-- Logs begin at Wed 2022-11-02 11:33:11 UTC, end at Wed 2022-11-02 13:23:58 UTC. -- Nov 02 12:11:29.382503 n-d-857339-6 systemd[1]: Starting Devstack devstack@keystone.service... Nov 02 12:11:29.393068 n-d-857339-6 devstack@keystone.service[82119]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:11:29 2022] *** Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: nodename: n-d-857339-6 Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: machine: x86_64 Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: clock source: unix Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: pcre jit disabled Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: detected number of CPU cores: 4 Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: current working directory: / Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:11:29.395103 n-d-857339-6 devstack@keystone.service[82119]: your processes number limit is 47680 Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: your memory page size is 4096 bytes Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: detected max file descriptor number: 2048 Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: lock engine: pthread robust mutexes Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: thunder lock: enabled Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 02 12:11:29.395818 n-d-857339-6 devstack@keystone.service[82119]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:11:29.433827 n-d-857339-6 devstack@keystone.service[82119]: Python main interpreter initialized at 0x55bdb2c879c0 Nov 02 12:11:29.433827 n-d-857339-6 devstack@keystone.service[82119]: python threads support enabled Nov 02 12:11:29.433827 n-d-857339-6 devstack@keystone.service[82119]: your server socket listen backlog is limited to 100 connections Nov 02 12:11:29.433827 n-d-857339-6 devstack@keystone.service[82119]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:11:29.434192 n-d-857339-6 devstack@keystone.service[82119]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:11:29.434264 n-d-857339-6 devstack@keystone.service[82119]: *** Operational MODE: preforking *** Nov 02 12:11:29.434516 n-d-857339-6 devstack@keystone.service[82119]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:11:29.434516 n-d-857339-6 devstack@keystone.service[82119]: spawned uWSGI master process (pid: 82119) Nov 02 12:11:29.434718 n-d-857339-6 systemd[1]: Started Devstack devstack@keystone.service. Nov 02 12:11:29.435466 n-d-857339-6 devstack@keystone.service[82119]: spawned uWSGI worker 1 (pid: 82131, cores: 1) Nov 02 12:11:29.435635 n-d-857339-6 devstack@keystone.service[82119]: spawned uWSGI worker 2 (pid: 82132, cores: 1) Nov 02 12:11:29.435782 n-d-857339-6 devstack@keystone.service[82119]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:11:33.787135 n-d-857339-6 devstack@keystone.service[82131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:11:33.787135 n-d-857339-6 devstack@keystone.service[82131]: from cryptography.utils import int_from_bytes Nov 02 12:11:33.787896 n-d-857339-6 devstack@keystone.service[82132]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:11:33.787896 n-d-857339-6 devstack@keystone.service[82132]: from cryptography.utils import int_from_bytes Nov 02 12:11:33.788317 n-d-857339-6 devstack@keystone.service[82131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:11:33.788317 n-d-857339-6 devstack@keystone.service[82131]: from cryptography.utils import int_from_bytes Nov 02 12:11:33.788421 n-d-857339-6 devstack@keystone.service[82132]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:11:33.788421 n-d-857339-6 devstack@keystone.service[82132]: from cryptography.utils import int_from_bytes Nov 02 12:11:33.838910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:11:33.838910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:11:33.839296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:11:33.839409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] command line args: [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:11:33.839515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:11:33.839515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] command line args: [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:11:33.839675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:11:33.839675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ================================================================================ {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:11:33.839864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:11:33.839864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ================================================================================ {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:11:33.840026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] admin_token = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.840109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] admin_token = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.840186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] config_dir = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.840676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.840889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] config_dir = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.841015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] config_source = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.841106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.842053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] debug = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.842146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] config_source = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.842263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.842601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] debug = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.842601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.843912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.843990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.844953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_config_append = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_config_append = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_dir = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_dir = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.845949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_file = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_file = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.846965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.847945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.848960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] publish_errors = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] publish_errors = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.849958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] standard_threads = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] standard_threads = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.850937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] use_journal = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] use_journal = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] use_json = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] use_json = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] use_stderr = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] use_stderr = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] use_syslog = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] use_syslog = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:11:33.851857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.851928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.852929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.853821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.854050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.854134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.854452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.854542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.854918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.855936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.856985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.857935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.858967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.859946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.860894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.861899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.862971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.863975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.864930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.865946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.866987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.867988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.868201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.868440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.868602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.868770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.868949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.869959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.870972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.871913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.872969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.873952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.874906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.875995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.876964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.877786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.external = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.external = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.878795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.password = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.password = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] auth.token = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] auth.token = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.879948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.880925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.881970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.882951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.883961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.884908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.885879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.886990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.887967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.888070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.888822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.888933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.889872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.890997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.891940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.892955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.893943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.894953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.895919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.896918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.897856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.898806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.899914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.900905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.901862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.902848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.903929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.904994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.905964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.906983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.907957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.908929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.909965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.910944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.911925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] role.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.912896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] role.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] role.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] role.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.913875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.914854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.915986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.916999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.917983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.918961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.919914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.920921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.921852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.922992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.923960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.924986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.925976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.connection = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.connection = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.926934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.927957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.928943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.929113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.934640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.934640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.934863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.935926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:11:33.936005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82132) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:11:33.936079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:11:33.960871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.961025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.961113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.961191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.961314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.961403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.969982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.970080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.998837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.999064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.999162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:33.999319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.052613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.052781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.101929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.102097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.102169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.102285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.258507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.258721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.258842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.258933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.259935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.282497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.282652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.282738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.282874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.282961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.283976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.295542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.295768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.311948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.312904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.313042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.313157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.313345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.313434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82132) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 02 12:11:34.330234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.330439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:11:34.330551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.330712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:11:34.330797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.330970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:11:34.331052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.331243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 02 12:11:34.331330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.331506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.331633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.331767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.331849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.332034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.332130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.332287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.341929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.342848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.350141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.350302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.353101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.353230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.353386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.353519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.353671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.353803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.353958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.354892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.355960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.379724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.379865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.381225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.381369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.381512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.381598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.386217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.386317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.386504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.386590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.386787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.386871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.393372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.393505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.393658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.393783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.399604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.399724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.399905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.399997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.400196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.400283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.401908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.402101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.402197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.402379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.402461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.418691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.418810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.422887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.422998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.423854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.423956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.427378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.427499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.427672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.427758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.432028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.432133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.435904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.436018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.439266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.439390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.439614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.439701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.439917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.440911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.457325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.457442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.457615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.457699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.457883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.457965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.458147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.458231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.465070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.465167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.467173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.467273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.468758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.468856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.469034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.469116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.471950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.472063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.472247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.472329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.472556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.472642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.472846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.472945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.473231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.473312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.484523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.484637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.484812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.484896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.485855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.486058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.486140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.486339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.486428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.501851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.501953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.504798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.504898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.507689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.507780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.509189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.509290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.513314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.513500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.513500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.513699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.513802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.513910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.518449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.518582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.519968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.520241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.522879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.522980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.523930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.533969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.534224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.537335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.537443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.537528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.537607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.542498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82132) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.542789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.543075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.543353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.543632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.543905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 02 12:11:34.544203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.544933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.545990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.546108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.546276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82132) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.546360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.546606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.546997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.547454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.548330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.548330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 02 12:11:34.581578 n-d-857339-6 devstack@keystone.service[82132]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bdb2c879c0 pid: 82132 (default app) Nov 02 12:11:34.583050 n-d-857339-6 devstack@keystone.service[82131]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bdb2c879c0 pid: 82131 (default app) Nov 02 12:11:34.585074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d772f0-1b3b-4dc3-bb80-2f953e7f73c7 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:34.585277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d772f0-1b3b-4dc3-bb80-2f953e7f73c7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:34.585550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d772f0-1b3b-4dc3-bb80-2f953e7f73c7 None None] PATH_INFO: `/v3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:34.589764 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Wed Nov 2 12:11:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:42.384451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:42.384988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:42.384988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:42.389251 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:42.395184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:42.395705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:42.395705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:42.467592 n-d-857339-6 devstack@keystone.service[82132]: INFO dbcounter [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] Registered counter for database keystone Nov 02 12:11:42.489059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG oslo_db.sqlalchemy.engines [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82132) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:11:42.496185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writer thread running {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:11:42.679582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG passlib.handlers.bcrypt [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82132) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 12:11:42.679878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG passlib.handlers.bcrypt [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82132) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 12:11:42.738915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:42.740613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:42.871131 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 12:11:43.349702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:43.420237 n-d-857339-6 devstack@keystone.service[82131]: INFO dbcounter [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] Registered counter for database keystone Nov 02 12:11:43.440179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG oslo_db.sqlalchemy.engines [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:11:43.446394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writer thread running {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:11:43.566222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64971c1e-041d-4fdb-ab2c-3e3c61dcb2a2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:43.570531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:43.571159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:43.571435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:43.571730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:43.579905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:43.631738 n-d-857339-6 devstack@keystone.service[82131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 12:11:43.632002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84bf48-96ee-4b79-9a05-76776b3c644c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:43.641630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Nov 2 12:11:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:11:43.647524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:43.665119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a20e46-5ea7-4fce-abf2-4f62d219dddf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:43.670506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:43.672239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:43.672239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:43.672239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] PATH_INFO: `/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:43.674050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] RBAC: Authorizing `identity:get_project(project_id=a77a9a466b3c4a1db84a2273ce5d6a0e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:43.727071 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.common.rbac_enforcer.enforcer [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 02 12:11:43.727416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c41018-8cd0-4b62-94c7-98c5dc1ee0ac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:43.732812 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:11:43 2022] GET /identity/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:45.880245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22031a1f-2f9f-42f0-8cb0-f7f6ea1dee95 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:45.880812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22031a1f-2f9f-42f0-8cb0-f7f6ea1dee95 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:45.880903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22031a1f-2f9f-42f0-8cb0-f7f6ea1dee95 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:45.885545 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:11:45.892311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:45.892311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:45.892311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:45.911990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:45.913556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:45.921597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:11:46.185677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22031a1f-2f9f-42f0-8cb0-f7f6ea1dee95 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:46.198204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22031a1f-2f9f-42f0-8cb0-f7f6ea1dee95 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:46.202398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:46.202983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:46.203255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:46.203523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:46.212844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:46.214593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745ff73-aeb5-4d5b-b0dd-ee882f891b0f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:46.223394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Nov 2 12:11:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:11:46.229211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:46.238230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dead222-dbf5-4ea7-9051-18d785c33090 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:46.242587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:46.243200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:46.243476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:46.243746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] PATH_INFO: `/v3/users/d787a32a40cf4bfab2a0a7e140cad17b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:46.245067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=d787a32a40cf4bfab2a0a7e140cad17b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:46.246874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b769f-a117-49a8-97bd-426b2bb296c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:46.248376 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Wed Nov 2 12:11:46 2022] GET /identity/v3/users/d787a32a40cf4bfab2a0a7e140cad17b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:48.450256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408b56-48c0-4a04-b039-9c1b7ed0ad2b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:48.450805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408b56-48c0-4a04-b039-9c1b7ed0ad2b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:48.450805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408b56-48c0-4a04-b039-9c1b7ed0ad2b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:48.452311 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:48.457785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:48.458259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:48.458385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:48.478259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:48.479477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:48.521913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496f327-aaeb-41fb-9dfb-ae0046c2dc94 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:48.522550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496f327-aaeb-41fb-9dfb-ae0046c2dc94 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:48.523583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496f327-aaeb-41fb-9dfb-ae0046c2dc94 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:48.525141 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:11:48.531347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:48.531629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:48.532038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:48.572761 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:48.578068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG passlib.handlers.bcrypt [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 02 12:11:48.578459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG passlib.handlers.bcrypt [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 02 12:11:48.627954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:48.629613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:48.736580 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:48.852125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:48.878808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:48.956968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830a86b-3b42-4055-8cfd-b9da88f7c9b8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:48.990569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:48.991121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:48.991921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:48.992194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.003310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:11:49.005574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:11:49.012797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:11:49.013759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:11:49.014560 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:11:49.019620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.111064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:49.113746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ecb54-956f-439d-92b1-7da071fbbf4c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.116208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:49.131166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4729ee-a105-4184-a88e-55d10822c7ef None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.156048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.156962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.157241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.157509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.158472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.159905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.177860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.179390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.179895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.180392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.181602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:11:49.182074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.184252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.206906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:49.212723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.224016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.sql.core [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:11:49.224016 n-d-857339-6 devstack@keystone.service[82131]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:11:49.224016 n-d-857339-6 devstack@keystone.service[82131]: [parameters: {'id': '49f61c8a5a004fd4be0ee5ca2a8ae20a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:11:49.224016 n-d-857339-6 devstack@keystone.service[82131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:11:49.243871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result.read() Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 12:11:49.244777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application yield resource Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise self.value Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application session.commit() Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:11:49.245681 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:11:49.246533 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:11:49.247950 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result.read() Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:11:49.249761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [parameters: {'id': '49f61c8a5a004fd4be0ee5ca2a8ae20a', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 12:11:49.251489 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:11:49.252410 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.253479 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 8/16] 10.222.0.64 () {60 vars in 1137 bytes} [Wed Nov 2 12:11:49 2022] POST /identity/v3/domains => generated 190 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:11:49.255529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.326825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ad3bf-b4bf-46c2-8c18-6673a606e4d0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.357410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cf194-41a7-461d-b5f6-0298899d0c3e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.361632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.362258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.362533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.362800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] PATH_INFO: `/v3/users/d787a32a40cf4bfab2a0a7e140cad17b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.363939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] RBAC: Authorizing `identity:get_user(user_id=d787a32a40cf4bfab2a0a7e140cad17b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.365421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.367530 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:11:49 2022] GET /identity/v3/users/d787a32a40cf4bfab2a0a7e140cad17b => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:49.373556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.389961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:49.392531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.393128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.393411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.393675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.411665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.413727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:11:49.431020 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:11:49.432006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:11:49.432869 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:11:49.432869 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:11:49.432869 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:11:49.432869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:11:49.438064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.461431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:49.481978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4133e898-4a14-42b9-bce3-da8332ca1ef2 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.520180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.520852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.521132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.521406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.522604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.524065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.525654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:49.531323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:49.548736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5a57-1dd6-490c-b991-c483db5163ad None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.583974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.584604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.585461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.585761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.586391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:11:49.589282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.589282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129b2e-48e9-42db-a977-d2dc28698b63 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.606166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:49.616097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:49.637869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db27c8-05c0-46fd-ab02-76ce4394e37c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:49.678067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:49.678792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:49.679068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:49.679342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] PATH_INFO: `/v3/domains/default/users/d787a32a40cf4bfab2a0a7e140cad17b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:49.681457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d787a32a40cf4bfab2a0a7e140cad17b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:49.682940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c52344-5833-46b7-9327-9af6453802b7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:49.893752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1361 bytes} [Wed Nov 2 12:11:49 2022] PUT /identity/v3/domains/default/users/d787a32a40cf4bfab2a0a7e140cad17b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:11:52.145152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee593-8041-40e9-8e89-df7c63398f77 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.145690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee593-8041-40e9-8e89-df7c63398f77 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.145690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eee593-8041-40e9-8e89-df7c63398f77 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.147058 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 11/22] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:52.153014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866427-ade0-4f88-b380-6d0e36f67d66 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.153413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866427-ade0-4f88-b380-6d0e36f67d66 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.153579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c866427-ade0-4f88-b380-6d0e36f67d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.181694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0c866427-ade0-4f88-b380-6d0e36f67d66 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:52.183326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0c866427-ade0-4f88-b380-6d0e36f67d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:52.268948 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:52.482833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c83b6-d5cf-48ea-a29d-d6b35fae86bf None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.483126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559315-c0ab-4811-82ab-d55c4ee0f657 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.483329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559315-c0ab-4811-82ab-d55c4ee0f657 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.483595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41559315-c0ab-4811-82ab-d55c4ee0f657 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.484026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c83b6-d5cf-48ea-a29d-d6b35fae86bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.484533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c83b6-d5cf-48ea-a29d-d6b35fae86bf None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.486373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:52.488297 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 13/25] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:11:52.493982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c2ace-5ac2-48d8-bd9c-acc3fd61d535 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.494532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c2ace-5ac2-48d8-bd9c-acc3fd61d535 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.495002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c2ace-5ac2-48d8-bd9c-acc3fd61d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.499344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.500246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.501276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.537889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-917c2ace-5ac2-48d8-bd9c-acc3fd61d535 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:52.539153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-917c2ace-5ac2-48d8-bd9c-acc3fd61d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:52.553786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:52.555014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:52.686891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 13/26] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:11:52.688798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427343-e2f2-465e-b132-1d7a98ddfdd9 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.692935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427343-e2f2-465e-b132-1d7a98ddfdd9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.694291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427343-e2f2-465e-b132-1d7a98ddfdd9 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.702330 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 14/27] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:52.704015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.705314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.706039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:52.706168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.730674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 14/28] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:52.749649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:52.750765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:52.753981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:52.761291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:52.862983 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:11:52.938201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c820dbe-59be-4328-8018-1ca1017ae612 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:52.983020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:52.983658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:52.983978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:52.984250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:52.997746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:52.999386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:11:53.026000 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:11:53.026916 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:11:53.027712 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:11:53.027712 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:11:53.027712 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:11:53.027712 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 15/30] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:11:53.034100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.094765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.187982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:53.188621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3ff9c-87eb-4ef8-a923-46d252371d60 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:53.234936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:53.236115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:53.236607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:53.237189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:53.238366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:11:53.239166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:53.241807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:53.247305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64b503-73e1-4e11-84a4-47adb55d9197 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:53.253108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:53.258407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 16/31] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:53.259908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.286555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:53.287431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:53.287844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:53.288215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:53.301548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:11:53.307358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:11:53.308461 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:11:53.309442 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:11:53.311148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 16/32] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:11:53.317328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.402006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac847b5e-edc7-4e77-a8d4-80775517e3a5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:53.432353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce415632-64f8-4b20-9e23-fee076882cdb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:53.449331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:53.462618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:53.464010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:53.464444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:53.465167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:53.466040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:53.468291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:53.474772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:53.475829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:53.476154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:53.476547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:53.477447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:53.478972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:53.638899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 17/33] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Nov 2 12:11:53 2022] POST /identity/v3/roles => generated 219 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:11:53.640056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.706192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 17/34] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Nov 2 12:11:53 2022] POST /identity/v3/roles => generated 225 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:11:53.707573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:53.828134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ce694-87ca-405b-b48e-dc2ae5164c52 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:53.858642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:53.925825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:53.927176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:53.928749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:53.929776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:53.934256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:53.936372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d59e4-232e-4259-9cc6-bb52b6acd0b0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:53.965098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364861-bb30-4018-af3b-e875825c4a0b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.011715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.012958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.013498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.013969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.014947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:11:54.015531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.017544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.033406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 18/35] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:54.040896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:54.082560 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 18/36] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:11:53 2022] POST /identity/v3/projects => generated 301 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:11:54.086634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97d04-d301-47d9-9666-5d463ec29f6e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.087334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97d04-d301-47d9-9666-5d463ec29f6e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.087681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97d04-d301-47d9-9666-5d463ec29f6e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.093021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 19/37] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:54.097432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.097778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.098055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.126156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:54.127960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:54.155393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:54.208888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d55729-5d04-4654-9e9b-d70db3adba0a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.228984 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 20/38] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:11:54.247579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:54.264853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.265885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.266362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.266860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] PATH_INFO: `/v3/users/d787a32a40cf4bfab2a0a7e140cad17b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.268812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] RBAC: Authorizing `identity:get_user(user_id=d787a32a40cf4bfab2a0a7e140cad17b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.271200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3954c2c-c92f-4d96-b9be-134973f96a99 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.273287 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 19/39] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:11:54 2022] GET /identity/v3/users/d787a32a40cf4bfab2a0a7e140cad17b => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:54.282357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:54.293295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f934-ba9c-465c-8c8c-b7b35a248737 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.293968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f934-ba9c-465c-8c8c-b7b35a248737 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.294445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f934-ba9c-465c-8c8c-b7b35a248737 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.296172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 20/40] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:11:54.303214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.303578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.303835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.324376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:54.326087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:54.407548 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:54.512176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357072e1-3ab2-41b5-88a5-7ca02cfd9ce5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.524964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:54.557278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.558043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.558412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.558791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.559748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.561267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.563126 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 21/42] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:54.569563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:54.597363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:54.635556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620f546-4322-43b4-b5d7-5bf9cda6a2e6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.660894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:54.676168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.676853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.677666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.678008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.678585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.679804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e2e-82e9-40b0-bb52-8bf07b7cf983 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.680037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.720456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.721093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.721373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.721647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.722359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.domain.id=default, user.id=d787a32a40cf4bfab2a0a7e140cad17b) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:11:54.722664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.724141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.731344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1322 bytes} [Wed Nov 2 12:11:54 2022] GET /identity/v3/role_assignments?user.id=d787a32a40cf4bfab2a0a7e140cad17b&scope.domain.id=default&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:11:54.732219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:54.769303 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Nov 2 12:11:54 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:11:54.845576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:54.864885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d887-f766-40d4-bd86-df6a7dff9947 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:54.913123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:54.913801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:54.914091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:54.914358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:54.915648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:54.917248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d512011-4990-4a32-b89b-7b65992f7c9a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:54.919132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 23/45] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:54.924980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:55.044123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3fa02-68ef-40c5-8c46-ca17d9073307 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:55.076364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7735c-f419-425b-8690-e3310848403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:55.076998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7735c-f419-425b-8690-e3310848403e None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:55.077279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7735c-f419-425b-8690-e3310848403e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:55.077552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7735c-f419-425b-8690-e3310848403e None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:55.078206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7735c-f419-425b-8690-e3310848403e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:55.079651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7735c-f419-425b-8690-e3310848403e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:55.165559 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:11:54 2022] POST /identity/v3/projects => generated 312 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:11:57.342491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1d2f-1b40-40d0-a3ce-b594e1f8c5bf None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:57.343059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1d2f-1b40-40d0-a3ce-b594e1f8c5bf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:57.343059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb1d2f-1b40-40d0-a3ce-b594e1f8c5bf None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:57.344355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:11:57.349742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:57.350148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:57.350372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:57.369825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:11:57.371166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:11:57.397336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:11:57.438033 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:11:57.704574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1d2f-1b40-40d0-a3ce-b594e1f8c5bf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:57.805853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb1d2f-1b40-40d0-a3ce-b594e1f8c5bf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:57.840007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:57.840655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:57.840932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:57.841264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:57.842294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:57.843782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b74d5b-e1bd-4e18-a89b-5c87dc0a1c3d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:57.845372 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:11:57.851769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:11:57.948321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c938a6-d3cf-4d93-9114-12ac4896896b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:11:57.982349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:11:57.982879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:11:57.983163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:11:57.983438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:11:57.984087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:11:57.985594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f5246-520b-4e9d-bb1a-3da09022cb89 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:11:58.063714 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 25/50] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Nov 2 12:11:57 2022] POST /identity/v3/projects => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:00.236770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5de04a-81f2-40db-87a8-b114820ad84e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:00.237291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5de04a-81f2-40db-87a8-b114820ad84e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:00.237291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5de04a-81f2-40db-87a8-b114820ad84e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:00.238762 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 26/51] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:00.244032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:00.244458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:00.244604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:00.263013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:00.264196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:00.273928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:00.435717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 26/52] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:00.704378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5de04a-81f2-40db-87a8-b114820ad84e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:00.730074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:00.811640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5de04a-81f2-40db-87a8-b114820ad84e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:00.847703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:00.848330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:00.848640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:00.848913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:00.850012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:00.851465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce999f-b571-456a-ba33-95ff8d9dbb6d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:00.860862 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:00.860985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:00.957457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d69031-1160-4bc7-bab7-3124490cbf95 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:00.990252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:00.990851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:00.991127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:00.991399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:00.992037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:00.993509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60298e11-d6da-4d1e-946f-aa49cdf1e44a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:01.077921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:01.082943 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 27/54] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:00 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:04.404670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089650-7dce-4afe-855b-229d1bb72566 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.405183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089650-7dce-4afe-855b-229d1bb72566 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.405183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a089650-7dce-4afe-855b-229d1bb72566 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.406710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 28/55] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:04.413905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c72d-6cba-411a-86b0-5e14d486e5bf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.414743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c72d-6cba-411a-86b0-5e14d486e5bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.415236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41c72d-6cba-411a-86b0-5e14d486e5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.449603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3c41c72d-6cba-411a-86b0-5e14d486e5bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:04.451186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c41c72d-6cba-411a-86b0-5e14d486e5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:04.531142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72505e4-b7ec-4586-bf06-54cb0fe3d177 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.531466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72505e4-b7ec-4586-bf06-54cb0fe3d177 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.531686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72505e4-b7ec-4586-bf06-54cb0fe3d177 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.533661 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 29/56] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:04.540207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce1e8a-7077-4554-b7d1-c82d827af1db None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.540554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce1e8a-7077-4554-b7d1-c82d827af1db None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.540791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce1e8a-7077-4554-b7d1-c82d827af1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.559224 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 28/57] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:04.574384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-48ce1e8a-7077-4554-b7d1-c82d827af1db None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:04.575604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-48ce1e8a-7077-4554-b7d1-c82d827af1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:04.678226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 30/58] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:04.764349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee853-44c3-439a-8227-071c5f8f8035 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.765040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee853-44c3-439a-8227-071c5f8f8035 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.765568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ee853-44c3-439a-8227-071c5f8f8035 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.767254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 29/59] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:04.773350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.773651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.773900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.801325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:04.802504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:04.825486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:04.884069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7367a3-ffad-4b07-97b9-fdbe9d574ad4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.884720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7367a3-ffad-4b07-97b9-fdbe9d574ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.885231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7367a3-ffad-4b07-97b9-fdbe9d574ad4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.886970 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 30/60] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:04.896513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:04.896513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:04.896513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:04.915374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:04.917390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:04.920201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 31/61] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:04.995007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 31/62] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:05.000797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.019098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.138163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.201376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca182-87a4-416f-b9de-8181a5b7bad7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.219160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52005e-0762-4971-a012-45ce40f4ffee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.258000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.258569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.258849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.259125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.276885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:05.282421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:05.283861 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:05.284761 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 32/63] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:05.285381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.289344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.290393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.290683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.290957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.299532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.304678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:05.310787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:05.315289 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 32/64] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:05.316071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.393829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17315147-20de-4040-97dd-0735dc5d3d11 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.428156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.428888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.429082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.429355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.429828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed2ac4-dce6-453a-b4f0-6085dfd59608 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.440560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:05.445412 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:05.446236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 33/65] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:05.448322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.450079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.464785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.465419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.465699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.465970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.476672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:05.481891 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:05.482747 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:05.483527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 33/66] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:05.484160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.521606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.552388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770b16f-9bec-4902-8918-6045675701e7 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.587490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.588089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.588365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.588679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.588998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889bd9b-9f41-46be-a49e-29b79bd14d9e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.589337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:05.589643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:05.591025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ffb2a1-9144-45d7-b4fa-57388a71bf5e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:05.600237 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 34/67] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:05.601462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b92e2-ec2e-4e83-9042-fad0a3b5b64b None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.601742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b92e2-ec2e-4e83-9042-fad0a3b5b64b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.602013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b92e2-ec2e-4e83-9042-fad0a3b5b64b None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.603219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 35/68] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:05.607801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b92e2-ec2e-4e83-9042-fad0a3b5b64b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.627274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.627878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.628152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.628419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.629103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:05.629402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:05.631738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:05.638795 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:05.639615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.682487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.710326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b92e2-ec2e-4e83-9042-fad0a3b5b64b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.738535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898af16-162c-4ed9-aa2e-e000fb336e49 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.741050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.745904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.746584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.746868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.747298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.748008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:05.748317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:05.749757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:05.758570 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 36/70] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:05.759727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.777340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.777875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.778162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.778435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.779117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:05.779393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:05.780796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14b938-a81f-4d4d-8175-c7ae995258b0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:05.789337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:05.790485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.790771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.791045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.809056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:05.810266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:05.866964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb89b-a4d5-4928-a7e2-3b2d7f3ec064 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:05.877021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 36/72] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:05.877873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.905254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:05.905947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:05.906233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:05.906505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:05.921139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.921312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:05.922693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:05.924999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:05.925775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:05.985526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:05.992923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a326c-8105-4472-83b8-4bf182af1c27 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.029624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.030178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.030456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.030728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] PATH_INFO: `/v3/users/d787a32a40cf4bfab2a0a7e140cad17b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.031964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=d787a32a40cf4bfab2a0a7e140cad17b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.033965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.039887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 37/74] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/users/d787a32a40cf4bfab2a0a7e140cad17b => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.039887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.040457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009ccc-f7fe-49e4-b91d-d931b553f539 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.085040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.085769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.086053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.086326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.087610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.089476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.091163 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:05 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.091831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.153134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9bfca-6b4a-4223-bcad-19f30ebe7dd9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.154710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.190833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.191467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.191748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.192020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.193189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.194614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.196188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 38/76] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.197057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.197783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691a130-73f5-4ca1-bbee-ae5c074c18f2 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.219003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.234757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.235935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.236213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.236511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.237682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.239150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.240854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 39/77] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.241634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.300318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11fda1-063f-4cd4-8760-65357302ae4e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.335453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.336102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.336402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.336706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.337845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.339286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.340984 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.341740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.350411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca0c71-929c-42c0-aaec-342faca8d510 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.384811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.385946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.386589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.386873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.387149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] PATH_INFO: `/v3/projects/8742255bfc104dc18de176c39dceb448` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.388294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] RBAC: Authorizing `identity:get_project(project_id=8742255bfc104dc18de176c39dceb448)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.389803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.396727 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/projects/8742255bfc104dc18de176c39dceb448 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.396727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.445802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d9353-08f3-4495-9bb0-d3b8684d518f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.449335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.480837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.481462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.481776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.482048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.483145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.484615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.486176 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.486908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.495747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33af6f-d040-42c2-9056-3df6c08b44da None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.534057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.534692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.534976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.535250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.536384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.537877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.539552 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:06 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:06.540259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.592004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd2e1-8f2e-4901-ba95-92d9ac8d2c0c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.600242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.628997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.629657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.629982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.630213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/25285d71f0ed4b71b81cb814f99299bd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.632205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, user_id=25285d71f0ed4b71b81cb814f99299bd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.633692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.646006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82c824-ec80-4fe9-a143-1ddc66e36c9c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.670085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:06.681081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.681738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.682022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.682298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/d787a32a40cf4bfab2a0a7e140cad17b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.684200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, user_id=d787a32a40cf4bfab2a0a7e140cad17b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.685690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.711968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 41/82] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:06 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/25285d71f0ed4b71b81cb814f99299bd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:06.712814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.826330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83032ebf-4776-4801-9419-5f98b08664a2 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.840748 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 42/83] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:06 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/d787a32a40cf4bfab2a0a7e140cad17b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:06.841607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:06.884104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:06.887947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:06.887947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:06.887947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] PATH_INFO: `/v3/projects/8742255bfc104dc18de176c39dceb448/users/25285d71f0ed4b71b81cb814f99299bd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:06.888751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] RBAC: Authorizing `identity:create_grant(project_id=8742255bfc104dc18de176c39dceb448, user_id=25285d71f0ed4b71b81cb814f99299bd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:06.890469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:06.981356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933821d-f9ea-404f-85d5-a0815eb25865 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:06.991320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 42/84] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:06 2022] PUT /identity/v3/projects/8742255bfc104dc18de176c39dceb448/users/25285d71f0ed4b71b81cb814f99299bd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:06.993798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:07.037433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:07.069382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:07.070019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:07.070298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:07.070567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:07.071248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:07.072866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbbbb5-00fa-4a60-9fc1-8ca37fafad41 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:07.141137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a247e-6741-458d-88bd-1b5fd4621759 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:07.195162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:07.196174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:07.196677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:07.197140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/25285d71f0ed4b71b81cb814f99299bd/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:07.199656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, user_id=25285d71f0ed4b71b81cb814f99299bd, role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:07.201570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084ae55-a29f-4b5e-8734-fed11e03711b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:07.222831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 43/85] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:06 2022] POST /identity/v3/users => generated 289 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:07.326201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:06 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/25285d71f0ed4b71b81cb814f99299bd/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:09.317808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496b2a-da5f-4c9b-b415-3f401d5efbd8 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:09.318324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496b2a-da5f-4c9b-b415-3f401d5efbd8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:09.318324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd496b2a-da5f-4c9b-b415-3f401d5efbd8 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:09.319983 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 44/87] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:09.325657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9031b-58aa-4a9f-9517-4ea6ea845a8a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:09.326092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9031b-58aa-4a9f-9517-4ea6ea845a8a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:09.326283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9031b-58aa-4a9f-9517-4ea6ea845a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:09.349559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-85a9031b-58aa-4a9f-9517-4ea6ea845a8a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:09.350797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85a9031b-58aa-4a9f-9517-4ea6ea845a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:09.455122 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 44/88] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:10.056567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd496b2a-da5f-4c9b-b415-3f401d5efbd8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:10.121232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:10.194819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2740-a3f3-49a6-a1e3-dc3669bf0a87 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.195154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2740-a3f3-49a6-a1e3-dc3669bf0a87 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.195382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2740-a3f3-49a6-a1e3-dc3669bf0a87 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.200519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 45/89] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:10.201783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222246d6-730a-498f-b082-c29d45466fde None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.202155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222246d6-730a-498f-b082-c29d45466fde None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.202815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222246d6-730a-498f-b082-c29d45466fde None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.204114 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 46/90] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:10.209136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd496b2a-da5f-4c9b-b415-3f401d5efbd8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:10.211634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.212134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.212634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.252541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:10.253895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:10.270692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:10.272140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.272647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.273089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.300099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:10.301052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7d373a6c-448b-4405-99a8-adb436515290 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:10.314676 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:10.315590 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:10.316673 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 45/91] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:10.320514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4b08-c558-4c8f-848d-4305051c6039 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.320514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4b08-c558-4c8f-848d-4305051c6039 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.320514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c4b08-c558-4c8f-848d-4305051c6039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.343503 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 47/92] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:10.344473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:10.373703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ac8c4b08-c558-4c8f-848d-4305051c6039 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:10.375452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac8c4b08-c558-4c8f-848d-4305051c6039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:10.468602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf182a-ba98-4a05-bb7d-11b6389c06f3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:10.505819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:10.506625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.506914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.507326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.508000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:10.508305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:10.509730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:10.519251 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 48/93] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:10.525579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:10.540148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 46/94] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:10.549096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:10.635556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ef92-37e4-42db-bfd8-b7b30a2af8e5 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.635925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ef92-37e4-42db-bfd8-b7b30a2af8e5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.636123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41ef92-37e4-42db-bfd8-b7b30a2af8e5 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.637517 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 47/95] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:10.643328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.643618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.643898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.657608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55d5cb-d826-4a82-8e5c-9759ca837aa6 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:10.693449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:10.694110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:10.694218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.694440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.694716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.695343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:10.695900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:10.697381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9e27d-7abc-456b-9ca8-d4399082fe0f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:10.699316 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:10 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:10.700456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a705-a288-4643-bce9-75cafe5e19d4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.700809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a705-a288-4643-bce9-75cafe5e19d4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.701088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a705-a288-4643-bce9-75cafe5e19d4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.702294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 50/97] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:10.710099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:10.710386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:10.710655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:10.750685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:10.751877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:10.758812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:10.829204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 48/98] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:10.830541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:10.852685 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 51/99] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:10.853536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:10.863937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:10.964644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa60c5-b42b-4dc5-8d64-ddf89f6c1113 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.002598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77954c6-7a7a-4e8b-b330-09f2a31ce0ce None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.003748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.004361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.004670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.004999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.063258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.072855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.073762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.073762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.074039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.086419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:11.091415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:11.092259 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:11.093587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 52/100] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:11.094224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.135882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.137426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.167324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.211948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af739736-7df3-4827-9a25-8903b532c403 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.255021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.255569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.255852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.256115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.268009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:11.273478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:11.274346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:11.275113 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 53/101] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:11.276426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.284139 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 49/102] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:11.285206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.347580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.387768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c1d1-9194-414c-99b1-5fd15fc50a2c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.389215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a69fa-fe7b-467f-af83-2e37a8e8f77b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.415532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.424328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.424764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.424983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.425229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.425396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.425514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.425673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.425922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.426141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:11.426440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.428224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.436075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:11.437799 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 54/103] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.438642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:11.441864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:11.442833 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:11.443578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 50/104] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:11.444218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.541798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a991c1-8a06-49b4-9235-aff8a1a5e2cd None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.550603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d392126-c62e-4f34-8c6a-51a402761cb5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.572011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.577325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.577965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.578241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.578512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.586231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.586745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.587017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.587290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.587961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:11.588288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.588758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:11.589693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6244d-6e5d-4c75-af42-0af94ff4801d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:11.593618 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:11.594818 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 55/105] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:11.595606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.598283 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 51/106] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.599339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4de59-7557-4a9f-8242-a9b87b89ea58 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.599635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4de59-7557-4a9f-8242-a9b87b89ea58 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.599956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4de59-7557-4a9f-8242-a9b87b89ea58 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.601578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 52/107] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:11.602293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4de59-7557-4a9f-8242-a9b87b89ea58 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.652546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.703163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df45e4-20f7-4d73-badf-0ec2b35ad556 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.708533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4de59-7557-4a9f-8242-a9b87b89ea58 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.737175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.737806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.738085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.738359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.739557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.741037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.742662 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 56/108] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.742824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.743417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.746583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.746872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.747150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.748456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.749974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.751582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 53/109] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.752348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.802843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.844597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603d8d9-4207-4994-9689-a7a1f2a7ef38 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.855746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc30e31-9634-4453-a6fe-2d0757faba9e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.861606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:11.879511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.880026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.880306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.880617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.881284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:11.881587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.882963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.890646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:11.891291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.891567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.891837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.896905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 57/110] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.897070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:11.897070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:11.897228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:11.897309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef89a2-e66a-49eb-90a0-249c8c4f3c11 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:11.902603 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 54/111] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:11.903798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:11.904079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:11.904348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:11.922054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:11.923269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:11.990889 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 55/112] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:11.994083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6050d9c-b338-42ff-a00e-a0a0b5aef6e8 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:11.997415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.034522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.035152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.035428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.035700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] PATH_INFO: `/v3/users/d787a32a40cf4bfab2a0a7e140cad17b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.036873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] RBAC: Authorizing `identity:get_user(user_id=d787a32a40cf4bfab2a0a7e140cad17b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.038310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.040034 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 58/113] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/users/d787a32a40cf4bfab2a0a7e140cad17b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.040662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.049844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.092070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.114315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6838-b066-452b-83ad-3e63dee4294c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.149273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2cfc7-4e9f-48a1-b7c1-d33989c81a38 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.151924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.152631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.152952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.153182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.153898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] RBAC: Adding query filter params (role.id=8a005951b7924bba902f57f978fd27d0, scope.project.id=29b16a0ffa434edf88667c6f42f00624, user.id=25285d71f0ed4b71b81cb814f99299bd) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:12.154202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.156287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.162524 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 56/114] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:11 2022] GET /identity/v3/role_assignments?user.id=25285d71f0ed4b71b81cb814f99299bd&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=8a005951b7924bba902f57f978fd27d0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.163123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.195606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.196233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.196539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.196814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.292760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.293221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d610a-5f57-4cdd-b3cc-4276989c5057 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.294275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.302994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.336603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.337918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.338199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.338470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] PATH_INFO: `/v3/users/25285d71f0ed4b71b81cb814f99299bd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.339687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] RBAC: Authorizing `identity:get_user(user_id=25285d71f0ed4b71b81cb814f99299bd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.341193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.348350 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 57/115] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/users/25285d71f0ed4b71b81cb814f99299bd => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.348350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.353721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.425034 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 59/116] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:12.425899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.458036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab1c68-8c4d-4ec3-b33b-da4d4aad19ec None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.492465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.493115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.493397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.493671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] PATH_INFO: `/v3/users/4d7cf99897254550aeb7ab63c7444fb5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.507512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] RBAC: Authorizing `identity:get_user(user_id=4d7cf99897254550aeb7ab63c7444fb5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.509032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.511750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 58/117] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/users/4d7cf99897254550aeb7ab63c7444fb5 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.511750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.533164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863acea-5230-4b49-a059-be1a24537575 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.544820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.567971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.568610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.569101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.569573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.586675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.616257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5d143-44ac-4936-8d7a-57b2b7084d60 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.644313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.645865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.650409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.651038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.651317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.651587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.652717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.654153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.655721 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 59/118] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.656507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.751432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 60/119] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:12.752285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.759166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.762169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565a63a-b01a-47b8-aa78-ebbf7b61093d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.797585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.798191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.798472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.798747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.799143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.853511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d11480-034c-49ea-9758-908234ffaa5d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:12.867455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.868902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.888853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:12.889503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:12.889828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:12.890167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] PATH_INFO: `/v3/projects/8742255bfc104dc18de176c39dceb448` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:12.891326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] RBAC: Authorizing `identity:get_project(project_id=8742255bfc104dc18de176c39dceb448)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:12.893005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:12.894821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 61/120] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/projects/8742255bfc104dc18de176c39dceb448 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:12.895577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:12.973162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:12.981821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 60/121] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:12.983204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.009929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042adfe8-affa-4800-9fe4-6b27e288e731 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.024023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.044499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.045232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.045537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.045812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.046981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.048437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.050262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 62/122] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:12 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:13.050892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.086843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9eeb-5906-40cc-a6e7-556260b58b2f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.120136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.120688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.120965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.121228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.121865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.123313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.152154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff3b25-d3a4-4d40-bd50-5627013d0251 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.184970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.185585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.185864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.186709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.187810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.189273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.191084 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 63/123] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:13 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:13.191670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.196620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 61/124] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:12:12 2022] POST /identity/v3/projects => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:13.201538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.254046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.266765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.317361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad446e1-f7aa-4c62-b82c-2e6ef47388d7 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.324320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2cd5a-507b-4ccf-9a95-c5f1c0f685c5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.358398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.359021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.359301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.359571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.360309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] RBAC: Adding query filter params (role.id=8a005951b7924bba902f57f978fd27d0, scope.project.id=8742255bfc104dc18de176c39dceb448, user.id=25285d71f0ed4b71b81cb814f99299bd) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:13.360657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.362123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.366009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.366662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.366945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.367767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.368983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.370572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.370682 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 64/125] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:13 2022] GET /identity/v3/role_assignments?user.id=25285d71f0ed4b71b81cb814f99299bd&scope.project.id=8742255bfc104dc18de176c39dceb448&role.id=8a005951b7924bba902f57f978fd27d0 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:13.378333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.378507 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 62/126] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:13 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:13.378507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.517462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13a138-d107-4d0b-a1be-698f88e9c43e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.520732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac219-47e4-4ef6-90bc-5ad01a38ab4e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.537049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.554272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:13.566844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.567533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.567813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.568090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/4d7cf99897254550aeb7ab63c7444fb5/roles/918a633e0b864acf94133fa03aa0827b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.570169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, user_id=4d7cf99897254550aeb7ab63c7444fb5, role_id=918a633e0b864acf94133fa03aa0827b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.571754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a02b68-5205-4c06-8f7d-b8d03cf4b06c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.574292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.575090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.575393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.575670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.577727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=29b16a0ffa434edf88667c6f42f00624, user.id=d787a32a40cf4bfab2a0a7e140cad17b) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:13.578043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.579682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.586890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 63/127] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:13 2022] GET /identity/v3/role_assignments?user.id=d787a32a40cf4bfab2a0a7e140cad17b&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:13.587772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:13.653906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 65/128] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:13 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/users/4d7cf99897254550aeb7ab63c7444fb5/roles/918a633e0b864acf94133fa03aa0827b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:13.728072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b39c78-bd2e-45f7-bc50-4262b697954c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:13.773002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:13.773767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:13.774059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:13.774336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:13.775154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] RBAC: Adding query filter params (role.id=81a2fc90eeda4eefb2eef3ff435097cb, scope.project.id=29b16a0ffa434edf88667c6f42f00624, user.id=25285d71f0ed4b71b81cb814f99299bd) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:13.775472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:13.777107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc124a9-1caa-43c6-8b05-69ee7df28794 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:13.784827 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 64/129] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:13 2022] GET /identity/v3/role_assignments?user.id=25285d71f0ed4b71b81cb814f99299bd&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=81a2fc90eeda4eefb2eef3ff435097cb => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:15.502352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71744-5da5-447c-b390-cf113ba8f582 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:15.502352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71744-5da5-447c-b390-cf113ba8f582 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:15.502352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df71744-5da5-447c-b390-cf113ba8f582 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:15.504367 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 66/130] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:15.509880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c16-45cf-4735-be4a-58733cece708 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:15.510275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c16-45cf-4735-be4a-58733cece708 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:15.510523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616c16-45cf-4735-be4a-58733cece708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:15.529840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f0616c16-45cf-4735-be4a-58733cece708 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:15.531059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f0616c16-45cf-4735-be4a-58733cece708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:15.574797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:15.599003 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 65/131] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:15.858694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790700b-4995-4963-945d-f1a52424e87a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:15.859120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790700b-4995-4963-945d-f1a52424e87a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:15.859243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790700b-4995-4963-945d-f1a52424e87a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:15.860591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 67/132] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:15.865962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:15.866329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:15.866677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:15.873189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790700b-4995-4963-945d-f1a52424e87a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:15.885401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:15.897638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:15.959315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 66/133] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:15.981501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4790700b-4995-4963-945d-f1a52424e87a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.014553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.015168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.015446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.015717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.016830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:16.018301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:16.019856 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 68/134] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:16.025366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:16.124072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44905aa-05c3-4391-a83d-75987ef4ea93 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.133391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:16.158752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.159355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.159633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.159903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.160595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:16.162036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:16.228263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:16.245804 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 67/135] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:16 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:16.277418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:16.340696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b27a99-c074-4868-92a5-9107bfa7111c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.378439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.379049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.379326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.379593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.391742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:16.397244 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:16.398236 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:16.399220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 69/136] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:16.404480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:16.511439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8271-e399-4c6c-8770-a3d00fdcab13 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.549560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.550170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.550444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.550709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.551370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:16.551670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:16.553088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:16.562036 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 68/137] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:16.567950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:16.685747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a43b-96a8-4137-bb1c-42bf9d1356bf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.687390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:16.723777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.724427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.724740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.725018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] PATH_INFO: `/v3/users/4d7cf99897254550aeb7ab63c7444fb5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.726163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] RBAC: Authorizing `identity:get_user(user_id=4d7cf99897254550aeb7ab63c7444fb5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:16.727765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:16.729584 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 70/138] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:16 2022] GET /identity/v3/users/4d7cf99897254550aeb7ab63c7444fb5 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:16.735583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:16.768087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:16.850263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2662411-a60b-430f-9db7-21068cdfc011 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:16.889927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:16.890545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:16.890870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:16.891153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:16.963690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:16.965150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:17.008882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:17.077513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 69/139] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:17.084149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:17.190130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e19e7-fd37-4c65-b38c-dd3fd4c09e7d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:17.226069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:17.226799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:17.227147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:17.227424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:17.228579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:17.230021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5a0a-6804-4721-a4ca-287fb155d3c9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:17.232404 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 71/140] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:17 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:17.243513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:17.357961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b0084-316b-44fb-81fa-cab8a414accc None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:17.384601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:17.394159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] RBAC: Adding query filter params (role.id=918a633e0b864acf94133fa03aa0827b, scope.project.id=29b16a0ffa434edf88667c6f42f00624, user.id=4d7cf99897254550aeb7ab63c7444fb5) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:17.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8abc4-ea23-4895-88c5-00be878eba81 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:17.403933 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 70/141] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:17 2022] GET /identity/v3/role_assignments?user.id=4d7cf99897254550aeb7ab63c7444fb5&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=918a633e0b864acf94133fa03aa0827b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:18.622535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa972-6ad1-4180-8c1e-b5f955a3b7d3 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.623060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa972-6ad1-4180-8c1e-b5f955a3b7d3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.623060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa972-6ad1-4180-8c1e-b5f955a3b7d3 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.624432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 72/142] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:18.630520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d361e5-6363-44d2-84b0-964e42dfb487 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.630951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d361e5-6363-44d2-84b0-964e42dfb487 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.631130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d361e5-6363-44d2-84b0-964e42dfb487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.649577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-14d361e5-6363-44d2-84b0-964e42dfb487 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:18.650773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-14d361e5-6363-44d2-84b0-964e42dfb487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:18.733798 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 71/143] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:18.800885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3869db-0add-4617-9306-f70b7a6e1a35 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.801207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3869db-0add-4617-9306-f70b7a6e1a35 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.801445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3869db-0add-4617-9306-f70b7a6e1a35 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.802712 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 73/144] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:18.808625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.808987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.809902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.830865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:18.832036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:18.844776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3ddb-6a11-4f63-809b-7e420724ec21 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.845102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3ddb-6a11-4f63-809b-7e420724ec21 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.845340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b3ddb-6a11-4f63-809b-7e420724ec21 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.846857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 74/145] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:18.851668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:18.851965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:18.865059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:18.870819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:18.872621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:18.906950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:18.912624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 72/146] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:18.947212 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 75/147] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:19.013697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.067379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.119323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e493b-cf1f-48f7-b452-27e082e7316d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.154257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.154889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.155198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.155428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.165552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:19.170834 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:19.171746 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:19.172546 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 73/148] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:19.179085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.181008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.281184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae7542-a88b-45f3-9f62-b76176ac4148 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.284761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badd51e-25ff-49c0-9b10-bf8f3bc2ae9e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.294949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.316058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.320226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.320226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.320226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.320226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:19.320599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.320685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.320771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.320771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.320771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.320938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.328850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 76/149] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.329686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.334900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:19.340804 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:19.341967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:19.342962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 74/150] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:19.343866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.364831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.438263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3a59c-f4b7-4a03-b06b-36d23948fef6 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.446264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b55bf-1c3d-4a77-ab06-d7ad6cb9a07a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.472879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.473503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.473777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.474046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.475142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.476621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.478333 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 77/151] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.478918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.482357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.482990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.483267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.483542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] PATH_INFO: `/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.497009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] RBAC: Authorizing `identity:get_user(user_id=f699f9ff35304668ad3e0a0d4c8d8b65)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.498513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.500165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 75/152] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.500165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.532377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.582016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.585396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d202b-dddf-40e2-aeca-4d673e47c791 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.605677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb3318-d550-4619-bbdb-a8f880a32d92 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.621109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.621731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.622007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.622272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.622919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:19.623434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.624571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.632594 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 78/153] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.633383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.644947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.645559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.645820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.646085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.646722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.648175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.732863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf90d2e-f8bc-45e1-be08-4bafa25a15f2 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.756890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 76/154] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:19 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:19.757719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.770085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.770728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.771007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.771281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.773187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.774819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.776630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 79/155] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.782963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.818427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.877181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:19.896109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877e991-a80f-4832-88ef-13ffd282b0fb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.906911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16a82b-8c12-4c64-80e7-bc920c2620fc None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:19.941137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.942047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.942330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.942599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] PATH_INFO: `/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.944740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] RBAC: Authorizing `identity:get_user(user_id=f699f9ff35304668ad3e0a0d4c8d8b65)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.945829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:19.947018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 77/156] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:19.948015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:19.948794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:19.949224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:19.949444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/f699f9ff35304668ad3e0a0d4c8d8b65/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:19.951575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, user_id=f699f9ff35304668ad3e0a0d4c8d8b65, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:19.952853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:19.953079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:20.021019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 80/157] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:19 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/f699f9ff35304668ad3e0a0d4c8d8b65/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:12:20.075315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb43d-a74a-4d73-bde3-8774c462592a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:20.117220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:20.117870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:20.118154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:20.118420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:20.119625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:20.121162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae43a4-8937-4717-a294-48a18928e399 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:20.123541 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 78/158] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:19 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:20.129776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:20.235011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:20.247634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da09d12-3e29-49cf-8206-d12d5624e93b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:20.284867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:20.285539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:20.285816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:20.286090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/f699f9ff35304668ad3e0a0d4c8d8b65/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:20.288300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, user_id=f699f9ff35304668ad3e0a0d4c8d8b65, role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:20.289791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c42bb0e-d55d-40c1-a053-ded979f40992 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:20.388893 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 81/159] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:20 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/f699f9ff35304668ad3e0a0d4c8d8b65/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:22.153219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57d8b-3e24-4019-b653-d65ebbbbf03e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.153773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57d8b-3e24-4019-b653-d65ebbbbf03e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.153773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea57d8b-3e24-4019-b653-d65ebbbbf03e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.155433 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 79/160] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:22.161417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e90f-a402-447d-9a74-17585c1012f2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.161945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e90f-a402-447d-9a74-17585c1012f2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.161945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5e90f-a402-447d-9a74-17585c1012f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.181761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dfc5e90f-a402-447d-9a74-17585c1012f2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:22.183625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dfc5e90f-a402-447d-9a74-17585c1012f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:22.252462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7d57-f3a2-440f-a7c3-33be78f65378 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.252831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7d57-f3a2-440f-a7c3-33be78f65378 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.253109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad7d57-f3a2-440f-a7c3-33be78f65378 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.254452 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 80/161] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:22.260078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f52c-a1d0-4eaf-91bc-2b7adb77e1be None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.260354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f52c-a1d0-4eaf-91bc-2b7adb77e1be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.260648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f52c-a1d0-4eaf-91bc-2b7adb77e1be None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.261879 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 82/162] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:22.262629 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 81/163] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:22.263433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.263876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.264279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.268709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9df15-ea1f-4346-8709-c7b567dbf509 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.269061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9df15-ea1f-4346-8709-c7b567dbf509 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.269362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9df15-ea1f-4346-8709-c7b567dbf509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.284925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:22.286227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:22.294090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-80a9df15-ea1f-4346-8709-c7b567dbf509 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:22.296202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80a9df15-ea1f-4346-8709-c7b567dbf509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:22.317459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:22.369205 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 83/164] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:22.387504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 82/165] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:22.537519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:22.549011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:22.629458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c26c3-0ba3-4b92-89da-c0fb161939de None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.630126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c26c3-0ba3-4b92-89da-c0fb161939de None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.630618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c26c3-0ba3-4b92-89da-c0fb161939de None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.632180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 83/166] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:22.637421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.637952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.638706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.645905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79600c0-5d8d-4117-9a2b-aa4d16360206 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:22.658342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:22.659889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:22.685278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:22.685910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.686217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.686460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.697012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:22.702643 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:22.703767 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:22.704623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 84/167] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:22.705266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:22.734515 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 84/168] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:22.735729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:22.772965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:22.810612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1a9e2-360e-4fcf-9b36-ffc60015f9da None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:22.822575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:22.844527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fc30f-9926-43ff-bf48-36a4434c1dfc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:22.845962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:22.846597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.846876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.847143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.848656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:22.850062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:22.851792 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 85/169] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:22.853436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:22.882245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:22.882875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:22.883148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:22.883414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:22.894785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:22.899742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:22.900863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 85/170] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:22.901662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:22.981627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2e61e-ee9b-4ae6-8c95-ef186c06502d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.015572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.016179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.016453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.016751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.017403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:23.017701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.019087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.021222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.035869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 86/171] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.035869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.074150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c687f1-ca52-406c-99b2-8b17ce668784 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.110279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.110879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.111156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.111489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.112137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.113631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.126041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.139108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423129c-1515-4613-bd2d-20060d38ec29 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.171227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.171836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.172095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.172364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.173053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:23.173359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.174732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.182461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 87/172] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.183785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.219353 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 86/173] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:22 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:23.219353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.254246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.300662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b29a42-2eda-4d4a-bcb6-6dda9b267c68 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.336915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98200a6e-82e2-477d-a5c1-c553659f3d5e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.344219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.344906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.345191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.345464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.358678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:23.364253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:23.368771 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 88/174] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:23.369646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.380655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.381408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.381750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.382113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] PATH_INFO: `/v3/users/eb046e55c0194fad99fe204a627c4303` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.397068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] RBAC: Authorizing `identity:get_user(user_id=eb046e55c0194fad99fe204a627c4303)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.398292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.400011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 87/175] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/users/eb046e55c0194fad99fe204a627c4303 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.400788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.471973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.492083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f71e4-c3a3-4d2f-9d8c-2856deb75284 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.521411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f0015-b653-47e1-b374-278f6efa6e1a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.522370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.539881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.540585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.540812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.541082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] PATH_INFO: `/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.542338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f699f9ff35304668ad3e0a0d4c8d8b65)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.543798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.545588 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 89/176] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.546295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.576233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.577494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.578095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.578543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.579719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:23.580188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.581726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.591279 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 88/177] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.591966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.672339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c5d66-816f-4cc9-a037-fd7614c7d5d8 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.710325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.711138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.711419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.711690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.712866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.714930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.716896 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 90/178] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.722268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.726138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294eab1-8a43-4a78-a764-3666c06d8a03 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.747509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.771945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.772591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.772876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.773333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.784971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:23.840027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5f63-c399-456b-843b-6d9a91ff81ba None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:23.866588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.868378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.876225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:23.876897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:23.877172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:23.877485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] PATH_INFO: `/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:23.878636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f699f9ff35304668ad3e0a0d4c8d8b65)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:23.880096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:23.882226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 91/179] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/users/f699f9ff35304668ad3e0a0d4c8d8b65 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:23.889559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:23.985021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 89/180] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:23.986138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:24.008882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.033131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb3f77-04d1-4d29-99aa-109359dd49d8 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.079619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.080464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.080880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.081288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/eb046e55c0194fad99fe204a627c4303/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.083650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, user_id=eb046e55c0194fad99fe204a627c4303, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.085320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.088836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.110332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc317ea-8341-4121-bbfc-15d32264f53d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.146427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.147040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.147313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.147581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.167623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 92/181] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:23 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/eb046e55c0194fad99fe204a627c4303/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:24.168855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:24.284338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.285346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.300388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f507e7-d536-4575-908d-2e7fd59737e4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.325311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.345233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.346833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.347335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.347815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.349628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.351549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.353903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 93/182] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:24 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:24.362426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:24.450700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.485586 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 90/183] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:24.493375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:24.513710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86beb6-8ac0-4964-9341-3a6cb6f1eb82 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.557850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.558813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.559261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.559748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.560699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2, user.id=f699f9ff35304668ad3e0a0d4c8d8b65) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:24.561150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.562958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.570998 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 94/184] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:24 2022] GET /identity/v3/role_assignments?user.id=f699f9ff35304668ad3e0a0d4c8d8b65&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:24.622225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35314308-8f7c-4997-a06f-7d9ad07530bb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.648443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.666138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.667430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.667711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.667982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.669154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.670735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601a1be-2b01-441e-a4ea-701f331e02e8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.672728 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 91/185] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:24 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:24.678540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:24.814454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67727a-687a-426a-b41f-9770551343ae None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:24.832968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:24.851595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:24.852208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:24.852481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:24.852763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:24.853489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] RBAC: Adding query filter params (role.id=81a2fc90eeda4eefb2eef3ff435097cb, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2, user.id=f699f9ff35304668ad3e0a0d4c8d8b65) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:24.853796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:24.855831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384aedb9-7f40-4669-8b64-61d32b69fc94 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:24.862240 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 95/186] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:24 2022] GET /identity/v3/role_assignments?user.id=f699f9ff35304668ad3e0a0d4c8d8b65&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=81a2fc90eeda4eefb2eef3ff435097cb => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:25.670079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6dced-e918-47ef-bc98-f3a648cc0102 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:25.670587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6dced-e918-47ef-bc98-f3a648cc0102 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:25.670587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6dced-e918-47ef-bc98-f3a648cc0102 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:25.672099 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 92/187] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:25.677250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:25.677662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:25.677863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:25.696100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:25.697318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:25.734625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74114d5-c69a-4d90-9075-49c74eec4610 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:25.734951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74114d5-c69a-4d90-9075-49c74eec4610 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:25.735181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74114d5-c69a-4d90-9075-49c74eec4610 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:25.736566 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 93/188] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:25.742421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:25.742700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:25.743345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:25.764718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:25.765932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:25.768810 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 96/189] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:25.835908 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 94/190] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:26.035681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.106094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.141297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422aef4-ac94-474e-a577-348ffcc3b1ae None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.152458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.177219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.178202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.178674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.179166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.191927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:26.196772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:26.198230 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:26.200041 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 97/191] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:26.204460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.212834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708d32f-4a19-4b53-a480-e41d8490a5bf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.228963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.249682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.250308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.250584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.250850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.251945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.253417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:26.255185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 95/192] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:26.261706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.315807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36607c9-b711-4c18-9ebe-4096408b06c0 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.359553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.360164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.360441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.360794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.361456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:26.361782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.363272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:26.370756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51362b4-319f-42c2-9322-774b62ea7373 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.376973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 98/193] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:26.378050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.407634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.408332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.408530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.408803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.409450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.410889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:26.413399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.484966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4656-6747-4e04-9db9-71ca63a8efc9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.505565 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 96/194] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:26 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:12:26.530713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.531419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.531697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.531969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] PATH_INFO: `/v3/users/de54ebaf579c456ebce1def30a79f820` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.550540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] RBAC: Authorizing `identity:get_user(user_id=de54ebaf579c456ebce1def30a79f820)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.552006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:26.553966 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 99/195] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:26 2022] GET /identity/v3/users/de54ebaf579c456ebce1def30a79f820 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:26.559847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.606955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.683478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582866b3-9e52-40c2-b96f-533da887cd1f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.722082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.722717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.722997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.723266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.724420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.725918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f60ced-fb16-43e1-97dd-6dcca6abf8a2 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:26.727562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 97/196] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:26 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:26.733375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:26.757240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85cff-2e24-415c-a668-997bbd76700f None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.757570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85cff-2e24-415c-a668-997bbd76700f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.757793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba85cff-2e24-415c-a668-997bbd76700f None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.759152 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 98/197] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:26.765193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.765479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.765754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.784541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:26.785974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:26.841923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:26.858865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694c355-c64b-4454-bb08-0eaac5fe9054 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:26.866015 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 99/198] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:26.898350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:26.899018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:26.899353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:26.899636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/de54ebaf579c456ebce1def30a79f820/roles/918a633e0b864acf94133fa03aa0827b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:26.902246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, user_id=de54ebaf579c456ebce1def30a79f820, role_id=918a633e0b864acf94133fa03aa0827b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:26.903709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:27.002679 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 100/199] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:26 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/users/de54ebaf579c456ebce1def30a79f820/roles/918a633e0b864acf94133fa03aa0827b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:27.151339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:27.191466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:27.261015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18051ac2-7b98-4102-9d47-87d3de9f0437 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:27.296612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:27.297249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:27.297523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:27.297787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:27.309129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:27.313999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:27.314858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:27.315633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 100/200] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:27.321190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:27.428292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b74bb7-e782-4250-bb63-298b88e30370 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:27.465211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:27.465831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:27.466105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:27.466377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:27.467052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:27.467353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:27.468899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:27.478152 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 101/201] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:27.484024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:27.587096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:27.593274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d420-9f68-4346-8343-98af5f17838c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:27.631447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:27.632174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:27.632474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:27.638998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] PATH_INFO: `/v3/users/eb046e55c0194fad99fe204a627c4303` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:27.638998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] RBAC: Authorizing `identity:get_user(user_id=eb046e55c0194fad99fe204a627c4303)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:27.638998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:27.638998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 101/202] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:27 2022] GET /identity/v3/users/eb046e55c0194fad99fe204a627c4303 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:27.643454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:27.661563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:27.760901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2dd05d-5967-405d-bd23-f46cbd56bc42 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:27.797135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:27.797743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:27.798016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:27.798283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:27.867888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:27.870066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:27.885318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:27.975688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 102/203] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:27.981489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:28.093182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daccd0e-da17-43e8-bc92-edc9ce5ea10a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:28.129501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:28.130488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:28.131043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:28.131514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:28.132935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:28.135125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014393b9-8fad-4929-bd8f-a83e4d36f50e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:28.137304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 102/204] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:27 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:28.148535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:28.245913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d79e8-4098-46c5-b73f-3cee94513412 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:28.259102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:28.280447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:28.281065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:28.285184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:28.285184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:28.285184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] RBAC: Adding query filter params (role.id=8a005951b7924bba902f57f978fd27d0, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2, user.id=eb046e55c0194fad99fe204a627c4303) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:28.285184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:28.285184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fd7ac-f210-4d9a-a933-401ff85b2f0f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:28.296666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 103/205] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:28 2022] GET /identity/v3/role_assignments?user.id=eb046e55c0194fad99fe204a627c4303&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=8a005951b7924bba902f57f978fd27d0 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:28.962703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa5e3-8013-4772-bcdb-d1d80ac79811 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:28.963183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa5e3-8013-4772-bcdb-d1d80ac79811 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:28.963465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa5e3-8013-4772-bcdb-d1d80ac79811 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:28.964987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 103/206] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:28.970957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48d5-3734-46d0-ac35-10b7b7c6a398 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:28.971441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48d5-3734-46d0-ac35-10b7b7c6a398 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:28.971514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a48d5-3734-46d0-ac35-10b7b7c6a398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:28.990819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d45a48d5-3734-46d0-ac35-10b7b7c6a398 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:28.992007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d45a48d5-3734-46d0-ac35-10b7b7c6a398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:29.058028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20b0c-e0ad-4f60-b2d9-e1232b2b04f4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.058543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20b0c-e0ad-4f60-b2d9-e1232b2b04f4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.058543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b20b0c-e0ad-4f60-b2d9-e1232b2b04f4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.060087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 104/207] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:29.061165 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 104/208] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:29.065224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c720d-9b64-44ce-aac6-6f012fe6296f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.065512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c720d-9b64-44ce-aac6-6f012fe6296f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.065789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c720d-9b64-44ce-aac6-6f012fe6296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.085839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-674c720d-9b64-44ce-aac6-6f012fe6296f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:29.087582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-674c720d-9b64-44ce-aac6-6f012fe6296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:29.124646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:29.174056 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 105/209] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:29.196414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90baa-d5f8-4d90-a081-0c8daf2a4f78 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.196736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90baa-d5f8-4d90-a081-0c8daf2a4f78 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.196998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e90baa-d5f8-4d90-a081-0c8daf2a4f78 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.198489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 105/210] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:29.203859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.204147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.204423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.223785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:29.224904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:29.292209 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 106/211] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:29.343239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e90baa-d5f8-4d90-a081-0c8daf2a4f78 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.444831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e90baa-d5f8-4d90-a081-0c8daf2a4f78 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.449582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.452807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:29.482323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.482872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.483147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.483415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.494522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:29.499687 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:29.500606 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:29.501574 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 106/212] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:29.506568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.552324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:29.563668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6a4b7-8b37-42a3-b844-9b99fd72dd7e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.599119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.599747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.600023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.600289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.601428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:29.602895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:29.604461 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 107/213] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:29.609477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.612038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d15e3-1ff7-4b07-a068-302c62e73b14 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.647843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.648448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.648755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.649027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.650236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:29.650534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:29.651924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:29.659966 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 107/214] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:29.660762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.692133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:29.713454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8a0c-ffa3-4832-9e59-a5d54c01210b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.747871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.748411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.748727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.748998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.760102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:29.763863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389e31-f927-4d25-b302-d0e9aedf52be None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:29.765043 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:29.768041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 108/215] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:29.768858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.788882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:29.798570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.799169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.799474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.799780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.800343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:29.801794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:29.865839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08c27-2ac3-4c50-800a-58c1b8ca9f82 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:29.900312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:29.901043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:29.901380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:29.901714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] PATH_INFO: `/v3/users/dde43c0667b64665aedd2b2dbce06217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:29.902525 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 108/216] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:29 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:29.903421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:29.918646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] RBAC: Authorizing `identity:get_user(user_id=dde43c0667b64665aedd2b2dbce06217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:29.920256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:29.922240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 109/217] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/users/dde43c0667b64665aedd2b2dbce06217 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:29.928519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:30.007527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:30.021238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:30.026436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806a57-c80c-48c7-bc5f-645309332ebb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.045780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf32f4-63fa-40ac-be75-adf24f05a6dc None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.064767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.065395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.065674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.065946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.066736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:30.067061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.069363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.080646 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 109/218] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:30.083301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.083903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.084223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.084551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.085244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] RBAC: Adding query filter params (role.id=8a005951b7924bba902f57f978fd27d0, user.id=dde43c0667b64665aedd2b2dbce06217, scope.system=all) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:30.086099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.086237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:30.087062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.092952 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 110/219] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Nov 2 12:12:29 2022] GET /identity/v3/role_assignments?user.id=dde43c0667b64665aedd2b2dbce06217&scope.system=all&role.id=8a005951b7924bba902f57f978fd27d0 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:30.212404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28471-5090-4213-9f56-7e9fd3288a9b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.256642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.257704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.258185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.258689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] PATH_INFO: `/v3/users/de54ebaf579c456ebce1def30a79f820` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.260142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] RBAC: Authorizing `identity:get_user(user_id=de54ebaf579c456ebce1def30a79f820)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.261860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.263728 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 110/220] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:30 2022] GET /identity/v3/users/de54ebaf579c456ebce1def30a79f820 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:30.269342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:30.385073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651781d2-9eb6-49ff-8577-e26f58ff40c6 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.421820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.422430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.422707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.423032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.436616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:30.497233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.498715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.607947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 111/221] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:30.613817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:30.631828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:30.722630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc534a28-7fc4-4681-8aed-c79dc31aab04 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.757716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.758349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.759177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.759470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.760630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.762067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba3c0-d33f-4f3f-bd4e-d73839763902 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.764059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 111/222] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:30 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:30.774039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:30.819230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:30.880134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa006ca-93cd-4e4f-a261-6bd586cfffae None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:30.917157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:30.917813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:30.918088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:30.918353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:30.919068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] RBAC: Adding query filter params (role.id=918a633e0b864acf94133fa03aa0827b, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2, user.id=de54ebaf579c456ebce1def30a79f820) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:30.919372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:30.920867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9224e22-c141-4dfd-bd23-59404bb43b2b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:30.927260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 112/223] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:12:30 2022] GET /identity/v3/role_assignments?user.id=de54ebaf579c456ebce1def30a79f820&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=918a633e0b864acf94133fa03aa0827b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:32.344670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3121ee-fc37-4c0d-8298-e3bf3d219780 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.345217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3121ee-fc37-4c0d-8298-e3bf3d219780 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.345217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3121ee-fc37-4c0d-8298-e3bf3d219780 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.346555 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 112/224] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:32.348106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bd4c-bc84-4c7c-ae18-3a76a512a694 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.348542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bd4c-bc84-4c7c-ae18-3a76a512a694 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.348716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790bd4c-bc84-4c7c-ae18-3a76a512a694 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.350024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 113/225] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:32.352857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd308-ee59-45a3-a720-c7ef46ddbefe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.352857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd308-ee59-45a3-a720-c7ef46ddbefe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.352857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd308-ee59-45a3-a720-c7ef46ddbefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.355946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301f0-0202-42e4-9b94-3886e9c20a8e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.356228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301f0-0202-42e4-9b94-3886e9c20a8e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.356515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970301f0-0202-42e4-9b94-3886e9c20a8e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.357941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 114/226] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:32.359205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.359494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.359763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.372308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a35dd308-ee59-45a3-a720-c7ef46ddbefe None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:32.373535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a35dd308-ee59-45a3-a720-c7ef46ddbefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:32.378749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:32.379947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:32.440297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 113/227] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:32.441556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.441832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.442094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.450058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 115/228] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:32.467059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:32.468252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:32.476419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:32.536696 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 114/229] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:32.712821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:32.718420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:32.749437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:32.816965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd530e7-8b26-4ee0-b352-68f5562d657f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:32.829375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29c4eb-1e19-4ea7-beca-b64492f84c65 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:32.852112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:32.852765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.853046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.853321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.862694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:32.863322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:32.863597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:32.863819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:32.863914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:32.869221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:32.870130 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:32.871054 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 116/230] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:32.871907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:32.877436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:32.882400 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:32.883837 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:32.884686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 115/231] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:32.886894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:32.893876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:32.973712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:32.979767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7bc11-946f-4d2c-b96f-69b165b0608c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:32.990553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe1439-2ff7-4c4f-ba33-bf88bcfc5e98 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.012356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.013007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.013274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.013547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.014778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.016251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.017867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 117/232] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:33.018614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.024384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.025022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.025298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.025566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.026222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] RBAC: Adding query filter params (name=member) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:33.026520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.027886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.036179 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 116/233] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:33.039903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.101662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:33.127678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8fb5d-73e4-4fba-974e-d6838bc3a1e3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.139649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6df9d-95ec-470a-8241-41558cce7a16 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.162269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.162874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.163152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.163427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.164119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:33.166368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.170164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.178527 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 118/234] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:33.179033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.179342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.179711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.180037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.180309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.180969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.182430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.211489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:33.257116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 117/235] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Nov 2 12:12:33 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:33.258384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.291757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb74a19-8ce4-4f46-a4cf-057ac0eef676 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.331727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.332753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.333031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.333290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] PATH_INFO: `/v3/users/dde43c0667b64665aedd2b2dbce06217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.334517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] RBAC: Authorizing `identity:get_user(user_id=dde43c0667b64665aedd2b2dbce06217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.336720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.338414 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 119/236] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:33 2022] GET /identity/v3/users/dde43c0667b64665aedd2b2dbce06217 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:33.346197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.386230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b01ed-d743-47e4-af38-b7c9c1eb2896 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.414786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:33.426101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.426868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.431544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.431544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] PATH_INFO: `/v3/users/1b360b443ea944a4b0b11e9525305d5b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.445815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b360b443ea944a4b0b11e9525305d5b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.447284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.449318 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 118/237] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:33 2022] GET /identity/v3/users/1b360b443ea944a4b0b11e9525305d5b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:33.455977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:33.458774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:33.467979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048fab9-e411-4583-9070-cf9b82d1d03f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.510663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.511248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.511934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.512442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] PATH_INFO: `/v3/system/users/dde43c0667b64665aedd2b2dbce06217/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.514263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dde43c0667b64665aedd2b2dbce06217, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.515967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe05c54-5b23-4127-8dcc-bf3a9ac7d6c5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.570139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29801-522d-4d24-9842-9af0ca7363a2 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:33.604891 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 120/238] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Nov 2 12:12:33 2022] PUT /identity/v3/system/users/dde43c0667b64665aedd2b2dbce06217/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:33.605528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:33.606110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:33.606385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:33.606657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:33.607387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] RBAC: Adding query filter params (role.id=918a633e0b864acf94133fa03aa0827b, user.id=1b360b443ea944a4b0b11e9525305d5b, scope.system=all) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:33.607687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:33.609237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bb7fc-cfd5-4701-bacc-f727f28ebbc1 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:33.620225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 119/239] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Nov 2 12:12:33 2022] GET /identity/v3/role_assignments?user.id=1b360b443ea944a4b0b11e9525305d5b&scope.system=all&role.id=918a633e0b864acf94133fa03aa0827b => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:35.479765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd46ee-d2ba-4004-975a-3bc858191519 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.480281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd46ee-d2ba-4004-975a-3bc858191519 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.480281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd46ee-d2ba-4004-975a-3bc858191519 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.481855 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 121/240] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:35.487094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72912ab-20e3-4d6c-851b-dc94a36b088d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.487466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72912ab-20e3-4d6c-851b-dc94a36b088d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.487641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72912ab-20e3-4d6c-851b-dc94a36b088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.505702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b72912ab-20e3-4d6c-851b-dc94a36b088d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:35.506890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b72912ab-20e3-4d6c-851b-dc94a36b088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:35.552706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:35.580511 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 120/241] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:35.790747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6469fa-6b8f-4d6e-b048-cc321a6344b4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.790913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6469fa-6b8f-4d6e-b048-cc321a6344b4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.791184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6469fa-6b8f-4d6e-b048-cc321a6344b4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.793178 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 122/242] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:35.798538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b4a7-62e3-493b-938a-fef4f69de048 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.798872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b4a7-62e3-493b-938a-fef4f69de048 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.799088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3b4a7-62e3-493b-938a-fef4f69de048 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.799316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.799610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.799884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.801055 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 123/243] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:35.806603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:35.806886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:35.807161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:35.822575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:35.824083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:35.825844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:35.827004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:35.896770 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 121/244] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:35.898440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:35.905284 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 124/245] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:36.006344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353f4ef-9737-4f98-ad1d-4aeebbed9b17 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.013810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.042220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.042768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.043044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.043378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.044565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.049550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.049550 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 122/246] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:36.053264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.166459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.195435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.207696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f035d8-6bc8-4824-9314-453ad2ef283f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.242750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.243370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.243651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.243921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.244605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.246092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.268936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f5265-68fc-491f-b4f2-bdb95d72d27d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.303448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.304025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.304301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.304598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.314574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:36.319914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:36.320930 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:36.321710 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 123/247] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:36.322356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.356638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.374518 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 125/248] 10.222.0.64 () {60 vars in 1134 bytes} [Wed Nov 2 12:12:36 2022] POST /identity/v3/groups => generated 226 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:36.376639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.435600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e84783-fa9f-4ba0-a9f3-b5c5cddcb07a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.479708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.480384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.480685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.480956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.493873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:36.498858 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:36.499764 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:36.500591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 124/249] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:36.503117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aa7d4-9d52-4dea-b5d2-8c440d5a6854 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.506122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.547842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.548456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.548758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.549023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.549681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:36.550304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.551383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.560330 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 126/250] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:36.565664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.579779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.623945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.631473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782eb5a-024a-4e28-b150-a456604ba15b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.672459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.672956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.673281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.673914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.674194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:36.674353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd9272-abb1-4218-826b-6d105b4554be None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.674513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.675853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.690512 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 125/251] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:36.698267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.728231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.729176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.729455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.729730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] PATH_INFO: `/v3/users/dde43c0667b64665aedd2b2dbce06217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.730920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=dde43c0667b64665aedd2b2dbce06217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.732378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.734228 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 127/252] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/users/dde43c0667b64665aedd2b2dbce06217 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:36.739904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.828753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5da8b1-94d7-46ba-bf42-50a0ad37738f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.844983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.875579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698712-afd0-4016-b6c9-a5196b22e3c9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:36.879306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.879454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.879693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.879959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] PATH_INFO: `/v3/users/1b360b443ea944a4b0b11e9525305d5b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.882705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] RBAC: Authorizing `identity:get_user(user_id=1b360b443ea944a4b0b11e9525305d5b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.884150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.885966 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 126/253] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/users/1b360b443ea944a4b0b11e9525305d5b => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:36.891396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:36.922741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:36.930742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:36.931657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:36.932208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:36.932730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:36.933753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] RBAC: Adding query filter params (role.id=8a005951b7924bba902f57f978fd27d0, user.id=dde43c0667b64665aedd2b2dbce06217, scope.system=all) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:36.934374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:36.936954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fafb-e415-4c6c-a4f8-f33877196153 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:36.955273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 128/254] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Nov 2 12:12:36 2022] GET /identity/v3/role_assignments?user.id=dde43c0667b64665aedd2b2dbce06217&scope.system=all&role.id=8a005951b7924bba902f57f978fd27d0 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:37.021558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1181145-1a17-4341-a111-6bbd18ca99ad None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:37.060687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:37.061360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:37.061630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:37.061898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] PATH_INFO: `/v3/system/users/1b360b443ea944a4b0b11e9525305d5b/roles/918a633e0b864acf94133fa03aa0827b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:37.063407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1b360b443ea944a4b0b11e9525305d5b, role_id=918a633e0b864acf94133fa03aa0827b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:37.064890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76aa3aa-c8e9-4706-89fb-10cba0910b2d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:37.160038 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 127/255] 10.222.0.64 () {58 vars in 1334 bytes} [Wed Nov 2 12:12:36 2022] PUT /identity/v3/system/users/1b360b443ea944a4b0b11e9525305d5b/roles/918a633e0b864acf94133fa03aa0827b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:12:38.927557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829d4d-e8d6-48a7-9764-2d668ec4f9d2 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:38.928661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829d4d-e8d6-48a7-9764-2d668ec4f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:38.928661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b829d4d-e8d6-48a7-9764-2d668ec4f9d2 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:38.930297 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 129/256] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:38.935560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830be5-a1b1-449d-8e8c-b2adefafc9e0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:38.935980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830be5-a1b1-449d-8e8c-b2adefafc9e0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:38.936176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830be5-a1b1-449d-8e8c-b2adefafc9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:38.961496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-14830be5-a1b1-449d-8e8c-b2adefafc9e0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:38.962717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-14830be5-a1b1-449d-8e8c-b2adefafc9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:39.033804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 128/257] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 02 12:12:39.539423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829d4d-e8d6-48a7-9764-2d668ec4f9d2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:39.557498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c44b8-853e-48cb-94ee-4de387051cb0 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.557680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b829d4d-e8d6-48a7-9764-2d668ec4f9d2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:39.557758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c44b8-853e-48cb-94ee-4de387051cb0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.558031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c44b8-853e-48cb-94ee-4de387051cb0 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.559740 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 129/258] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:39.562027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:39.562660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.562940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.563216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.579816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:39.585303 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:39.586154 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:39.586941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 130/259] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:12:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:39.589602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.589878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.590146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.597477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:39.608713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79840dd2-3054-4bef-ace0-83b398157e12 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:39.625800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:39.626781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.627254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.627719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.628646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:39.629173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:39.630583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:39.631464 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:39.631464 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:12:39.631464 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:12:39.631810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:39.632939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:39.649391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 130/260] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:12:39.657114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 131/261] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:39.663268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:39.676089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d4c49-fc1c-4734-a64a-5f7e84f0e33d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:39.682686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:39.683330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.683607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.683881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.699539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:39.701395 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:39.701395 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:12:39.701395 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:12:39.702646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:39.704350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 131/262] 10.222.0.64 () {56 vars in 1201 bytes} [Wed Nov 2 12:12:39 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:39.710180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:39.729842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27aab5-814d-46f6-bc9d-14f976e27faa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:39.737186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:39.737839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.738125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.738406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.739623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:39.742511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:39.744178 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 132/263] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:12:39 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:39.750021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:39.761053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d6270-c649-46e0-b256-5c91e21093da admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:39.768094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:39.768737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:39.769014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:39.769290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/groups/e03197384558466ab45d043ce9d817cc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:39.771209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, group_id=e03197384558466ab45d043ce9d817cc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:39.772236 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:39.772236 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:12:39.772236 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:12:39.774239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:39.843438 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 132/264] 10.222.0.64 () {58 vars in 1463 bytes} [Wed Nov 2 12:12:39 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/groups/e03197384558466ab45d043ce9d817cc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:40.003420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.014456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b6d29-adc4-4783-9f25-72d3ac12962f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.080640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.081210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.081486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.081762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.094027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-09c2cf81-959b-4e00-a69c-917be331ec2d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:40.099052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:40.100020 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:40.100826 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 133/265] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:40.106250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.117683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77e156-65de-463d-a6a2-05dd8ef2c99f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.120387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf087-c853-4cfa-928e-c385dfc86867 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.120699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf087-c853-4cfa-928e-c385dfc86867 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.120979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcf087-c853-4cfa-928e-c385dfc86867 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.122356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 134/266] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:40.128149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc4e7-bb0d-453a-8394-b802f3eb3692 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.128451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc4e7-bb0d-453a-8394-b802f3eb3692 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.132538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbc4e7-bb0d-453a-8394-b802f3eb3692 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.132809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.132809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.132809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.132809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.133403 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 135/267] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:40.133545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:40.133545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.133834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.133834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.133834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.134343 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:40.134343 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:12:40.134343 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:12:40.135757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3be7f5-f7cb-493d-876c-4c59b59ef82a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.143545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:40.154923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:40.156333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:40.157021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 133/268] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:40.158532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.158997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.159452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.168632 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 136/269] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:12:40.170686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.182845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a7a06-60f0-4b20-acc4-f4dac0e78100 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.187429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.188078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:12:40.194871 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:12:40.195274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:40.195355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.195432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:40.195500 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 137/270] 10.222.0.64 () {56 vars in 1201 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:40.205527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.227063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be1184-7ea0-4f9f-9cb9-bbc82a7fbec2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.235781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.236888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.237166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.237431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.239159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.244842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.248725 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 138/271] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:40.257230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.272292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235766d-f229-4d3d-8dc7-278f18e3907f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.282411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.283070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.284239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.285785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624/groups/e03197384558466ab45d043ce9d817cc/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.289209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b16a0ffa434edf88667c6f42f00624, group_id=e03197384558466ab45d043ce9d817cc, role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.290227 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:12:40.290227 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:12:40.290227 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:12:40.292918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.310619 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 134/272] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:40.373709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 139/273] 10.222.0.64 () {58 vars in 1463 bytes} [Wed Nov 2 12:12:40 2022] PUT /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624/groups/e03197384558466ab45d043ce9d817cc/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:40.663498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.753973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce33c7-9d21-439c-b4aa-96e5e4535a6a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.764654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.765659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.766157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.766646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.781277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-dcbf0be4-461a-446a-b21e-1fb913d69908 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:40.787058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:40.787932 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:40.788985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:40.794155 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 135/274] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:40.799749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.818868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12899-69b8-44b1-bb9f-7579ad33cd3f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.819474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12899-69b8-44b1-bb9f-7579ad33cd3f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.819942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12899-69b8-44b1-bb9f-7579ad33cd3f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.820278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49b47-3f64-4c33-9d09-80db2ec49a16 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.823432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 136/275] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:40.828444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.829006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.829481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.830278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.830895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.831174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.831445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.832121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:40.832424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.834105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.855574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 140/276] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:40.862307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.872004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:40.873553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:40.876721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4428596-bba8-4bdd-83c9-82900cdeab17 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.884007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.884687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.884964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.885235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.887566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.889547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.890438 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 137/277] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:12:40.891503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.894999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 141/278] 10.222.0.64 () {56 vars in 1201 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:40.900451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.913201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861d31a-4ba8-43e1-a177-6195e86a9fbb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.923513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.924072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.924346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.924656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.925791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.928755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.930451 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 142/279] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:40.935948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:40.954470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4cf2-f074-4ae2-9e27-badc0ed96d9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:40.965787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:40.966457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:40.966732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:40.967000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/groups/e03197384558466ab45d043ce9d817cc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:40.972877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, group_id=e03197384558466ab45d043ce9d817cc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:40.976686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:40.979332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:41.011559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:41.062692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835c08b-24a8-45da-9a70-95530fc2dbaf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.087556 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 143/280] 10.222.0.64 () {58 vars in 1463 bytes} [Wed Nov 2 12:12:40 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/groups/e03197384558466ab45d043ce9d817cc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:12:41.118161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.118803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.119083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.119355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.141099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:41.146286 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:41.147261 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:41.148173 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 138/281] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:41.155865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.212469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.357692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55cf13-52e8-4649-be07-65a6bc1f49cf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.369843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.370499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.370774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.371041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.377205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2da9a-1208-4d64-a0d6-cdde046ec0de admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.405498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:41.410473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:41.411609 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:41.412607 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:41.416611 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 139/282] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:41.418292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.423975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.424898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.425305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.425785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.426587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:41.427058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.428611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.438477 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 144/283] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:41.441857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4369b-6675-428e-9f7b-fc9694088d8d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.445139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.448677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.449587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.450066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.450505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.451373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:41.451818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.453650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.469063 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 140/284] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:41.475410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.492640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c5bec-51e8-451e-8528-f4389f82122b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.503304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.509286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.509567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.509848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.511116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.513092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.514703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 141/285] 10.222.0.64 () {56 vars in 1201 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:41.521503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.546692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4423b0b-fc78-4b26-8b8b-915c40b90ab6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.549859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:41.558302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.558945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.565717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.565717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.565717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.565717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.565717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 142/286] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:41.573478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.595040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283dd59-4296-4997-a7bc-e4524ca992e3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.610198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.610873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.611155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.611487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/groups/e03197384558466ab45d043ce9d817cc/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.613700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbfc870c662471d9bf7bde2a710a5d2, group_id=e03197384558466ab45d043ce9d817cc, role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.616976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30fab8-82b9-4946-968c-0772b42171a1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.623269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea89d9-49f8-4a9b-b9d3-0cd7ef70e55d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.667290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.667935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.668209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.668587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] PATH_INFO: `/v3/users/1b360b443ea944a4b0b11e9525305d5b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.669821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] RBAC: Authorizing `identity:get_user(user_id=1b360b443ea944a4b0b11e9525305d5b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.671259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.672986 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 145/287] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/users/1b360b443ea944a4b0b11e9525305d5b => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:41.679508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:41.728140 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 143/288] 10.222.0.64 () {58 vars in 1463 bytes} [Wed Nov 2 12:12:41 2022] PUT /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2/groups/e03197384558466ab45d043ce9d817cc/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:41.808279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29eb22a-d2e8-4631-8194-9dc082e44b0c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:41.839907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:41.852574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:41.853237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:41.853519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:41.853791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:41.854519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] RBAC: Adding query filter params (role.id=918a633e0b864acf94133fa03aa0827b, user.id=1b360b443ea944a4b0b11e9525305d5b, scope.system=all) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:41.854839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:41.856264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b7fd-c6dc-4b48-bc7a-b600516fd1ff None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:41.872663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 146/289] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Nov 2 12:12:41 2022] GET /identity/v3/role_assignments?user.id=1b360b443ea944a4b0b11e9525305d5b&scope.system=all&role.id=918a633e0b864acf94133fa03aa0827b => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:42.263138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467074a-778f-4d99-88c1-a181a619234c None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.263678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467074a-778f-4d99-88c1-a181a619234c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.263678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1467074a-778f-4d99-88c1-a181a619234c None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.265365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 144/290] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:42.272283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.272776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.272971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.299652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:42.300930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:42.367134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 147/291] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 02 12:12:42.695996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467074a-778f-4d99-88c1-a181a619234c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:42.715885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1467074a-778f-4d99-88c1-a181a619234c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:42.720384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:42.721042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.721319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.721589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.741619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:42.747242 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:42.748188 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:42.749003 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 145/292] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:12:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:42.754828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:42.772035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed41f8-a6b1-431c-b00d-5a233ef36b85 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:42.779051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:42.779675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.779953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.780209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.780916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:42.781222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:42.782836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:42.796610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 148/293] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:42.802722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:42.818283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303e87-03bb-4554-9277-c1f0d5d2ffc6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:42.825957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:42.826591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.826869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.827139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] PATH_INFO: `/v3/groups/e91eddefed034c239f73bb65fbc9caa2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.832457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] RBAC: Authorizing `identity:get_group(group_id=e91eddefed034c239f73bb65fbc9caa2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:42.834531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:42.836350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 146/294] 10.222.0.64 () {56 vars in 1201 bytes} [Wed Nov 2 12:12:42 2022] GET /identity/v3/groups/e91eddefed034c239f73bb65fbc9caa2 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:42.841796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:42.856249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e5a5e-23b2-4cf5-a6a6-9b68634d48c7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:42.861784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:42.862425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.862705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.862975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] PATH_INFO: `/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.869243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] RBAC: Authorizing `identity:get_project(project_id=a77a9a466b3c4a1db84a2273ce5d6a0e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:42.871064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30a268-b50b-4cee-bf87-b88bc859d9fb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:42.872988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 149/295] 10.222.0.64 () {56 vars in 1207 bytes} [Wed Nov 2 12:12:42 2022] GET /identity/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:42.878509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:42.889995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac0f6c-a9c9-4301-80eb-57d7bdac3c2f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:42.892675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f29c8-00d0-4aeb-b712-d602c0a5d9bd None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.893181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f29c8-00d0-4aeb-b712-d602c0a5d9bd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.893736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f29c8-00d0-4aeb-b712-d602c0a5d9bd None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.895357 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 150/296] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:42.898899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:42.899568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.899844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.900158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] PATH_INFO: `/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e/groups/e91eddefed034c239f73bb65fbc9caa2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.902032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:42.902477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:42.904456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:42.904709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77a9a466b3c4a1db84a2273ce5d6a0e, group_id=e91eddefed034c239f73bb65fbc9caa2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:42.907586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:42.923750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:42.925272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:42.985782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:42.994203 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 147/297] 10.222.0.64 () {58 vars in 1463 bytes} [Wed Nov 2 12:12:42 2022] PUT /identity/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e/groups/e91eddefed034c239f73bb65fbc9caa2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:43.011062 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 151/298] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:43.304961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:43.418237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11942f-3443-40d9-bbac-9b82cafe087e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:43.458489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:43.459119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:43.459390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:43.459656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:43.471507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:43.477490 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:43.478356 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:43.479131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 148/299] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:43.484461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:43.549082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:43.612509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6567a5-8792-47bb-8e91-b99c7dd7f9da None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:43.654316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:43.654929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:43.655263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:43.655532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:43.656261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:43.656589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:43.657982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb273aa-d8f5-4807-9065-2f6faa94f093 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:43.673483 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 152/300] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:43.679244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:43.757158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:43.803259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5bbff-39bd-4815-8d36-d50cc90591ca None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:43.842479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:43.843165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:43.843439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:43.843759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:43.934239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:43.935664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:44.013873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:44.048853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf2ee-65da-4024-926f-d46e63a83491 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.049178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf2ee-65da-4024-926f-d46e63a83491 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.049399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faf2ee-65da-4024-926f-d46e63a83491 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.050756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 153/301] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:44.057742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.058016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.058286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.067067 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 149/302] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:44.077612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.084330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:44.085689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:44.183109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 154/303] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:44.256808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e787e-8bfe-4d3b-872a-18def0bb991e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:44.303778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:44.304419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.304767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.304982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.306126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:44.307686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b588b6-e812-485b-aa46-cae7712bccd7 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:44.309653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 150/304] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:44.315268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.333428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111490-70cd-4b2f-850e-190747663996 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.333724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111490-70cd-4b2f-850e-190747663996 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.334545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111490-70cd-4b2f-850e-190747663996 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.336329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 151/305] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:44.340685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.340963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.341282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.364524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:44.365162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:44.369980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:44.396812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:44.463694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 152/306] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:44.487101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf229-e522-4307-893b-07e565a58a77 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:44.528383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:44.529280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.529724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.530172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.531533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:44.533164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:44.535240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 155/307] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:44.541991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.655259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.664031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012868f1-03e6-429b-a267-baa74aa07263 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:44.729784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:44.730427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.730685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.730953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.731687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] RBAC: Adding query filter params (group.id=e03197384558466ab45d043ce9d817cc, role.id=8a005951b7924bba902f57f978fd27d0, scope.project.id=29b16a0ffa434edf88667c6f42f00624) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:44.731987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:44.733461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:44.748516 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 153/308] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/role_assignments?group.id=e03197384558466ab45d043ce9d817cc&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=8a005951b7924bba902f57f978fd27d0 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:44.791623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607e80d-50a1-4136-bb55-85b579254d22 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:44.800525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:44.852079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:44.853166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:44.853694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:44.854172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:44.865839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:44.868698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:44.871885 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:44.872963 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Nov 02 12:12:44.873841 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:44.876855 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 156/309] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:44.890652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:44.929171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.027752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a0c011-3779-4a7e-b13e-69a093171666 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.072221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.073230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.074432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.075077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.077379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:45.077379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.079824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.093122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c1323-3615-49dc-87e9-11ecd5558fcf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.094796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 157/310] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:45.102329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.141428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.142081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.142356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.142624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.145399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.161979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:45.168816 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:45.173820 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:45.174615 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 154/311] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:45.180685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.267131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b172f4-f96c-424a-8078-e1dcdd2f94d9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.293183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.306132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf3dbc-d9dc-48e2-a1ce-e4b58c86fe21 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.331596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.333046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.333492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.334013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.349095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.350195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.350195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.350195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.350795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:45.351090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.354503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bb8d8-1c8e-4faf-9a5e-82697eff54b2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.362814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 155/312] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:45.364097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cbb0-a2be-4b9f-9aa7-3c040c11a0af None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.364445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cbb0-a2be-4b9f-9aa7-3c040c11a0af None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.364792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32cbb0-a2be-4b9f-9aa7-3c040c11a0af None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.366148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 156/313] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:45.370223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32cbb0-a2be-4b9f-9aa7-3c040c11a0af None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.434879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.436356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e14921-51c7-4733-b81e-e706a2242732 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.471286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.504061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32cbb0-a2be-4b9f-9aa7-3c040c11a0af None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.555524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.556850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.557344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.557852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.571516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 158/314] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:45.572850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.573203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.573544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.576860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.593956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:45.595507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:45.649276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.650755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.689075 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 159/315] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:45.690359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.762745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.777674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 157/316] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:45.783452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.826638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc9cf6-70d8-45bd-987a-662c61b60550 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.855194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:45.867315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.867950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.868224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.868510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.870504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.871962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.873709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 160/317] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:45.879885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.921224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab080ca-6ae7-4354-aece-f15908399634 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:45.963360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:45.964947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:45.965439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:45.965899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] PATH_INFO: `/v3/projects/29b16a0ffa434edf88667c6f42f00624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:45.969182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] RBAC: Authorizing `identity:get_project(project_id=29b16a0ffa434edf88667c6f42f00624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:45.971589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:45.974266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 158/318] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/projects/29b16a0ffa434edf88667c6f42f00624 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:45.979849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:45.999460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38921c-7748-4220-be90-f4b440127400 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.027641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.043079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.043747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.044021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.044289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.046095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.047414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.049509 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 161/319] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:46.056427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.108831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808df68e-3b08-4182-a7d0-d304ac75f741 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.127550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.158636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.159625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.161730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.161730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.163335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.165584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.166588 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 159/320] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Nov 2 12:12:45 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:46.168325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.193030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5955a7-7406-4e0d-9592-774ac94723a0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.235740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.236385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.236690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.236959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.250315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:46.256016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:46.257065 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:46.257891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:46.258559 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 162/321] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:46.260539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.303518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae59dd8-7119-4be4-bd9f-675e4988f25b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.328756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.350711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.351472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.351758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.352213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.352791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] RBAC: Adding query filter params (group.id=e03197384558466ab45d043ce9d817cc, role.id=8a005951b7924bba902f57f978fd27d0, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:46.353097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.354555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5ca2-9720-48ae-8d7b-36b617d19d5e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.361202 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 160/322] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/role_assignments?group.id=e03197384558466ab45d043ce9d817cc&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=8a005951b7924bba902f57f978fd27d0 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:46.362381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8183-f195-4d05-940c-ea76fa817905 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.362665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8183-f195-4d05-940c-ea76fa817905 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.363619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c8183-f195-4d05-940c-ea76fa817905 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.364820 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 161/323] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:46.366274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8183-f195-4d05-940c-ea76fa817905 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.393295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814d37-62a0-4654-a2f1-966ac4696889 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.435070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.449525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.450323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.450528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.450754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.451721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] RBAC: Adding query filter params (group.id=e03197384558466ab45d043ce9d817cc, role.id=81a2fc90eeda4eefb2eef3ff435097cb, scope.project.id=29b16a0ffa434edf88667c6f42f00624) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:46.452478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.456202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33958956-58ab-4395-acf2-a4218415b696 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.466294 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 163/324] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/role_assignments?group.id=e03197384558466ab45d043ce9d817cc&scope.project.id=29b16a0ffa434edf88667c6f42f00624&role.id=81a2fc90eeda4eefb2eef3ff435097cb => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:46.468878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.469365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.469840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.492112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:46.493653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:46.535640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c8183-f195-4d05-940c-ea76fa817905 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.583745 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 164/325] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:46.595806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.596765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.597183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.597629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.598306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:46.598608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.600003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.613322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 162/326] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:46.618921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.679865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.743155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d51ebf-48f2-4174-afc3-2fb01e26a6c1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:46.780361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:46.781004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:46.781276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:46.781545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:46.854557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:46.856422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:46.882487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.906994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:46.969259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 165/327] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:12:46.975297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:46.994619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5c006e-9404-409b-86a2-ddaad04a7802 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.001977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.035478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.036342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.036808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.037183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.052234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:47.059205 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:47.060113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:47.061158 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 163/328] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:12:47.066754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.099857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c06d1-35f7-40ad-acee-20bbd02d205b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.149809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.150384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.150661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.150929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] PATH_INFO: `/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.152074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] RBAC: Authorizing `identity:get_project(project_id=6dbfc870c662471d9bf7bde2a710a5d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.153573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.155453 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 166/329] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:46 2022] GET /identity/v3/projects/6dbfc870c662471d9bf7bde2a710a5d2 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:47.161461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.178765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.196611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba42db-f9d3-4b22-b2e7-2b43e1cf6468 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.233724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.234331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.234604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.234867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.235516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:47.235818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.237205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.245920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 164/330] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:47.251603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.273809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc7129-af4f-43e4-8dcd-5343bb77875f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.279919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.318399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.319030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.319308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.319578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] PATH_INFO: `/v3/groups/e03197384558466ab45d043ce9d817cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.321160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] RBAC: Authorizing `identity:get_group(group_id=e03197384558466ab45d043ce9d817cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.322621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.324227 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 167/331] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/groups/e03197384558466ab45d043ce9d817cc => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:47.330086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.355702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a14a-c043-4b26-aeec-903b9fb6a9f9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.389909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.390765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.391046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.391324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.410929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.430015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808f24-72e9-4ea6-9567-43d3e7f4a722 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.460033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.461521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.463557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.464160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.464437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.464729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.465442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] RBAC: Adding query filter params (group.id=e03197384558466ab45d043ce9d817cc, role.id=81a2fc90eeda4eefb2eef3ff435097cb, scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:47.465743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.467147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.473604 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 168/332] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/role_assignments?group.id=e03197384558466ab45d043ce9d817cc&scope.project.id=6dbfc870c662471d9bf7bde2a710a5d2&role.id=81a2fc90eeda4eefb2eef3ff435097cb => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:12:47.490400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.571879 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 165/333] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:12:47.578445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.689245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3e8f-4c38-466f-8887-e361083bb191 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.724004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.724684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.725009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.725302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] PATH_INFO: `/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.726428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] RBAC: Authorizing `identity:get_project(project_id=a77a9a466b3c4a1db84a2273ce5d6a0e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.727891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.729548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 169/334] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/projects/a77a9a466b3c4a1db84a2273ce5d6a0e => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:47.735264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.838169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0049264-abcd-42e2-a72c-aa7fdfa82b0a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:47.864679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.872914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:47.873484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:47.873754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:47.874018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] PATH_INFO: `/v3/groups/e91eddefed034c239f73bb65fbc9caa2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:47.875098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] RBAC: Authorizing `identity:get_group(group_id=e91eddefed034c239f73bb65fbc9caa2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:47.876536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda29062-3566-4490-9aec-55dfc77d5bef None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:47.878074 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 166/335] 10.222.0.64 () {56 vars in 1180 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/groups/e91eddefed034c239f73bb65fbc9caa2 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:47.884032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:47.900676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:47.983591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacb27e-c958-4b38-82b9-484eacf7a127 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:48.015971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:48.016587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:48.016868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:48.017137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:48.017852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] RBAC: Adding query filter params (group.id=e91eddefed034c239f73bb65fbc9caa2, role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=a77a9a466b3c4a1db84a2273ce5d6a0e) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:48.018161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:48.020117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e2df3-849c-467a-9706-06157caf0fe7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:48.025740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 170/336] 10.222.0.64 () {56 vars in 1376 bytes} [Wed Nov 2 12:12:47 2022] GET /identity/v3/role_assignments?group.id=e91eddefed034c239f73bb65fbc9caa2&scope.project.id=a77a9a466b3c4a1db84a2273ce5d6a0e&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:50.949370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad47-450c-4ae5-9911-3ea3b44a94c3 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:50.950382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad47-450c-4ae5-9911-3ea3b44a94c3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:50.950916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6ad47-450c-4ae5-9911-3ea3b44a94c3 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:50.952762 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 167/337] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:50.958503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ad9e7-c006-479e-8755-aed5eb41bbd0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:50.958976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ad9e7-c006-479e-8755-aed5eb41bbd0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:50.959125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ad9e7-c006-479e-8755-aed5eb41bbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:50.985843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6b5ad9e7-c006-479e-8755-aed5eb41bbd0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:50.987111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6b5ad9e7-c006-479e-8755-aed5eb41bbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:51.070800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 171/338] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:51.110785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a556-b8cd-4694-94c4-25770fa69c2c None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.111536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a556-b8cd-4694-94c4-25770fa69c2c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.112044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65a556-b8cd-4694-94c4-25770fa69c2c None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.114062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 168/339] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:51.120060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.120342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.120639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.141101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:51.142315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:51.144027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe469d-27d7-4df5-a977-87ab3be483b1 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.144549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe469d-27d7-4df5-a977-87ab3be483b1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.145128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe469d-27d7-4df5-a977-87ab3be483b1 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.147025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:51.150722 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 169/340] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:51.157734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7349f-965c-4522-92cc-58c1dfdbb49c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.162256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7349f-965c-4522-92cc-58c1dfdbb49c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.162256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7349f-965c-4522-92cc-58c1dfdbb49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.193554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0aa7349f-965c-4522-92cc-58c1dfdbb49c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:51.197139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0aa7349f-965c-4522-92cc-58c1dfdbb49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:51.278589 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 172/341] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:51.314059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 170/342] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:12:51.388805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:51.532179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9ea37-37ae-49e4-a75e-cc065028a935 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:51.579825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:51.580511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.580786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.581057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.587869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:51.595033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:51.596549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:51.612509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:51.613450 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:51.614307 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:51.614307 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:51.614307 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:51.618001 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 173/343] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:51.622505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c640b-3c61-4820-99e1-bea46e1b356a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.622806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c640b-3c61-4820-99e1-bea46e1b356a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.623050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c640b-3c61-4820-99e1-bea46e1b356a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.624542 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 171/344] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:51.625399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:51.630171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.630547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.632521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.649511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:51.650951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:51.726881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 172/345] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:51.728012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:51.741746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549401b8-66ee-4fdc-bff5-a687d03e735e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:51.794792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:51.796287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.796768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.797501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.798324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:51.799535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:51.800481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:51.802567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:51.826496 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 174/346] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:51.828024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:51.849969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30696cac-7b04-489c-972e-92fdead8fcc7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:51.894426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:51.895420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:51.895892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:51.896417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:51.900902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:51.911282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:51.913790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:51.933808 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:51.934990 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:51.935854 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:51.935854 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:51.935854 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:51.938855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 173/347] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:51.939910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:51.975275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff1749-f6ea-492d-8374-594c57681899 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.024654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.025447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.025730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.026428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.040149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.042028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:52.063654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:52.065145 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:52.071643 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:52.071643 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:52.071643 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:52.071824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2f20-cc33-4e23-95d0-4bd6b7b62afd None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.072223 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 175/348] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:52.072223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.075038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.107557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.108158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.108428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.108726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.109357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.110950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.180468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308fd37-76f1-4793-a4ba-cd85a014f1fa None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.182186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.196665 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 174/349] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:51 2022] POST /identity/v3/users => generated 246 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:52.196665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.239371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.240373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.240845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.241318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.242108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:52.242700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.245169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.266174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 176/350] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:52.267630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.339152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32846721-07f8-4104-bfbc-882d9c778e1d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.379262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.380366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.380878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.381346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.395213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.397125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.403271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dce98-dc3a-4685-a917-6430c6a9a8d0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:52.414271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:52.415211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:52.416065 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:52.416065 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:52.416065 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:52.417644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 175/351] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:52.418743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.439441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.446783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.447360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.447640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.448086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.448706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:52.453283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.453283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4def2-ef28-473b-bf36-eefdceb81c02 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.463442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 177/352] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:52.464533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdced5-c1ba-471e-981a-b0a556fe5102 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.464987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdced5-c1ba-471e-981a-b0a556fe5102 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.465195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdced5-c1ba-471e-981a-b0a556fe5102 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.468638 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 178/353] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:52.468638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdced5-c1ba-471e-981a-b0a556fe5102 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.495313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.545777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff0d29-ed44-4ed8-8df1-029fd7a0a346 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.584954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdced5-c1ba-471e-981a-b0a556fe5102 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.585422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.586036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.586523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.586692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.587963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.588902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e78b2-ccbc-41ff-874e-eee10322c559 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.620788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.621392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.621664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.621993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.622558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:52.622856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.624224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.635734 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 179/354] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:52.636541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.663618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 176/355] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:52 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:52.671197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.671481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.671756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.695484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:52.696946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:52.758010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.781869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 177/356] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:52.782554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:52.785555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b230a-ce4e-481b-949c-54c20b2761d9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.816897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:52.832823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.833437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.834120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.834399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.835047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.837208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.904663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33586425-22bc-4b46-bdb1-193f27863764 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:52.949645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:52.950254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:52.950529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:52.950798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:52.951440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:52.953056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:52.992389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 180/357] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:52 2022] POST /identity/v3/users => generated 248 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:53.032257 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 178/358] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:52 2022] POST /identity/v3/users => generated 249 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:53.196685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:53.321240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709104e-c6e0-4651-8d86-90962a7471a8 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:53.360518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:53.361917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:53.362342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:53.362754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:53.363927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:53.365544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:53.399925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.sql.core [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 12:12:53.399925 n-d-857339-6 devstack@keystone.service[82132]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 12:12:53.399925 n-d-857339-6 devstack@keystone.service[82132]: [parameters: {'id': '0e04810bd38c432ebf19cb7fb5a38a42', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 12:12:53.399925 n-d-857339-6 devstack@keystone.service[82132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:12:53.421580 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return ref.to_dict() Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:12:53.422682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application yield resource Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise self.value Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application session.commit() Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:12:53.424425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:12:53.425532 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:12:53.426522 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:12:53.427438 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [parameters: {'id': '0e04810bd38c432ebf19cb7fb5a38a42', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:53.428427 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 02 12:12:53.429520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:53.436438 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 181/359] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Nov 2 12:12:53 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:53.437829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:53.503796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:53.570183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135e06-b307-46f8-a5d8-04395e14c12d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:53.627576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:53.628225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:53.628514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:53.628797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:53.643716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-76788374-2553-45b9-9604-62658b5dfeef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:53.649970 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:53.650853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:53.651801 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 179/360] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:12:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:53.656988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:53.662582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:53.809997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b039b-c34a-47be-9aa6-09183a6a92aa None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:53.862864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:53.864694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:53.864694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:53.864694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:53.865561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:53.866047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:53.867741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de47df7-f160-4ff9-9752-bbff713295b3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:53.880825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 182/361] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:54.667237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1565f5-1c51-444e-95c0-7c664483e672 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:54.667749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1565f5-1c51-444e-95c0-7c664483e672 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:54.667749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1565f5-1c51-444e-95c0-7c664483e672 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:54.669417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 180/362] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:54.675951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:54.676427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:54.676523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:54.705002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:54.706218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:54.788297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:54.802080 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 183/363] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:55.155583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1565f5-1c51-444e-95c0-7c664483e672 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:55.295090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1565f5-1c51-444e-95c0-7c664483e672 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:55.323035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:55.347188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:55.347839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.348118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.348387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.373583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7e89b490-1b98-4145-b266-1e17d54ecf15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:55.379415 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:55.380538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:55.381628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 181/364] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:55.387065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:55.504716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696c1e-9612-4e50-9b1c-5e11a2e9b4f0 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.505462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696c1e-9612-4e50-9b1c-5e11a2e9b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.505744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9696c1e-9612-4e50-9b1c-5e11a2e9b4f0 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.507148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 182/365] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:55.519267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c8de-df48-4972-9668-de473a5e6415 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.519547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c8de-df48-4972-9668-de473a5e6415 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.519814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5c8de-df48-4972-9668-de473a5e6415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.555072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1ed5c8de-df48-4972-9668-de473a5e6415 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:55.556332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1ed5c8de-df48-4972-9668-de473a5e6415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:55.586006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2ef94-d93f-4236-82b8-6c460915f669 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:55.670260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 183/366] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:55.675492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:55.676249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.676778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.677000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.677774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:55.678176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:55.679677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec6863-76cb-443e-871c-86289cdd638c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:55.683718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986e2b-dacc-4843-b3b5-921ca6bae70f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.684177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986e2b-dacc-4843-b3b5-921ca6bae70f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.684674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986e2b-dacc-4843-b3b5-921ca6bae70f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.686142 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 184/367] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:12:55.690769 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 184/368] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:12:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:55.695770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b92462-19f7-487c-b31b-4c8e15cf3d68 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.696062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b92462-19f7-487c-b31b-4c8e15cf3d68 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.696335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b92462-19f7-487c-b31b-4c8e15cf3d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.697432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986e2b-dacc-4843-b3b5-921ca6bae70f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:55.726143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-11b92462-19f7-487c-b31b-4c8e15cf3d68 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:55.727569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-11b92462-19f7-487c-b31b-4c8e15cf3d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:55.810214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:55.833206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 185/369] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:55.913738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986e2b-dacc-4843-b3b5-921ca6bae70f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:55.924789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:55.943557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0e6f1-a542-4390-83e5-ef4cf951d06e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.943838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0e6f1-a542-4390-83e5-ef4cf951d06e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.944107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0e6f1-a542-4390-83e5-ef4cf951d06e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.945615 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 186/370] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:55.951717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.951996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.952264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.958324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:55.959271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:55.959815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:55.960333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:55.971346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:55.973321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:55.979256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:55.980456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:55.990349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:55.991262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:55.992115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:55.992115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:55.992115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:55.993868 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 185/371] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:55.998409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.088594 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 187/372] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:56.089958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.138065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d54d8b-e8d1-4c91-8eed-30be877770d5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.180578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.181369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.181651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.181914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.201661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:56.209505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:56.210438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:56.211219 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 186/373] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:12:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:56.211869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.235509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59ae66-5170-4efc-a06d-efe7909a1424 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.239810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.259772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.283866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.284837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.285559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.285982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.287184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:56.287910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.290118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.305978 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 188/374] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:56.311009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.340866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a714d2d-f939-4e3e-b1e5-514b15fe3c16 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.383798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.384458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.384760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.385031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.396279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:56.401091 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:56.402250 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 187/375] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:56.403167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.449336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3971a0a-57df-4b58-b935-c06073c38301 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.489207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.490134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.490688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.491161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.492238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:56.492855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.494407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.495792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.509313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 189/376] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:56.509313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.529770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ddb1f9-d007-4fd9-be47-78a1537408eb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.553886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.567026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.567909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.568185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.568460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.576715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.578154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:12:56.593017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:56.593947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:56.595384 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 188/377] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:56.595940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.626606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c3ef-8cbc-401f-af79-f049f4560a0a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.663089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.663811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.664092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.664362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.676807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:12:56.682089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:56.683214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 190/378] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:56.684201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.714912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39015e1d-87af-4df6-8c5d-e938448db660 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.750621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.751232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.751508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.751790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.752431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:56.752760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.754133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.762892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 189/379] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:56.765346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.770810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.789078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:56.794847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca92cd-7e59-41d6-91c3-64520a8ca9f7 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.832592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.833242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.833521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.833788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.844222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.846158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:56.861258 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:56.863615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:56.864446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:56.864446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:56.864446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:56.864446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 191/380] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:56.864446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.880767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600dd33a-d799-4539-b533-8a2d7d0c765f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:56.920692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:56.921346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:56.921621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:56.921886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:56.922739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:56.923043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:56.924543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:56.964982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 190/381] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:56.966009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:56.988348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c646f4-a153-4e24-9594-17c4d1a9d1cf None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.024893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.025498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.025799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.026035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.026726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.027025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.028408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.033520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.038035 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 192/382] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.038843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.054016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.076854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7e67-a925-4065-aa70-b6c8e283f738 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.111586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.112303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.112611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.112876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.123643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.125132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:57.140013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:57.141665 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:57.142500 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:57.142500 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.142500 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:57.142674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a20ea-59a6-4a32-9c5c-d690d8fb757b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.144941 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 191/383] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:57.145485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.176552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.177156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.177436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.177707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.178339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.178633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.180003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0450e-b27a-445c-aea8-6f5038c5ecde None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.191611 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 193/384] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.193073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3727c-55aa-407e-9e0a-5a73358821dc None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.193350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3727c-55aa-407e-9e0a-5a73358821dc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.193615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3727c-55aa-407e-9e0a-5a73358821dc None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.194977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 194/385] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:12:57.195496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3727c-55aa-407e-9e0a-5a73358821dc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.250813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dbc587-cdb5-4e7d-a925-1d53338980b5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.263264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.271204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.285451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.286079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.286353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.286624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.296978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.298479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.301717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3727c-55aa-407e-9e0a-5a73358821dc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:57.315006 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:57.315973 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:57.317151 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:57.317151 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.317151 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:57.317151 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 192/386] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:57.317366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.345185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.345820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.346097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.346364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.356848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.358288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:57.372921 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:57.373977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:57.374824 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:57.374824 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:57.374824 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:57.374824 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 195/387] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:57.374824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.430989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fd9ba-120a-4ac6-960a-f7a171875620 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.465030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.465634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.465916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.466183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.466815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.467109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.468521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906940d-6389-4e6d-b9a8-8c19e3001b24 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.480891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 193/388] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.482135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd26d-d7c4-40a0-b582-4806eb1a6ff3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.482296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.482518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.482791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.501488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:12:57.502644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:12:57.506048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.518556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.519205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.519488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.520863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.521743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.528369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.529775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:12:57.544208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:57.550122 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 196/389] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:57.551024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.577018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 194/390] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:12:57.577851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.661606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79553463-159d-4771-ae7e-86d620aea919 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.689454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812ed3c-b843-417c-99bd-232610a9c59c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.697872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.698542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.698760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.699027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.699693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.700068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.701716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.718612 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 197/391] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.719588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.729764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.730491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.730773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.731045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.731687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.731990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.733380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.747674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 195/392] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.753084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.770447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.777548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:57.837265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40978dd-0409-4121-9515-25d3350a5916 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.863460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bed92-7b10-4d75-bb75-ea718be4a126 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:57.873642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.874253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.874526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.874792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.882556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.884011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:12:57.895956 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:57.897078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 198/393] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:57.898770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.900009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:57.901152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:57.901494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:57.901776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:57.904001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:57.904001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:57.904257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:57.923209 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 196/394] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:57.923990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:57.993911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.004806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421c8f5-bf92-4bc2-bedb-0dcbbe382f4a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.007238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.022542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7901c-54e9-49fd-8e4f-bad540ee604f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.039918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.040567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.040840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.041111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.048353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.049828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.059364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.059986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.060282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.060571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:12:58.061876 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:58.062940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:58.063997 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 199/395] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:58.064924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.073193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.074616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:12:58.085917 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:58.086836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 197/396] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:12:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:58.087744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.168710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea4371-fead-442a-bd16-df48601a6b7e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.189354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755809-5bec-4c3b-bbd2-a3403273ee02 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.202915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.203568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.203855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.204097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.214135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.215710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.217886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.222670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.223262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.223534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.223798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.224542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:58.224844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.226280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:58.230564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:58.231517 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:58.232388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:58.232388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.232388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:58.232388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 200/397] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:58.233028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.246015 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 198/398] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:58.246955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.255382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.337458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7131c-e89e-4fba-9144-2a59835fd94a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.350519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e6f5-efa8-48fb-9d62-47e85a054316 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.372835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.373476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.373754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.374021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.384528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.385900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.386163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.386511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.386787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.387059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.387746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:58.388049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.389485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:58.400972 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:58.402085 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:58.403060 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:58.403060 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.403060 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:58.403060 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 201/399] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:58.403060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.410557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 199/400] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:58.411404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.463467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.472043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.507257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4296a6-1920-4f43-ba13-5abb03720823 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.513743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff245e-ae5c-481d-909b-a7f1a4fa5327 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.543152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.543750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.544021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.544284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.545035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:58.545332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.547272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.549808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.550471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.550751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.551028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.551659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:58.551956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.553355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.566116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 200/401] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:58.567183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.585153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 202/402] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:58.585983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.673629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a272c1-3832-4366-a65f-c39e343b651c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.683732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.686558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6751b-f659-4779-bdf1-092d602a5f7f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.708660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07021f11-6657-430c-9588-91316c164535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.709295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07021f11-6657-430c-9588-91316c164535 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.709569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07021f11-6657-430c-9588-91316c164535 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.709837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07021f11-6657-430c-9588-91316c164535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.712170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:58.721077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.721354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07021f11-6657-430c-9588-91316c164535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.721610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.721882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.722250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.722776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:58.722877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07021f11-6657-430c-9588-91316c164535 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.723095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.724454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.742436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 203/403] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:58.742436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-07021f11-6657-430c-9588-91316c164535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:58.742985 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:58.744689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:58.745543 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:58.745543 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:58.745543 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:58.745543 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 201/404] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:58.745543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07021f11-6657-430c-9588-91316c164535 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:58.839906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810800e-e158-4b38-b112-566bfe9786c0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.844459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07021f11-6657-430c-9588-91316c164535 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:58.874653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.875904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.876179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.876446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.878801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:58.879394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:58.879667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:58.879929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:58.880602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.882028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:58.892037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=c48d278dd82d4be0b5a79b225c962d1a, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:58.893520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.024940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 202/405] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:12:58 2022] POST /identity/v3/users => generated 247 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:12:59.025730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.047344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.060249 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 204/406] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:58 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:12:59.061541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.122646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.163006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630378a-270e-4850-9d48-d6b90c427d05 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.206248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.207345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.207900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.208349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.215625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12580-f4ea-43bc-b3f2-ea8621da249d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.221107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.223684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:12:59.241994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:59.242957 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:12:59.243793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:12:59.243793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:12:59.243793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:59.245664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 203/407] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:59.246677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.266769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.267416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.267696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.267971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.275696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.278211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:12:59.291232 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:59.292227 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:59.293132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 205/408] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:59.293586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.339507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.380547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5e0ea-640d-4c12-98bf-1e8962b5a09b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.425008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.432384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1922f-8388-4372-89b1-474da96a48bb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.433269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802939ea-47f2-46f3-879f-343362168089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.434063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802939ea-47f2-46f3-879f-343362168089 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.434636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802939ea-47f2-46f3-879f-343362168089 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.435051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802939ea-47f2-46f3-879f-343362168089 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.436755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802939ea-47f2-46f3-879f-343362168089 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:59.437772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802939ea-47f2-46f3-879f-343362168089 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.442191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802939ea-47f2-46f3-879f-343362168089 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.455726 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 204/409] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:59.456917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802939ea-47f2-46f3-879f-343362168089 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.483892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.485301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.486238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.486703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.487810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:59.488311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.490758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.511594 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 206/410] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:59.513070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.579762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802939ea-47f2-46f3-879f-343362168089 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.612906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.620230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.621143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.621556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.621986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.622805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:12:59.623242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.624970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.637838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 205/411] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:12:59.639158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.650116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b6ad8-bf63-4719-9162-1feecc09f36d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.694763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.695976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.696451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.696965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.705114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.706953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:12:59.720967 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:59.722301 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.723295 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:12:59.725884 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 207/412] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:59.727430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.751473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.762741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa0d62-4a21-44eb-84b4-6b57aa932b33 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.803132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.804325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.804879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.805485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.815054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.817402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:12:59.835140 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:12:59.836344 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:12:59.837947 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:12:59.841147 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 206/413] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:12:59.842245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:12:59.859552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc1a97f-2b39-46d8-bb69-cfce9f2ee85a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:12:59.899234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:12:59.900325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:12:59.900947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:12:59.901473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6b073a335e944427a8560a4864364434/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:12:59.908661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:12:59.923265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=6b073a335e944427a8560a4864364434, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:12:59.924808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:12:59.972134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd6036-e991-4c99-b854-0c6af23ac658 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:00.008287 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 208/414] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:12:59 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6b073a335e944427a8560a4864364434/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:00.009940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:00.030288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:00.032030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:00.032594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:00.033070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:00.034132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:00.034709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:00.036529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:00.053664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 207/415] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:00.062631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:00.224134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:00.239313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3201b-d12b-4634-a429-e70bf272c16a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:00.260857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:00.293834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae48b46-fc7a-4aef-9b8c-9728aa0b7136 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:00.311250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:00.312448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:00.312746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:00.313016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/b46383fc54d5469884898c1b75ce41ff/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:00.333991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=b46383fc54d5469884898c1b75ce41ff, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:00.335442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7c64a-9ec4-4dcc-adff-d66dc2c64497 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:00.354142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:00.355027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:00.355305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:00.355572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:00.357026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:00.357026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:00.358080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:00.377406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 209/416] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:00.382960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:00.398082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 208/417] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:00 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/b46383fc54d5469884898c1b75ce41ff/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:00.506741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b6935-c6fe-4e27-9334-da11bae63dba None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:00.538233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:00.548172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:00.548891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:00.549172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:00.549449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/7bca0e59f8374e88bc91ef8145bb7f8b/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:00.570443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=7bca0e59f8374e88bc91ef8145bb7f8b, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:00.572186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe200a6-a777-4aab-98ad-45bdde90bd19 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:00.649715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 210/418] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:00 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/7bca0e59f8374e88bc91ef8145bb7f8b/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:13:01.565913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e754e-1ec2-4c56-a604-991068358e64 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:01.566421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e754e-1ec2-4c56-a604-991068358e64 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:01.566495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e754e-1ec2-4c56-a604-991068358e64 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:01.568069 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 209/419] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:01.573378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:01.573793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:01.573983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:01.596355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:01.597668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:01.598864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dad5c-2750-4f35-a286-48ec7433485d None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:01.599195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dad5c-2750-4f35-a286-48ec7433485d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:01.599529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dad5c-2750-4f35-a286-48ec7433485d None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:01.601140 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 210/420] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:01.614420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:01.614777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:01.615091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:01.653723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:01.654928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:01.706557 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 211/421] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:01.750035 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 211/422] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:02.067696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.113589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.220177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28997-a208-439d-8ad2-2df28797bbb0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.221734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:02.230177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:02.233694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843b9fb9-fe90-4a10-9883-12a56803372c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.272695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.273708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.274292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.274756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.286178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:02.292856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:02.294634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:02.295437 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:02.297973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 212/423] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:02.304122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.322317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.322861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.323140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.323410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.344740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:02.349644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:02.350591 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:02.351394 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:02.355623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 212/424] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:02.357201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.426779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f69fbb-f1da-4da0-bb92-12398c36e06b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.472550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.473552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.474284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.475407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.476536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:02.477753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:02.479515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:02.508520 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 213/425] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:02.510342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.536575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a8b2-17cc-49cf-86f3-1a6e523e64ec None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.559174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:02.598586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.599926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.600918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.601564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.603068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:02.603783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:02.607972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:02.627570 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 213/426] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:02.633631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.695432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:02.726205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3dc9c-b15c-46de-986e-f8a48cfa4d6e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.799864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.800521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.800798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.801065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.823949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:02.825446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:02.840934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cb398-871e-4a39-9ab7-4d9806d25cc4 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:02.859876 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:02.861042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:02.861954 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:02.861954 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:02.861954 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:02.861954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 214/427] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:02.874442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:02.903293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:02.903930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:02.904240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:02.904522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:02.916714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:02.918219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:02.942735 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:02.945235 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:02.947395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:02.947395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:02.947395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:02.947395 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 214/428] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:02.950202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.028352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.051324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.078955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1918790-bc0b-44f2-b467-3dcb42dcb5ed None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.080199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b1b15-ba6e-481e-8a56-c57d74e48b35 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.121747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.122392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.122670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.122943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.123643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:03.124569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.125968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b58069-4ff0-4aea-baaf-f9e8416f3825 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.126151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.126757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.127035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.127304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.127952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:03.128253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.130073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f70360-f18d-4013-826d-b55e249ea1e4 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.139610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 215/429] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:03.141027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91258d5-1d27-4793-8e43-b59b3a5c79cc None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.141304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91258d5-1d27-4793-8e43-b59b3a5c79cc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.141569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91258d5-1d27-4793-8e43-b59b3a5c79cc None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.143083 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 216/430] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:03.144049 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 215/431] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:03.151966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91258d5-1d27-4793-8e43-b59b3a5c79cc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.152212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.152212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.152212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.172678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:03.173894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:03.255357 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 216/432] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:03.256850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.285066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91258d5-1d27-4793-8e43-b59b3a5c79cc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.323613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.339683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.340344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.340712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.341030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.350992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.353593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-5d5810ef-0d3d-46c8-a2ca-f15d1c106380 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:03.369121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:03.370095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:03.370993 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:03.374272 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 217/433] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:03.376000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1fb04-cf32-4d2e-9216-2322329f63f6 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.376537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1fb04-cf32-4d2e-9216-2322329f63f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.377013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1fb04-cf32-4d2e-9216-2322329f63f6 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.381157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.383130 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 218/434] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:03.384301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1fb04-cf32-4d2e-9216-2322329f63f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.418317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981821a9-4278-4e0d-a2bc-1433de9d5d21 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.463378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.464392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.465094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.465575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.474352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.476170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-616fcf0e-00c6-4c93-a307-01ad9e9a5740 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:03.494966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:03.496702 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:03.498827 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:03.502506 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 217/435] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:03.504988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.505687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.506345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.521261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1fb04-cf32-4d2e-9216-2322329f63f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.546794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:03.549032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:03.581772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.582706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.583189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.583670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.584898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:03.585392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.587538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.622255 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 219/436] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:03.622255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.672605 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 218/437] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:03.672605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.693961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.755148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:03.771456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219648f6-6c1a-4cb0-b550-20d9af802b65 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.806416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2da52e-e996-428c-8162-d00db5fa85c0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:03.827789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.828729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.829175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.829602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.830559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:03.830996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:03.832636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:03.845508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:03.846146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.846429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.846845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.860113 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 220/438] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:03.861597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:03.863188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-ae6693e8-0bd3-4c41-815b-e4c2bad4f7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:03.868393 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:03.874089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 219/439] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:03.875576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf093-4205-4425-851a-1e2c0bdd2b49 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:03.879010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf093-4205-4425-851a-1e2c0bdd2b49 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:03.879010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acf093-4205-4425-851a-1e2c0bdd2b49 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:03.879010 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 220/440] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:03.879758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf093-4205-4425-851a-1e2c0bdd2b49 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.009417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acf093-4205-4425-851a-1e2c0bdd2b49 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.012697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.015946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51f6c2-d793-4078-84f1-1fabaff6a496 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.031137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.048246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.049213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.049622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.050000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.058749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.059355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.059632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.059892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.062162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.064255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:04.079544 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:04.080781 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:04.081924 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:04.081924 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.081924 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:04.083958 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 221/441] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:04.084877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.135473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.137870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30db6b-5674-49d6-b43d-d9734702d37c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.218982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f789ef8-4a2c-4575-ac55-e02d9a0a899b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.252573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.256800 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 221/442] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:04.258181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.258528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.258893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.266562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.266562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.266562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.266562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.267165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:04.267165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.267165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.276179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 222/443] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:04.276861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.279950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:04.281551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:04.316894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.371409 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 222/444] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:04.372255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.385799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c75773-1ba4-42e7-b16e-3491edbd2c7e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.425062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.425687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.425990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.426234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.439477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:04.444864 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:04.449030 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 223/445] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:04.449820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.510480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b09cb9-9e9b-4584-8097-0ef425e3f4d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.546246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.553542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.554200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.554469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.554920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.556441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:04.561887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.561887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.573061 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 223/446] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:04.573977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.588131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.596102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a22417-ecf5-455b-bc08-774b7db0e77f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.632940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.633568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.633840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.634190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.645426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.646879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:04.663337 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:04.664439 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:04.665424 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:04.665424 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.665424 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:04.665424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 224/447] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:04.665424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.702355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63037d39-fc69-4ebc-843d-ad1cb32df72d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.740245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.740899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.741175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.741438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.752759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.754196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:04.768715 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:04.769920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:04.770797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:04.770797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:04.770797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:04.770797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 224/448] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:04.771042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.784954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d5325-6c62-41ac-bc7f-4d93a3327047 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.816939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.819511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.820114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.820511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.820679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.821329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:04.821660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.823024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.833093 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 225/449] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:04.833093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.843238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:04.880152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708fdea6-07bf-4070-a08c-c24e32ee12ca None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.954962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.955745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.956059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:04.956333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:04.957237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702bf6d-9443-41d5-bf54-bf2893547011 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:04.963260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:04.964804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:04.977281 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:04.978224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:04.979062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 225/450] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:04.979546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:04.998927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:04.999537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:04.999808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.000115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.000793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:05.001088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.002456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.015375 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 226/451] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:05.016244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.090530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.095628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f77a58-5f8a-4d87-8240-03fa61e8c63f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.097419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.130209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6fa17-de5f-424a-adbc-41492c123302 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.139389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.140357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.140848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.141301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.158477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:05.167121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:05.168213 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:05.169266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:05.172658 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 226/452] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:05.173694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.182749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.183354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.183651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.183914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.184578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:05.184875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.186883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.199552 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 227/453] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:05.200362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.279754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc576dfa-101b-4094-9646-c6a837f951af None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.307557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63833bc-58ca-4cb8-8546-b825f0c9de97 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.317450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.318062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.318330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.318582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.330052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.331521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.336879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.347629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.347629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.347629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:05.347944 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:05.348889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:05.349942 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:05.349942 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:05.349942 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:05.350127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.350127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:05.350127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.350127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.352645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 227/454] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:05.353647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.362928 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 228/455] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:05.363746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.375854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.464006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea67dc-f14d-4809-9b0b-eeb64247767c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.473367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f630a6-fb12-487f-b293-002a19a3393d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.507144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.507767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.508041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.508310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.519815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.520422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.520725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.520999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.521147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.521659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:05.521956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.523026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.523320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.533156 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 229/456] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:05.534699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:05.535298 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:05.536319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:05.537472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 228/457] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:05.537991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.594528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.619636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.640844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09030-a336-42f2-8511-5df502274e3e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.647138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76268d0-dfee-4cb9-80a8-a24f16d1c136 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.677014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.677617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.677891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.678160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.678786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:05.679086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.680450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.682688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.683511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.683859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.684259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.693254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 229/458] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:05.693522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.694049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.695047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:05.707810 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:05.709105 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 230/459] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:05.710116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.798053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a7c5-c775-4a5b-b661-00803b8f6b88 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.815881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0429805-b70c-4450-a967-0edd3b6f466a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:05.826337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.833144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.833792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.834062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.839495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/5d62c23e1f774db1bfa311c813861c8a/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.839495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:05.849922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=5d62c23e1f774db1bfa311c813861c8a, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.850261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:05.850906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:05.851151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:05.851386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.851478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:05.862735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:05.864218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:05.878630 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:05.879662 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:05.880971 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:05.880971 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:05.880971 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:05.880971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 231/460] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:05.880971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.950051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 230/461] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:05 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/5d62c23e1f774db1bfa311c813861c8a/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:05.951514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:05.990536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f55d2b-4798-4d31-b858-307da858fc2f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.038574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.039197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.039479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.039741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.040460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:06.040829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.042354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.061719 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 232/462] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:06.061719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.087330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.092289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322923e9-e970-48c5-a167-3b023af2f9d4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.136777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.137503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.137940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.138254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.147768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.149287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:06.164433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:06.165399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:06.166287 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 231/463] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:06.166839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.184476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10988f-6ee8-4054-87c7-3c2d8eebfd46 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.223248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.223945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.224217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.224521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.225266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:06.225580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.226033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.227093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.250848 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 233/464] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:06.250848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.287955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd0e28-6eb1-416a-a90d-f924d61fccb5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.330333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.331129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.331523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.331805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.332832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:06.333142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.334565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.353094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 232/465] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:06.353094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.360539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.394629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752333e-eb32-4324-8482-00a23a24526a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.432987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.433596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.433898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.434153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.434865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=c48d278dd82d4be0b5a79b225c962d1a) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:06.435721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.437188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.452520 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 234/466] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/role_assignments?user.id=c48d278dd82d4be0b5a79b225c962d1a&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:06.452520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.493599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0aaea1-8d5c-4478-935c-2567f4559b3b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.496788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.552189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.553098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.553568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.553987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.554928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:06.555363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.558239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.588835 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 233/467] 10.222.0.64 () {56 vars in 1139 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:06.590586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.598062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d786d5-7fdf-4300-9792-8d5bd21b501b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.640604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.641228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.641501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.641842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.660987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.727774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc9b88-6926-4e36-80c8-ab162e995d8a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.739045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.741194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.769563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.770275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.770556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.770828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:06.780295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:06.781877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:06.797634 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:06.798624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Nov 02 12:13:06.799656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:06.803732 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 234/468] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:06.804674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.836922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.878187 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 235/469] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:06.879229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:06.937000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:06.939589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b509c41-d690-4ec5-929a-16cb3b4df853 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:06.991039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:06.992920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:06.994049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:06.994769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.018246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080f37-ef09-4453-af32-3f2251ddbdd9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.082876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.084444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.085807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.086625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.088136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:07.088971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.093329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.118652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.121890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.124447 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 236/470] 10.222.0.64 () {56 vars in 1137 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:07.125531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.162743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.255919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7c14a-a6b8-4d9e-bc83-edb7c05b8b2c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.258097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.264778 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 235/471] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:07.265733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.298880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.299960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.300453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.300948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.313881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.316043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:07.336374 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:07.337371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:07.338230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:07.338230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.338230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:07.340540 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 237/472] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:07.341715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.397180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20148cb8-c915-43bf-810f-091a22bf0966 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.424464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.437274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.437874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.438147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.441778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.462251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68d079-f59d-4889-b676-a48ac57472c5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.507642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.508194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.508471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.508761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.533451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.534860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.550351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.552337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:07.555358 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:07.556353 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:07.557436 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:07.557436 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.557436 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:07.560825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 238/473] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:07.561729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.573556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.705431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 236/474] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:13:07.706062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09afa2d-10b3-4e65-b5f0-81db5e776b70 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.707154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.743696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.754514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.755644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.762295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.762295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.762295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:07.762295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.762295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.780762 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 239/475] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:07.780762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.849971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f71d3b-744a-4bc5-a797-4796b23c01c4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.858220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:07.892511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.893833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.894326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.894874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.895828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:07.896319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.897935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.898381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe650d-76fb-4dea-8839-522e68f05f7f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:07.916837 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 237/476] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:07.918225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:07.948834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:07.949500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:07.949782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:07.950054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:07.961827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:07.963707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:07.980433 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:07.981493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:07.983159 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:07.983159 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:07.983159 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:07.983159 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 240/477] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:07.983861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.025571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.046633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af54cd6-9cc7-4917-b40e-995af1600c60 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.085816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.086787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.087432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.087891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.096643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.098151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db34be-7f73-4b9c-84f9-4214135a18f3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.098613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:08.111472 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:08.112394 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.113262 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:08.120184 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 238/478] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:08.120973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.122782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.136511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.137240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.137524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.138447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.146260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.147836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:08.163863 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:08.165102 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.165958 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:08.170466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 241/479] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:08.171224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.256451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce8acd-d320-4d3e-a6d5-ae02a2153606 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.281783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa60eb3-40fc-42f8-86ea-7adeac1a3f86 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.296898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.298322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.299072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.299846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.301200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.301952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.305024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.319600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.320218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.320575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.320805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.321510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.321802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.323253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623a76f-df7c-40e6-b826-a7af649a8ff6 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.323802 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 239/480] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.325813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.330751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.338075 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 242/481] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.347765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a0db-57ae-484f-b70e-13c7f058c9d1 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.347765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a0db-57ae-484f-b70e-13c7f058c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.347765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a0db-57ae-484f-b70e-13c7f058c9d1 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.347765 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 243/482] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:08.347765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a0db-57ae-484f-b70e-13c7f058c9d1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.387859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.450061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b372e-063a-4af5-8557-2fc1418f507a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.460424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a0db-57ae-484f-b70e-13c7f058c9d1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.489813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.490407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.490689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.490942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.491620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.491917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.493384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.505798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.506928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.507461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.507934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.508399 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 240/483] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.509371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.526237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.528458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9c3b024b-171a-42fc-9139-9e503c843a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:08.543016 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:08.544057 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:08.544937 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 244/484] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:08.545381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.545771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.545860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.567161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:08.568372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:08.592878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.635141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fdadc-e8fa-40d4-b229-ce42d5cbb93c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.641250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 245/485] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:08.642110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.681334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.682227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.683708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.684190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.684818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.685787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=6b073a335e944427a8560a4864364434) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.686112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.687729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.695032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 241/486] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/role_assignments?user.id=6b073a335e944427a8560a4864364434&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.696424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:08.836674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd42c8c-35fe-472a-913c-805c6b9c4bc6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.893508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.894141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.894418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.894688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.895634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=b46383fc54d5469884898c1b75ce41ff) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.895970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.896170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffc5ea-1cb9-43ed-99e1-ef4951a0d9e9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:08.904892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05d91-32f8-4d86-b092-070859666c25 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.905358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 246/487] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/role_assignments?user.id=b46383fc54d5469884898c1b75ce41ff&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.906594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7d3c-e3b0-4809-8f15-b1d690ce5d80 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.906875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7d3c-e3b0-4809-8f15-b1d690ce5d80 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.907198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c7d3c-e3b0-4809-8f15-b1d690ce5d80 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.913471 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 247/488] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:08.915283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.915589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.915948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.937662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:08.941591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:08.943006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:08.949375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:08.950599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:08.950877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:08.951126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:08.952038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:08.952349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:08.954149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:08.971501 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 242/489] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:08.977372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.045258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 248/490] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:09.046133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.113412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:09.141980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3c34-a543-48d7-837b-e5cf0dcf9ee9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.190428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.191451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.191909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.192452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.193396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=7bca0e59f8374e88bc91ef8145bb7f8b) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:09.193915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:09.195809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:09.203116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 243/491] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:08 2022] GET /identity/v3/role_assignments?user.id=7bca0e59f8374e88bc91ef8145bb7f8b&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:09.212282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36bdc6-09a4-41a4-baba-5e94ee3a9a20 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.253814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.254456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.254729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.254993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.267902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:09.272964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:09.273907 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:09.274697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 249/492] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:09.280977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.341062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.350304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:09.454555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782120d-b2f8-4359-b7f2-8a9b7cfffd80 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.484074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:09.505448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.506254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.506632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.506899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.507565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:09.507859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:09.509197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab019-09c2-4549-bd6b-52ab35f70c87 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.509455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:09.540807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 244/493] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:09.545134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.574035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.574710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.574976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.576420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.591133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:09.599587 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:09.600578 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:09.601815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 250/494] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:09.607293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.692600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b70d3-c612-45cf-9b36-03fef3be574a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.708401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:09.738369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.739035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.739306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.739569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.752443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:09.753948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:09.754908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0304-7209-41e3-8b25-a815172db178 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:09.770450 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:09.771435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:09.772283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:09.772283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:09.772283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:09.772283 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 245/495] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:09.780995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.827956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:09.828683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:09.829072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:09.829403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:09.830174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:09.830538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:09.832796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:09.851400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 251/496] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:09.857110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:09.861016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:09.993476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f387a-771b-4738-9d32-6527da101796 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.051801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fb41c-4122-4b95-8b07-682e349ca35f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.070803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.071764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.072333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.072886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.073769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:10.074279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.077315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.100468 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 246/497] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:10.107613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:10.111551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.112533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.113008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.113538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.131320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.136406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.180461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:10.187179 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:10.195189 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:10.196040 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:10.196040 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:10.196040 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:10.196040 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 252/498] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:10.200396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:10.328978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:10.339150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c0932-cd12-4ad7-8c16-2c1caeb643d2 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.395623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.396688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.397104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.397513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] PATH_INFO: `/v3/users/swift` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.409702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.412187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.421013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215d5ef-4853-47c6-9b58-28138ac323f3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:10.438357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:10.439399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:10.440328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:10.446902 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 247/499] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:10.448515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:10.499861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.503338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.503338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.503338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.503338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:10.503338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.503684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.537610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 253/500] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:10.547096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:10.649844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:10.680800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0b5c-429e-46e5-97e5-5b834edab3fb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.757086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae172a-f275-4941-9bf1-bf3a93805144 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:10.762746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.763359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.763635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.763902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.764652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:10.764951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.768518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.792747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:10.796927 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 248/501] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:10.806992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:10.837269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:10.838069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:10.838479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:10.838844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:10.851917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:10.853662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:10.874579 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:10.875942 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:10.877151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:10.879481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 254/502] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:10.887949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.003008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f430e47-1248-45ff-8af3-23a5c248cd68 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.021223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4c86a-91a0-4736-a0ec-3151f1f1fd53 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.075985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.076757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.076874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.077140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.077896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:11.078230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.079747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:11.084120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.084752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.085027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.085285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.112343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.120540 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 255/503] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:11.126901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.203753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.238395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.240742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:11.304078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd767b01-f935-4f7e-9b0f-c6f424adc762 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.403149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 249/504] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:13:11.410779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.412413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.413395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.413887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.414362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.427191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.429049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:11.446435 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:11.447600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:11.448474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:11.448474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:11.448474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:11.450891 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 256/505] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:11.470824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.567193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.681057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.692917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb2b-226e-49b0-ba28-7c2c874dadc4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.713067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db207a06-f362-4b81-9a6f-9405e6a4e0d1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.738040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.738790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.739071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.739340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.754195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.757275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:11.766775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.767671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.768215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.768593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.769246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:11.769546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.771125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-729aad7c-9322-4729-82a1-1a2b8c62a489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:11.776659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:11.777911 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:11.779023 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:11.779023 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:11.779023 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:11.782007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 250/506] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:11.783568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca76fd-f340-4324-9961-41d18afdcd15 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.784074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca76fd-f340-4324-9961-41d18afdcd15 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.784626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca76fd-f340-4324-9961-41d18afdcd15 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.787210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 251/507] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:11.788814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca76fd-f340-4324-9961-41d18afdcd15 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.791203 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 257/508] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:11.800648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:11.929721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3bdef-7cde-42eb-bdaa-e1ab1be86521 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.971861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:11.977324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:11.978160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:11.978533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:11.978898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:11.985821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca76fd-f340-4324-9961-41d18afdcd15 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:11.989083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:11.990934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7ef9324f-ac03-4601-a5a7-1efb0437917d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:12.004361 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:12.005375 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:12.006298 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:12.007473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 258/509] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:12.009037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b19f0-56fc-4e2d-a8fa-19c8299d963e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.009397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b19f0-56fc-4e2d-a8fa-19c8299d963e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.009771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b19f0-56fc-4e2d-a8fa-19c8299d963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.028638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:12.035801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6d5b19f0-56fc-4e2d-a8fa-19c8299d963e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:12.037535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d5b19f0-56fc-4e2d-a8fa-19c8299d963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:12.057761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.060250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.061954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.063041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.065734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:12.066432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.068977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.091401 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 252/510] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:12.093077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.130024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 259/511] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:12.133730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e804b-29fb-43c0-afd0-9d3e1c9d1656 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.134686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e804b-29fb-43c0-afd0-9d3e1c9d1656 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.135289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e804b-29fb-43c0-afd0-9d3e1c9d1656 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.139198 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 260/512] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:12.140983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e804b-29fb-43c0-afd0-9d3e1c9d1656 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.265564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e804b-29fb-43c0-afd0-9d3e1c9d1656 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:12.269613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad579a-1502-4d66-8231-2bf3a5b6273a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:12.308368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.309159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.309493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.309828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.313650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:12.319503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.321318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.331723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.333249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.333914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.334591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-747e4aa2-888f-4475-87ef-8ee989c2bc8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:12.335952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:12.337366 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:12.338796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:12.340842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:12.341695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.342963 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 261/513] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:12.344623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9d28-3d39-41df-95dc-a0e7c5163033 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.344971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9d28-3d39-41df-95dc-a0e7c5163033 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.345318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e9d28-3d39-41df-95dc-a0e7c5163033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.345655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.367579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e28e9d28-3d39-41df-95dc-a0e7c5163033 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:12.368715 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 253/514] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:12.368920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e28e9d28-3d39-41df-95dc-a0e7c5163033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:12.372654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.396830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 262/515] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e32e-a5b0-4fcb-8871-ad851db7e139 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e32e-a5b0-4fcb-8871-ad851db7e139 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23e32e-a5b0-4fcb-8871-ad851db7e139 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 263/516] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:12.458843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e32e-a5b0-4fcb-8871-ad851db7e139 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.522822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028b02-74b8-4811-8481-a68f38d181a3 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:12.566899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.567549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.567867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.568133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.568849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:12.569149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.570572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.577177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23e32e-a5b0-4fcb-8871-ad851db7e139 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:12.588820 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 254/517] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:12.588820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.606867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:12.617205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.618396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.619819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.619819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.622694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=c48d278dd82d4be0b5a79b225c962d1a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.624682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351de5f2-9803-4cd2-a4ea-3e03f46a40f8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.669099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:12.697120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cc3ec-4377-40be-b2ae-5aa358bced1e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:12.708554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 264/518] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:12 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:12.708554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.708554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.708554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.720632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:12.721866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:12.756843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:12.757774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:12.758153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:12.758425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:12.759430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:12.762123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:12.776226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:12.777938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:12.778772 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 255/519] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:12.779899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.823178 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 265/520] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:12.824734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:12.976415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd900e6-7aed-4816-b2bc-a1efc91dd04c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.018921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.020030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.020576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.021476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.022663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=5d62c23e1f774db1bfa311c813861c8a) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.023168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.025561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.034321 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 256/521] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/role_assignments?user.id=5d62c23e1f774db1bfa311c813861c8a&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:13.036225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.048521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.060149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bce16a-4bc9-4273-add5-e97736054d13 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.101448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.154331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.154988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.155323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.155493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.156111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.156406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.158313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.169345 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 266/522] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:13.171086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.235715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82a08-c8e0-48bb-950d-a92afc2bb13a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.276516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.277935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.278047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.278837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] PATH_INFO: `/v3/services/network` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.278837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.280245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:13.291885 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:13.293995 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:13.294826 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 257/523] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:13.295752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.306415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74a66-cc1b-439e-ae73-2d40debdefb8 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.354615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.355962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.356243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.356524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.368699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.371092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:13.389089 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:13.390098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:13.391635 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:13.391635 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:13.391635 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:13.395631 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 267/524] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:13.396711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.396963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.437469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.454413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127d3e6-6074-4e2a-8d32-284fa999e9dc None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.506070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.507051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.507529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.508002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.509231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.509556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.513464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.530837 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 258/525] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:13.530837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.539213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86fbd-0664-44e1-82c8-50d62a0b2018 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.597624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.598827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.599633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.600112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.601511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.602656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.604623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.616838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 268/526] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:13.619583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:13.770833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.779202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0c156-6ae0-496c-8d1e-b5cf262ae8c9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.800951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9ea5c-4cd4-4cdd-a9ae-8291cd89ffe8 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:13.828840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.831659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.831968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.832187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.832876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] RBAC: Adding query filter params (type=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.833294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.834722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.853538 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 269/527] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:13.864032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:13.873354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:13.873994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:13.874334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:13.874800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:13.875660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:13.875959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:13.877813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae3a92-75b5-4eaa-bd5d-31bcb5347612 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:13.896082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 259/528] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:13.902807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:14.033434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fd7e5-10c4-4058-8c9d-2bec06d05aaf None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:14.086523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:14.087144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:14.087420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:14.087685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:14.088431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:14.090133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba81b6-3890-4608-9bdb-24672b59738a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:14.172687 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 270/529] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:13:13 2022] POST /identity/v3/users => generated 254 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:15.853042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105788b-112c-46af-b66b-ab6011d1a19c None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:15.854312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105788b-112c-46af-b66b-ab6011d1a19c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:15.854816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105788b-112c-46af-b66b-ab6011d1a19c None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:15.856773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 260/530] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:15.862472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026069-b09a-4907-9675-b7194e51c35a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:15.863335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026069-b09a-4907-9675-b7194e51c35a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:15.863872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed026069-b09a-4907-9675-b7194e51c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:15.884133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ed026069-b09a-4907-9675-b7194e51c35a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:15.886310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ed026069-b09a-4907-9675-b7194e51c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:15.898813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:15.977826 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 271/531] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:15.994337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740f32-2c84-435b-8b9b-d7a7f3051a1d None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:15.995215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740f32-2c84-435b-8b9b-d7a7f3051a1d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:15.995488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad740f32-2c84-435b-8b9b-d7a7f3051a1d None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:15.997078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 261/532] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:16.002964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603caed-6f26-47af-bbed-48c90889c555 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.003331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603caed-6f26-47af-bbed-48c90889c555 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.003648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603caed-6f26-47af-bbed-48c90889c555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:16.037756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b603caed-6f26-47af-bbed-48c90889c555 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:16.039164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b603caed-6f26-47af-bbed-48c90889c555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:16.134165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 272/533] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:13:16.498339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad740f32-2c84-435b-8b9b-d7a7f3051a1d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:16.637019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7ec8-e0fe-4b4c-8232-f0e4277fbebf None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.637724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7ec8-e0fe-4b4c-8232-f0e4277fbebf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.638233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7ec8-e0fe-4b4c-8232-f0e4277fbebf None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:16.639863 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 273/534] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:16.640062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad740f32-2c84-435b-8b9b-d7a7f3051a1d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:16.645763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.646355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.646839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:16.669334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:16.671213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:16.703757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:16.704872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.705373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.705844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:16.728278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:16.739208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:16.740257 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:16.741596 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 262/535] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:16.742863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:16.780644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 274/536] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:13:16.785945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:16.814199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:16.839159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:16.907320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e82de6-6275-4962-bcf7-9e1e29e84d2c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:16.958531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:16.959430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.959837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.960242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:16.961525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389028b-21ca-4e93-9362-f668a2b446bf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:16.977230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-56433696-9b11-44ca-9dc0-a92c98f51dd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:16.987181 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:16.988144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:16.989049 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:16.996046 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 263/537] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:16.998292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850f63-326e-4b22-882e-14e6fba72c01 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:16.998875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850f63-326e-4b22-882e-14e6fba72c01 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:16.999285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d850f63-326e-4b22-882e-14e6fba72c01 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.001686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 264/538] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:17.002796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d850f63-326e-4b22-882e-14e6fba72c01 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.008803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.009741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.010200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.011196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.012219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:17.012763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.015013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b21b8-146a-4028-a9d0-b19a0a7a19e1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.029226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 275/539] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:17.031200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.031557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.032017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.059661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:17.061605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:17.134559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d850f63-326e-4b22-882e-14e6fba72c01 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.150556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:17.157071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:17.172525 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 276/540] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:17.172525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.189936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.190757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.191132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.191478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.192350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:17.192885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.194601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.208623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 265/541] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:17.208623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.339036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f481c-78f0-4785-af5e-9b6abc92c056 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.368016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43faa6c-6095-4eb2-a1d8-62bb857ade83 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.387487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.388590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.389311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.389828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.404480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.407356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.421321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.422203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.422611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.423016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.424020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:17.424518 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:17.431999 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:17.434082 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:17.434082 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:17.434082 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:17.434082 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 277/542] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:17.435068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b0347-447b-4d39-998d-3f0be6128f40 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.435359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.483257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:17.528888 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 266/543] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:17 2022] POST /identity/v3/services => generated 251 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:17.530678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170b3f-ae95-40f3-b82a-d94cb24ec04f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.530964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170b3f-ae95-40f3-b82a-d94cb24ec04f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.531236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd170b3f-ae95-40f3-b82a-d94cb24ec04f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.537086 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 267/544] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:17.537086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd170b3f-ae95-40f3-b82a-d94cb24ec04f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.546326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635725-0d3f-415c-af36-2b28de594125 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.587014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:17.603484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.604152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.604433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.604741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.621210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.623342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:17.642452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:17.649782 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:17.650647 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:17.650647 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:17.650647 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:17.650647 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 278/545] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:17.650647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.711975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd170b3f-ae95-40f3-b82a-d94cb24ec04f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.763861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.764491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.764800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.765090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.765729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:17.766087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.767476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b6cb5-7f41-4ac3-9e7f-c3a87e9deca1 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.779320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 268/546] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:17.780607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.780914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.781185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.795360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:17.802230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:17.802401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8c6f-1552-4e42-a511-c3d79986908e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:17.803547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:17.848766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:17.849643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:17.849926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:17.850186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:17.850845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:17.852486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:17.908125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 269/547] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:13:17.909992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:17.918427 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 279/548] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:17 2022] POST /identity/v3/services => generated 240 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:17.920446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.010130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.176623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4f751-8675-410d-9711-0b3c9f48faf3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.188735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab2f14-b92b-48f3-ac63-283ec42aef99 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.217398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.218078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.218356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.218628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.228808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.230342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:18.244554 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:18.245542 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:18.247076 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 280/549] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:18.252458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.260766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.261751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.262236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.262709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.263671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:18.264207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.266627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.273848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.283155 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 270/550] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:18.289146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.383352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c598bd0-bd22-45a8-9d4a-a37c36584704 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.397135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.418760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93a3b6-53cb-4dc2-8fec-83a9c50133c4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.430723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.431698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.432204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.432726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.433964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:18.434486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.436203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.457260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.458007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.458392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.458708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.459849 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 281/551] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:18.460994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.468247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.469930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:18.483522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:18.484693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:18.485639 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 271/552] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:18.486225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.549291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.583916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23910c52-511d-49b9-a94f-b5111a50edf9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.610849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28031a14-3353-4cd6-b1d6-af0ad7adcce9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.625280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.626442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.626937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.627407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.639698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:18.644968 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:18.645906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:18.646778 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:18.649910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.655379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.655379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.655379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.655778 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 282/553] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:18.656930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.663850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.665402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.667894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:18.682920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:18.684211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:18.685168 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:18.685168 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:18.685168 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:18.685168 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 272/554] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:18.685168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.772503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4375d-a3dd-4c29-8982-f1ad26394083 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.800240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab28d6-eadf-4478-abe6-1597f34665cf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.806201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.812012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.813004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.813450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.813899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.821174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:18.821174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.821174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.837971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 283/555] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:18.839152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.839814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.840434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.840820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.841164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.841913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:18.842645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.845010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:18.858684 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 273/556] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:18.859751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:18.929049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:18.951781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601e62e-6c8c-4ab9-a387-65f5026320eb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.972231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef283d8-aecc-49cb-a737-cc446e2700bb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:18.989640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:18.990975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:18.991461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:18.991939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:18.992850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:18.993930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:18.995533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.008429 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 284/557] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:19.010176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.012320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.013017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.013306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.013831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.065222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.090668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.092300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.121947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97288ab-6202-4db9-880f-dc9ab0cdac83 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.159262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.160290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.160834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.161310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.174100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.175978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:19.192977 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:19.194414 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:19.195309 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:19.195309 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:19.195309 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:19.196939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.197705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 285/558] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:19.198711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.218624 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 274/559] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:19.218624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.307267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e486a2-54fa-483a-88b7-bbe91ca24764 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.309900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.329826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a670-45d0-4499-aeb1-b9a170f706ed None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.348092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.349227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.349750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.350226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.357787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.359588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.371149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.371769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.372054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.372328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.372994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:19.373298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:19.374011 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:19.374901 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:19.375795 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:19.376235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.378448 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 286/560] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:19.379480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.394332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 275/561] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:19.396393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.420947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.492936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdafb87-018e-457f-a12c-2165ad40476f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.530763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7d10-f2a1-42f6-b43d-62a14ab0104a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.536601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.537547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.538030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.538512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.550492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.552285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:19.569994 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:19.571025 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:19.571906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:19.571906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:19.571906 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:19.572074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.572074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.572235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.572790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.573231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:19.573540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.574908 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 287/562] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:19.575257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.576823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.594314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.594898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 276/563] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:19.596605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.708085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1826a-3bee-4e21-80e8-4a4b0eb3e34d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.731966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.752682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.752682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.752682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.752682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.762036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.762179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b63ce-4304-46ac-bdb5-234afa3ecf03 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.763732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:19.778892 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:19.780932 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:19.781938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:19.782484 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 288/564] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:19.783054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.821070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.822058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.822719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.823188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.823963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:19.824319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.826035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:19.842189 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 277/565] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:19.843223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:19.893471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:19.931197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d18f3-fcb4-4bc3-b5bc-65768ab0e1cc None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.983794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:19.985346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:19.986019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:19.986292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/5d62c23e1f774db1bfa311c813861c8a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:19.988760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=5d62c23e1f774db1bfa311c813861c8a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:19.989230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edd0d-f970-4a97-891b-5c7f5c78a95a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:19.990755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.028844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.029580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.029879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.030221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.031124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:20.032016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.033549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.037287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.057182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 278/566] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Nov 2 12:13:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:20.057182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.067381 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 289/567] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:19 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/5d62c23e1f774db1bfa311c813861c8a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:20.068648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.196662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e1bd1c-82d8-4e54-9169-70889f598d00 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.240539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.241597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.242096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.242531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328f4c8-5338-4869-9b4e-5a28194e8165 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.242824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.245501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.257650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.259595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-15d25840-2b78-4c72-830f-7f51ab887f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:20.277279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:20.278345 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:20.279313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:20.279313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:20.279313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:20.284590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 290/568] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:20.286186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3b667-10cf-4c32-a920-c812baf74ba1 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.286681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3b667-10cf-4c32-a920-c812baf74ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.287183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3b667-10cf-4c32-a920-c812baf74ba1 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.289074 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 291/569] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:20.292142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3b667-10cf-4c32-a920-c812baf74ba1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.306632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.307633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.308086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.308677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.321972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.324835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-51f2d3a7-d25c-4689-816a-3482a5b59671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:20.348194 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:20.349264 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:20.350146 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 279/570] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:20.355122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.355122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.355122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.384751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:20.386699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:20.443312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3b667-10cf-4c32-a920-c812baf74ba1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.486573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.490580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.491253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.491535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.491875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.492585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:20.494001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.495688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.525770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 292/571] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:20.525770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.526068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 280/572] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:20.527071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.621918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.651740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840991-8a2e-4fce-8278-9726dce6ce49 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.670723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e667d7-800e-443d-8f81-b252ba806ad9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.695011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.695655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.695934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.696206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.704786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.706299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.717966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.718795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.719248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f794bf1b-eb27-469d-9517-dd930fcbb08d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:20.719420 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:20.720436 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:20.721473 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:20.722212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.723647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:20.724096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.725732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3595d-83ea-49d5-b6c5-22ce537c58fb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.726374 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 281/573] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:20.727981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276013c9-a1ae-4356-a1e8-ff42b0e0b1f4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.728179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276013c9-a1ae-4356-a1e8-ff42b0e0b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.728463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276013c9-a1ae-4356-a1e8-ff42b0e0b1f4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.730196 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 282/574] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:20.731075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276013c9-a1ae-4356-a1e8-ff42b0e0b1f4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.741507 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 293/575] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:20.747248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.747248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.747248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.769414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:20.771207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:20.799717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.856574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 294/576] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:20.857451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:20.875173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276013c9-a1ae-4356-a1e8-ff42b0e0b1f4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:20.918270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:20.923132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:20.924157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:20.924841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:20.925311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:20.926195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:20.927073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:20.929453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:20.946397 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 283/577] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:20.947526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.008712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4fd5c-23f0-4f67-9784-6019e05f6837 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.063303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.064853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.065727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.066458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.068010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=c48d278dd82d4be0b5a79b225c962d1a) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:21.069396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.072288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.089058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7094a1f-ffd5-4171-9579-c7ae839e8b3f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.089058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:21.090732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 295/578] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/role_assignments?user.id=c48d278dd82d4be0b5a79b225c962d1a&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:21.092667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.142523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.144182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.146513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.149001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.149584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.150952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:21.163951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:21.165302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:21.166225 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.170394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 284/579] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Nov 2 12:13:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:21.171601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.255479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:21.259593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266efaeb-d41c-457a-a247-c215d6fb7c8e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.303745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.305494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.306059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.306485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/598d3903c0a540669a27f9a09b4cdaeb/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.310559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da753a-7467-4e55-9477-88a680ebcbb3 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.328523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=598d3903c0a540669a27f9a09b4cdaeb, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.330614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.350515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.351320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.351632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.356813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] PATH_INFO: `/v3/services/network` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.356813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.356813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:21.363572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:21.364766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:21.365723 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 285/580] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:21.366675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.402779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:21.423385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 296/581] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:21 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/598d3903c0a540669a27f9a09b4cdaeb/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:21.426100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.508124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c3fbe-4a72-4a34-96d7-cb2cacb57327 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.593380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.594001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.594278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.594596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.595290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:21.595588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.597272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.607323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdca21-c218-4b2f-bcca-99f30aea0780 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.621467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 286/582] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:21.628211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.696544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.697375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.697671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.698710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.699627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:21.700174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.701641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.711402 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 297/583] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:21.725229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.748131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:21.813755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:21.821467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a928e-0ec0-4be2-99c0-bdde51fa961d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.862705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.863597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.864043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.864543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.865378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:21.865867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.867603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.874877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 287/584] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:21.886153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:21.922579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d459ab-eb13-4370-a128-c874de3618f3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:21.981270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:21.981710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:21.982097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:21.982477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:21.983315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] RBAC: Adding query filter params (type=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:21.983709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:21.985855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:21.991285 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 298/585] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:21.997922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:22.071967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ce7ed-0517-47de-9f01-eb3909e8b8f0 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:22.104864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:22.135204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f792778-7b45-4b49-968c-52ed4ea96a3c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:22.135852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:22.136944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.138024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.138563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.139791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] RBAC: Adding query filter params (interface=public, service_id=423433ef171345f3b0e9bfd8fe112f3a, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:22.140373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:22.142814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:22.157919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 288/586] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/endpoints?service_id=423433ef171345f3b0e9bfd8fe112f3a&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:22.167857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:22.204410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:22.205060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.205340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.205605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.206311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] RBAC: Adding query filter params (interface=public, service_id=b6677c9a67e6437d82a9fb9e3abc1da3, region_id=RegionOne) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:22.206616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:22.208003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:22.223375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:22.226467 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 299/587] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:21 2022] GET /identity/v3/endpoints?service_id=b6677c9a67e6437d82a9fb9e3abc1da3&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:22.238148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:22.366695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09dad9b-85c0-4244-ab17-4e12f0dd84b7 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:22.433132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:22.433747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.434022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.434293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.434904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:22.436877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d66fc-7cc9-466b-919e-370292119ddb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:22.445324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b837b-03d8-4cdf-87dd-a50fafec2e88 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:22.454874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 289/588] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:22 2022] GET /identity/v3/services => generated 772 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:22.500503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:22.502048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.503048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.503772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.505087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:22.507897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba3f90-2a56-4681-9801-76eedceecfa4 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:22.531981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 300/589] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:22 2022] GET /identity/v3/services => generated 772 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:22.650149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f9054-0142-45a1-84a5-b1adc5aac7e2 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.650564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f9054-0142-45a1-84a5-b1adc5aac7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.650713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f9054-0142-45a1-84a5-b1adc5aac7e2 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.652472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 290/590] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:22.659851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:22.660740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:22.661433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:22.689937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:22.698750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:22.703826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:22.819373 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 301/591] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:23.114764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f9054-0142-45a1-84a5-b1adc5aac7e2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:23.224069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:23.243089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f9054-0142-45a1-84a5-b1adc5aac7e2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:23.292098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:23.292838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:23.293163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:23.293436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:23.305644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:23.310689 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:23.311718 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:23.312664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:23.317396 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 291/592] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:23.323362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:23.469324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a9c0ef-ea02-483f-9922-85af11f3bbae None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:23.527434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:23.528058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:23.528331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:23.528632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:23.529366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:23.529670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:23.531041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:23.538140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:23.545935 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 302/593] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:23.552798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:23.685788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc29c-8da0-4743-8707-6d6fe2535fc5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:23.733621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:23.734678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:23.735050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:23.735354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:23.749243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:23.751010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:23.768256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c0bf18cc-193d-475c-b827-82e0d6bca506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:23.778721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:23.782018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:23.783564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:23.783564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:23.783564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:23.783564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 292/594] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:23.786420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:23.786814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bce00-a8e3-4945-9897-42cb207fbe10 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:23.787075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bce00-a8e3-4945-9897-42cb207fbe10 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:23.787317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093bce00-a8e3-4945-9897-42cb207fbe10 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:23.788906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 293/595] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:23.796172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:23.796460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:23.796769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:23.820203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:23.821836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:23.905575 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 294/596] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:24.032910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579301b-3d3b-4fa5-b647-8ceba29ae6f1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:24.081560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:24.082172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.082446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.082714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.083352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:24.083649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:24.085077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:24.110468 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 303/597] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:24.116071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:24.259095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91178af-50ea-433a-87c8-4358c2efd34c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:24.296953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:24.299960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:24.300637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.300917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.301189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.309285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:24.310883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:24.332074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:24.342129 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:24.343195 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Nov 02 12:13:24.344224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:24.344814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 295/598] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:24.353527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:24.440930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:24.596091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4a31c-d693-4526-a76c-6f9155ae5edc None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:24.622309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa98b5-8352-40ea-a39b-b1c8f22a14bf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:24.684092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:24.684799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.685082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.686131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.686755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:24.688166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:24.701492 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:24.702507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:24.703413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 304/599] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:24.709782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:24.746901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:24.747915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.748401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.748912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.750240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:24.750781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:24.753454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:24.826463 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 296/600] 10.222.0.64 () {56 vars in 1135 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:24.851594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:24.907505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f4b35-0207-4a7e-a869-0e30d81f5f82 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:24.937909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:24.953829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:24.971203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:24.972572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.973259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.973940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.975325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:24.976078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:24.979000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d4e5-eeb4-4bbe-989a-3c74d32d2266 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:24.988709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 305/601] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:24.991322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07fc7-cbaa-40a3-b6dd-7dcacbe47e8b None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:24.992031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07fc7-cbaa-40a3-b6dd-7dcacbe47e8b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:24.992770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07fc7-cbaa-40a3-b6dd-7dcacbe47e8b None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:24.995934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 306/602] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:24.997460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07fc7-cbaa-40a3-b6dd-7dcacbe47e8b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:25.014321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dece24b-8a7e-4031-bb89-8c77f94e1cd7 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:25.061682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:25.062409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.063089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.063793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.126361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07fc7-cbaa-40a3-b6dd-7dcacbe47e8b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:25.160978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:25.163526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:25.167428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:25.167428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.167651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.167890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.169180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:25.169547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:25.171009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1469b-cb70-45ad-bace-32eb7f6456e7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:25.181879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 307/603] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:25.181879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94445-ed7d-4d30-896e-67900f62862c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.181879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94445-ed7d-4d30-896e-67900f62862c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.181879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94445-ed7d-4d30-896e-67900f62862c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.199367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cdc94445-ed7d-4d30-896e-67900f62862c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:25.201271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdc94445-ed7d-4d30-896e-67900f62862c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:25.256246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:25.321667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 297/604] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:25.326655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:25.328615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:25.373020 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 308/605] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:25.488582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0037-b980-4ea8-89d4-340b136940ed None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.489222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0037-b980-4ea8-89d4-340b136940ed None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.489796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b0037-b980-4ea8-89d4-340b136940ed None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.492405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 309/606] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:25.497546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0f16-89fa-4856-b441-855dd99b8a01 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.498970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0f16-89fa-4856-b441-855dd99b8a01 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.499476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff0f16-89fa-4856-b441-855dd99b8a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.530536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-76ff0f16-89fa-4856-b441-855dd99b8a01 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:25.531892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76ff0f16-89fa-4856-b441-855dd99b8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:25.532354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b2c4c-ff4d-4ff4-9117-0d0b32e95ecd None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:25.575390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:25.576437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.577009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.577502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.589815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:25.591742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:25.602846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-fad8222d-d7e4-42a4-a62c-a9de0d3b9c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:25.610841 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:25.611901 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:25.613346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:25.613346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:25.613346 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:25.615654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 298/607] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:25.617468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467405b9-569a-4d09-8d77-dfec56217577 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.617963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467405b9-569a-4d09-8d77-dfec56217577 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.618425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467405b9-569a-4d09-8d77-dfec56217577 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.620101 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 299/608] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:25.621139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467405b9-569a-4d09-8d77-dfec56217577 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:25.621859 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 310/609] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:25.633486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.633890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.634169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.659240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:25.660838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:25.755165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 311/610] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:25.756466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:25.807817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467405b9-569a-4d09-8d77-dfec56217577 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:25.866978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:25.892753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:25.893365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:25.893638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:25.893908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:25.894667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:25.894975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:25.897838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:25.917467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 300/611] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:25.923819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:25.958053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60d197-b5ed-4a71-862f-34d8c517d9c8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.003626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.003880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.004789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.005072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.005395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.017823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:26.028317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:26.029367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 312/612] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:26.030205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.062313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0742e31-5fc7-4acf-a111-783b1dd37249 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.105426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.106070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.106344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.106612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.115179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.116974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:26.130185 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:26.131142 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:26.132062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 301/613] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:26.133052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.151671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.154828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963e09-1a43-4b7c-9c65-4f1fad25dd3c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.194862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.195794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.196224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.196674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.197480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.199014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:26.209928 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:26.211109 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Nov 02 12:13:26.212151 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.214333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 313/614] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:26.215340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.256208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785723-cf1c-4849-84ad-0eb111621671 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.277947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.294876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.295487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.295765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.296034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.296726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.297027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.298385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.315293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 302/615] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.316276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.337527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab6b41-1940-449b-9385-6f6031ea28d7 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.379953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.380747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.380929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.381168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.381827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.383534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:26.393600 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:26.394697 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:26.395836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 314/616] 10.222.0.64 () {56 vars in 1129 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:26.397729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.429591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.447311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15122599-43b1-45b4-9fd4-54a65d2470e3 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.491622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.492281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.492656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.492970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.493671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.494025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.495547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.512916 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 303/617] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.512916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.521850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf437-0d76-4adc-a5be-5b02c252caa6 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.559550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.560664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.560944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.561211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.561837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] RBAC: Adding query filter params (name=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.562509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.563518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.565019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.570827 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 315/618] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.571401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.637217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726bceb-02e6-45aa-b77a-5cadc681c6c1 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.671668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.672304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.672649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.672885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.684856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.686353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:26.702555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:26.703761 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:26.704741 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:26.704741 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:26.704741 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:26.704741 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 304/619] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:26.704966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.716090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.726017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1460efd-8934-4153-b338-050f2bb88baa None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.764360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.764927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.765209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.765483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.766121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.766426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.767811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.773442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 316/620] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.774359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.825732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:26.834225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54725f-9617-4d65-8896-eb5d6c8f1b88 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.876736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.877521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.877866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.878146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.879223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=5d62c23e1f774db1bfa311c813861c8a) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.879576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.881039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.896564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 305/621] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/role_assignments?user.id=5d62c23e1f774db1bfa311c813861c8a&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.896564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.896893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17a42d-e56b-4497-ac62-3137a33bf281 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:26.933414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:26.934136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:26.934583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:26.934940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:26.935659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] RBAC: Adding query filter params (type=network) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:26.936038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:26.937560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:26.944535 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 317/622] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:26.945698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:26.976009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:27.046685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2cfa81-b177-4601-b4cf-67e2a0ef538a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.091762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e7c8-0487-44b7-bf6d-4939f49a6a42 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.102937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.103592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.103868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.104139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.104820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:27.105121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.107616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.126933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 306/623] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:27.127525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:27.145966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.146645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.146929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.147267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.147862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:27.148166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.150020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.156234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:27.157504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 318/624] 10.222.0.64 () {56 vars in 1124 bytes} [Wed Nov 2 12:13:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:27.158365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:27.259099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ae3a1-85f9-4162-8860-70fc725ce0db None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.288323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:27.302043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.302714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.303118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.303538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.304427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.306157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.309172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c25d9b-44a6-4894-927d-0d34432aab05 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.349446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.350808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.351128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.351473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.362434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.364056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:27.378098 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:27.379417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 319/625] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:13:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:27.381300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:27.448994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 307/626] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:27 2022] POST /identity/v3/endpoints => generated 337 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:27.450053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:27.522533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9d94c-d89d-4bb7-8a97-4025869746a0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.577351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.577897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.578168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.578552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.579246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.580733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.599416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:27.628578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:27.666701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0727c7-bbef-4b36-931f-67da4f42570a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.694179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 320/627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:27.735443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.736080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.736352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.736649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.737429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:27.737732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:27.739518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c718d4a-5623-467b-81b3-12437c456702 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:27.762269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 308/628] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Nov 2 12:13:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:27.772689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:27.790473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ebcdd-5fdb-42b5-9f07-8fe86ae72c2b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.790964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ebcdd-5fdb-42b5-9f07-8fe86ae72c2b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.791180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ebcdd-5fdb-42b5-9f07-8fe86ae72c2b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.793025 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 309/629] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:27.800292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.800679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.801038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:27.839254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:27.841591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:27.942236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f406dc0-8089-4c4f-a347-63097ee31022 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:27.965047 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 310/630] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:27.986585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:27.987287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:27.987569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:27.987836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.067207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:28.073335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.075202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.188117 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 321/631] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:28.193630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:28.243219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:28.258749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:28.306520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e83b7-becd-4d3b-b1a3-c3cfb776b513 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:28.346791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:28.347431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:28.347705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:28.347982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.360888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:28.364739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.366357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.368455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9996b9a-5429-4c53-b00d-3a28f71c416d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:28.387653 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:28.388907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:28.389821 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:28.389821 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:28.389821 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:28.394230 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 311/632] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:28.395291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:28.426141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:28.426946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:28.427241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:28.427578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.428251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.429711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.531786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 322/633] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:28 2022] POST /identity/v3/services => generated 269 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:28.533891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd40c5-0f4f-4cf6-9a44-b2679bdca04d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:28.554466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:28.600705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:28.601862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:28.602404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:28.602901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.603865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:28.604429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.606932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.623374 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 312/634] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:28.629359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:28.760236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a7fc4-e289-451d-be99-c601e5701196 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:28.803700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:28.804317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:28.804601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:28.804876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.813173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.814821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:28.829062 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:28.830033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:28.830925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 323/635] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:28.837735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:28.945019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce1963-b769-4442-9faa-6032c16e2ab9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:28.981364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:28.982078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:28.982350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:28.982614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:28.983391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:28.983749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:28.985221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f9f23-9361-47cf-808f-7b51c75ef513 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:28.999588 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 313/636] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:29.005443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:29.026971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:29.121772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770e538-5da5-470c-8173-716e9fa02d3f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:29.163246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:29.163857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:29.164145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:29.164419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:29.165291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=598d3903c0a540669a27f9a09b4cdaeb) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:29.165605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:29.167247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09903a6-c1b4-4e39-ba92-bd9a0b11bd07 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:29.176003 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 324/637] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:29 2022] GET /identity/v3/role_assignments?user.id=598d3903c0a540669a27f9a09b4cdaeb&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:29.523067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9f6b-c2b1-4fdd-b065-d8e826956742 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:29.523351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9f6b-c2b1-4fdd-b065-d8e826956742 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:29.523626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d9f6b-c2b1-4fdd-b065-d8e826956742 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:29.525350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 314/638] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:29.531500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:29.531780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:29.532052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:29.551489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:29.552717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:29.632620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 325/639] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:29 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:29.901555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9f6b-c2b1-4fdd-b065-d8e826956742 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:29.932774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:30.018366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d9f6b-c2b1-4fdd-b065-d8e826956742 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:30.058802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:30.059455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.059730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.059997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.060613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:30.062021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-508c60d3-132d-400f-8bdf-55bd2c9bcd31 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:30.072522 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:30.073560 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.074401 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 315/640] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:30.080541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:30.100942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:30.167717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc666e-8774-44bc-beaf-ebb9c815aaa8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.168075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc666e-8774-44bc-beaf-ebb9c815aaa8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.168238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfc666e-8774-44bc-beaf-ebb9c815aaa8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.169976 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 316/641] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:30.175844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.176223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.176520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.193796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178e347-001d-4a68-93d3-26fe5fabdeac None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:30.196858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:30.198243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:30.238200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:30.238989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.240193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.240464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.241132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:30.241434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:30.242808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:30.249051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 326/642] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:30.256685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:30.288804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 317/643] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:30 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:30.341206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:30.369014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8bf92-4189-442e-9d76-64850940210c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:30.408177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:30.409349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.409667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.409893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.410532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:30.411054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:30.412656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:30.418109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 327/644] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:30 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:30.589055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:30.613385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:30.708198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a994a12-d74c-4274-b179-e79f1796c861 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:30.747021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:30.748017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.748556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.749030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.749829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:30.751557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:30.762136 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:30.763176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:30.764148 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:30.767197 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 318/645] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:30.773567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:30.890477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d261aac-bda4-457c-b475-0b609b780a9f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:30.933090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:30.933753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:30.934033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:30.934390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:30.935081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:30.935385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:30.936780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9083-ef86-4021-9b77-4ec5d8c47060 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:30.947402 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 328/646] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:30.949944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:31.024110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc1ef-197b-4171-a39c-e1e16b7c651d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.024301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc1ef-197b-4171-a39c-e1e16b7c651d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.024666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffc1ef-197b-4171-a39c-e1e16b7c651d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.026788 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 329/647] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:31.032226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.032530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.032814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.039809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:31.054193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:31.055588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:31.061013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:31.082255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf200fd-e954-45cc-8d57-f42c14190334 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:31.132420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:31.133065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.133341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.133714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.134827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:31.135133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:31.136914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5421a79-5b82-414c-b29a-f550af055689 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:31.140944 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 330/648] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:31.148659 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 319/649] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:31.449192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:31.546638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e296c-a4e5-4a10-ab81-5248a0540984 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.546951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e296c-a4e5-4a10-ab81-5248a0540984 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.547192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e296c-a4e5-4a10-ab81-5248a0540984 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.548848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 320/650] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:31.554656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.554947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.555213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.574534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683b0ec-009e-4623-9d2d-b718258c6c93 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:31.575882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:31.578446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:31.609071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:31.614559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:31.615271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.615554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.616385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.617030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:31.618499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:31.628797 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:31.630891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:31.632644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 331/651] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Nov 2 12:13:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:31.636778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:31.672667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 321/652] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:31 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:31.751817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760eb8af-c2fb-4e46-85c7-f60ac7f8dc60 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:31.787155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:31.788742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.789217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.789680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.790521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:31.791036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:31.792660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:31.798330 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 332/653] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:31.806738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:31.895411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:31.919245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e771136d-28de-46b5-8164-64402013a1c5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:31.958365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:31.959032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:31.959273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:31.959503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:31.960213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:31.962028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:31.963127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:31.964563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:31.971800 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 322/654] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:31.980337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.035357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.089168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cfcc8-ae1c-4690-949b-92544a9ed9e8 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.107764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f10428-49b0-4566-8e21-28c72668f1de None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.140041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.141168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.142237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.142805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.151320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.152057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.152341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.152643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.153454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] RBAC: Adding query filter params (interface=public, service_id=f833cead70804355af4af673fb60885d, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:32.153875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.155258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.157535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:32.165913 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 323/655] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:31 2022] GET /identity/v3/endpoints?service_id=f833cead70804355af4af673fb60885d&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:32.167198 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:32.168419 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:32.169338 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:32.170668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.173080 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 333/656] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:13:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:32.176553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.185373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.302887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa9654f-74f4-4b29-a3ed-26137419f7de None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.324964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab02417-088c-4eee-a4fe-aec1fc7d4e96 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.344219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.344870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.345144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.345492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.346099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.347573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.360549 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 324/657] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:32 2022] GET /identity/v3/services => generated 1029 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:13:32.370490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.380696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.381331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.381610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.381973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.382717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:32.383069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.385204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.397266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 334/658] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Nov 2 12:13:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:32.403414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.489783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.541995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f09417-817a-43df-882d-f213a6ceec0b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.584813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.585377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.585654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.585925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.599331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.600948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:32.619423 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:32.620955 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:32.622972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:32.622972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:32.622972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:32.622972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 325/659] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:32.627464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.749845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9737d6-b431-4c50-ba10-0cba90f180d5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.789902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.790522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.790804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.791075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.791770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:32.792076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.793528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd79ec-2fbb-4c25-b44d-fdf9ac79ddd7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.807747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 335/660] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:32.813028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:32.843972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dfa8-3327-41dc-9e30-f99f45e1813b None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.844162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dfa8-3327-41dc-9e30-f99f45e1813b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.844441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06dfa8-3327-41dc-9e30-f99f45e1813b None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.846308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 336/661] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:32.853250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.853554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.853839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.878996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:32.880944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:32.926792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.930090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41df07-4312-4a88-a710-08d4ab4bae7d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:32.961352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:32.966621 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 337/662] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:32 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:32.971757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:32.972449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:32.972859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:32.973229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:32.982812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:32.984653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:32.997982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:32.998966 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:32.999900 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:33.002494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 326/663] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:13:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:33.009797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.121380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3fd91-97dc-4d41-ad5b-196a66dcbc8b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:33.161334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:33.161980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.162233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.162470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.163198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:33.163498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:33.164964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:33.186545 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 338/664] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Nov 2 12:13:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:33.191937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.274346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.315741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:33.319170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173ccb5-f745-43c0-9378-e611c880ad84 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:33.362843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:33.363484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.363762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.364034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.377304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:33.379251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:33.403468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:33.404484 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:33.405438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:33.405438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:33.405438 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:33.405438 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 327/665] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:33.411669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.421367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295e18f-9375-423b-aa8c-3beb577beffb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:33.460764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:33.462878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:33.463411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.463688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.464005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.464782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:33.466264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:33.540940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a172f-deeb-4532-9204-18fa236a6564 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:33.557294 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 339/666] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:33 2022] POST /identity/v3/services => generated 241 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:33.601662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:33.602291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.602570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.602828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.603474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:33.603778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:33.605312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7768a-a684-4a01-babd-c3da4bcfa11b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:33.619009 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 328/667] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:33.625441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.741572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:33.753362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4973158-73c2-4351-a7bf-d87f3eefcbbf None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:33.792111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:33.792798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.793125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.793400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.801672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:33.803135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:33.816983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:33.817937 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:33.818858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 340/668] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:33.824269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440d0-f8ee-4b01-b599-42ed4012ffce None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.824581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440d0-f8ee-4b01-b599-42ed4012ffce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.824862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e440d0-f8ee-4b01-b599-42ed4012ffce None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.826937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 329/669] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:33.827143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:33.833745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:33.834041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:33.834302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:33.869624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:33.870869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:33.957848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 330/670] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:33 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:33.966931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d78018-96e0-44bf-9e61-ca44d82a38af None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:34.019535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:34.020636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:34.021391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:34.021948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:34.022863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:34.023370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:34.025237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:34.040578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 341/671] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:34.047898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:34.073472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:34.180677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7453b-c9bc-4a3a-be8d-00bdf61587d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:34.226878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:34.227555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:34.227837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:34.228113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/598d3903c0a540669a27f9a09b4cdaeb/roles/54b226db266e437c9802c5339c1dfde3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:34.230426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=598d3903c0a540669a27f9a09b4cdaeb, role_id=54b226db266e437c9802c5339c1dfde3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:34.232044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49dc64-dd40-4293-90f2-824d4f697510 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:34.311474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 331/672] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:34 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/598d3903c0a540669a27f9a09b4cdaeb/roles/54b226db266e437c9802c5339c1dfde3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:34.313299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:34.328879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:34.446924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb0b82-de2c-462c-acbf-eed26c8f06a1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:34.489709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:34.490712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:34.491200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:34.491671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:34.492628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:34.494325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f0e6-aeac-411c-916a-11463a689ab5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:34.568945 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 342/673] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:34 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:34.817184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d8b1-84d4-42d1-847a-f06332f91aa3 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:34.817890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d8b1-84d4-42d1-847a-f06332f91aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:34.818393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1d8b1-84d4-42d1-847a-f06332f91aa3 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:34.820271 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 332/674] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:34.826345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:34.827080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:34.827573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:34.847736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:34.849331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:34.927839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:34.939756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 343/675] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:35.221165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1d8b1-84d4-42d1-847a-f06332f91aa3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:35.321288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:35.343310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1d8b1-84d4-42d1-847a-f06332f91aa3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:35.394533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:35.395175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:35.395467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:35.395812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:35.396397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:35.398096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:35.414562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:35.415595 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:35.416632 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 333/676] 10.222.0.64 () {56 vars in 1132 bytes} [Wed Nov 2 12:13:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:35.422182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:35.537129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bc03f-2a7a-4ba1-a72a-074c67e674cf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:35.583280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:35.583899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:35.584207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:35.584482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:35.585176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:35.585565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:35.587057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:35.593020 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 344/677] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:35.601669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:35.717673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845c44-0da3-489a-bfa3-bb10c5c1ee08 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:35.756251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:35.757287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:35.757771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:35.758295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:35.759258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:35.759767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:35.761857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a0ff5e-ba60-4a11-9956-bc89a9fefda4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:35.768191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 334/678] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:35.776596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:35.839457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:35.884518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07026a98-8525-4602-92cb-eaa618b8c462 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:35.929100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:35.929787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:35.930067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:35.930342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:35.931075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:35.932636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc002c-f338-4295-9f66-f5a41edc68bf None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:35.985347 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 345/679] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:36.131192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a149-dca5-4c6c-9b4e-9b61c0f838c1 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.131900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a149-dca5-4c6c-9b4e-9b61c0f838c1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.132430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312a149-dca5-4c6c-9b4e-9b61c0f838c1 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.134541 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 335/680] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:36.140947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.141583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.142066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.164800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:36.166425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:36.261147 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 346/681] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:36.572334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312a149-dca5-4c6c-9b4e-9b61c0f838c1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:36.585104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:36.693204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312a149-dca5-4c6c-9b4e-9b61c0f838c1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:36.731751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:36.732517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.732808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.733145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.733740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:36.735268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-bdb8167a-6cca-4868-8b45-f1240f3b041b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:36.746514 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:36.747602 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:36.748471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 336/682] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:36.754634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:36.790900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a34a2-aeed-48de-9b2a-0f9de275be4b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.791552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a34a2-aeed-48de-9b2a-0f9de275be4b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.791974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a34a2-aeed-48de-9b2a-0f9de275be4b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.793930 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 337/683] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:36.799804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.800427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.801037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.810066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:36.825217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:36.827415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:36.890331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723701ff-4d01-4a0c-aeca-bd4a8be2a199 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:36.928861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 338/684] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:36.938462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:36.939160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.939532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.939815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.940529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:36.940852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:36.942791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f67e08-68c5-4dc1-be40-e32bee0453cc None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:36.949612 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 347/685] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:36.955959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:36.958783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:36.976692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b32c-208a-4bd9-9924-d469f2587afa None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.976999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b32c-208a-4bd9-9924-d469f2587afa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.977248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b32c-208a-4bd9-9924-d469f2587afa None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:36.980028 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 348/686] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:36.986775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:36.987155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:36.987524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.012926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:37.014697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:37.081699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2195-7bf8-4da0-b4b9-8d42757536a4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.112732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 349/687] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:37.130328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.132174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.132838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.133412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.134715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:37.135363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.138097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.148071 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 339/688] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:37.157122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.219373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.249656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.307685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b203-eb65-48bd-af83-88133bf54ea5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.353715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724375-4054-457b-b775-0c30442a79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.354734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724375-4054-457b-b775-0c30442a79eb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.355192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724375-4054-457b-b775-0c30442a79eb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.355641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67724375-4054-457b-b775-0c30442a79eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.355918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.357266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724375-4054-457b-b775-0c30442a79eb None admin] RBAC: Adding query filter params (interface=public, service_id=1b461bee5f904a86a1f2a7d838125e33, region_id=RegionOne) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:37.357790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724375-4054-457b-b775-0c30442a79eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.359509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67724375-4054-457b-b775-0c30442a79eb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.366040 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 350/689] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/endpoints?service_id=1b461bee5f904a86a1f2a7d838125e33&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:37.372337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724375-4054-457b-b775-0c30442a79eb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.409939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9ff0-434c-4ee9-8d04-ba00f8e085b6 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.461778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.462649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.463039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.463640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.476960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:37.482457 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:37.483407 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 340/690] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:37.488012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.519675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.522676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67724375-4054-457b-b775-0c30442a79eb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.562781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.563407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.563702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.564292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.564983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.566380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.573449 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 351/691] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/services => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:13:37.574376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.618887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e0e40-37ae-4afa-99af-96d41d02e6f3 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.657152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.669950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.681086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.681086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.681086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.681086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.681086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:37.688843 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:37.689940 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:37.690866 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:37.700540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 341/692] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:37.702881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.761465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4ec96-ccc3-4729-8c24-b66e9a0ab22a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.811561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.812179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.812579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.812979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.813672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:37.813981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.815971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.830858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 352/693] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:37.838856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.860906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b9f4e4-3e42-4cab-904a-6a122bc71f6f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.881822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:37.904284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:37.905064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:37.905351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:37.905624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:37.906404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:37.906709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:37.908825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:37.919644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 342/694] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:37.921670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:37.991732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870971e4-2fac-4aa7-9b4d-0c0b2883da20 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:37.993287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.046832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.047533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.047874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.048148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.063703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.065233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.070145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109f59e-76eb-421d-95b0-84d43092bb37 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:38.083313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:38.085250 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:38.087101 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:38.087101 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:38.087101 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:38.087101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 353/695] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:38.090758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.117810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.119165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.119612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.120070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.121008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:38.121547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.123037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.129956 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 343/696] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:38.136681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.198937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.232268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f92c0-13a3-41db-b0cd-c179027e5adb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.270720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a2acf-f5f8-4b40-82e9-fb9763f29396 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.279517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.280215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.280511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.280797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.281450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:38.281752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.283847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.295712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.304714 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 354/697] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:38.308428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.322482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.323728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.324239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.324832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.325844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] RBAC: Adding query filter params (interface=public, service_id=fcae0e05945e42e6a5f94cbe3bf80536, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:38.326550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.328648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76a5ca-d929-4941-b8da-2bc0c31b40ba None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.335978 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 344/698] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/endpoints?service_id=fcae0e05945e42e6a5f94cbe3bf80536&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:38.338299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b99cc-6899-4e6a-9ddb-b4c7fea20e67 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.338854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b99cc-6899-4e6a-9ddb-b4c7fea20e67 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.339369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b99cc-6899-4e6a-9ddb-b4c7fea20e67 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.341370 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 345/699] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:38.346684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.347589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.347589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.369493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:38.370706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:38.432202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59df37-8701-4aa6-a894-111148cfa03f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.457824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 346/700] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:38.459022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.485601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.486428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.486777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.487151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.500834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.502683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.505875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:38.526983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:38.527930 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:38.528940 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 355/701] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:38.534057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.601904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393b75a-252a-4bb1-ab15-a1b88f55d6b0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.618563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.642746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.644188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.644695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.645192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.645898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.647356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.655440 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 347/702] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:13:38.665311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71b504-393b-4041-bc95-c50bad3093cd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.710440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.711333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.711795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.712219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.713284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:38.713819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.715552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.744028 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 356/703] 10.222.0.64 () {56 vars in 1149 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:38.746271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.777102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.856074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:38.888457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bd5fb-ba41-48e1-b93a-e5b9a2a71c20 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.918497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1d18-76fd-4290-b992-3a2eec392da2 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:38.932318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.933970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.934428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.934878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.959190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:38.960119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:38.960575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:38.960965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:38.961759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:38.963262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:38.974199 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:38.975290 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:38.976469 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 357/704] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:38.982776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:38.993342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:39.021296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.024267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.112768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00689828-7a16-4eb9-893b-7e4c7c12e9b4 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.138274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:39.154544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.155318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.155639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.156296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.157026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:39.157393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.159168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.169174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 358/705] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:39.170215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.176380 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 348/706] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:13:39.179360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.275396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:39.304798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b45f7-06e5-408f-97d4-9a49877fc166 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.330732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd616-41f8-4ab5-a02d-3a4a0f3ce512 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.350146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.351091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.351758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.352217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.366234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.368166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.384010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.385076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.385567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.386144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.387222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] RBAC: Adding query filter params (type=compute) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:39.387748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:39.388451 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:39.389695 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:39.390588 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:39.390588 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:39.390588 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:39.390760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.397324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 349/707] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:39.401431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.405062 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 359/708] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:39.531707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efeb4b-33fa-423a-a8b3-017ee679f7e3 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.564596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:39.574041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.575508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.575794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.576069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.576765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:39.577071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.583911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.596625 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 350/709] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:39.598521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.656109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:39.711893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1faec-8192-4ff2-ae48-46355ef0e5ed None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.750028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.750729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.751026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.751297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.759673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.761186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:39.774617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:39.778500 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:39.781800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 360/710] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:39.783700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.899911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4604b04-9454-4ac6-8b73-d02bf9cf9a5b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:39.940893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:39.941514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.941832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.942168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.942862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:39.943162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:39.944616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65409e86-533e-43d9-ae52-6c6ba4b56d21 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:39.962111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 351/711] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:39.965160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:39.969984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87b20-070e-4eb4-8efb-1752c0ee914b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.970289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87b20-070e-4eb4-8efb-1752c0ee914b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.970589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e87b20-070e-4eb4-8efb-1752c0ee914b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.972106 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 352/712] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:39.977681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185824-fe31-4f58-8502-315911a8543e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:39.977994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185824-fe31-4f58-8502-315911a8543e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:39.978235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51185824-fe31-4f58-8502-315911a8543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:39.998430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-51185824-fe31-4f58-8502-315911a8543e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:39.999645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51185824-fe31-4f58-8502-315911a8543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:40.051743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:40.093082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 353/713] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:40.138951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c46e1-d600-48d5-b88f-a64f4cb405b0 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:40.154024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:40.192474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:40.193923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:40.194609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:40.195338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:40.196845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] RBAC: Adding query filter params (role.id=54b226db266e437c9802c5339c1dfde3, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=598d3903c0a540669a27f9a09b4cdaeb) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:40.197594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:40.200181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:40.211119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 361/714] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:39 2022] GET /identity/v3/role_assignments?user.id=598d3903c0a540669a27f9a09b4cdaeb&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=54b226db266e437c9802c5339c1dfde3 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:40.489182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185824-fe31-4f58-8502-315911a8543e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:40.667619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51185824-fe31-4f58-8502-315911a8543e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:40.723723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:40.724702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:40.725113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:40.725516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:40.726407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:40.728741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:40.744399 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:40.745454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:40.746288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:40.747254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 354/715] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:40.755323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:40.911445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b34706-530a-4b87-a2a9-02c95135f8dd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:40.963304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:40.964207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:40.964742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:40.965169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:40.966142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:40.966617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:40.969415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f02fc3-d4fd-43a1-8a94-380fd2bb1e24 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:40.977836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 362/716] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:40.986846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:41.059434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:41.155281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86344a7e-e4ee-45e1-bf25-fa9142749785 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:41.211288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:41.212174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.212638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.213058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.214005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:41.214462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:41.216656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:41.225738 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 355/717] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:41.230456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a805-1277-4f2a-bc4b-8d4f11e78457 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.230742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a805-1277-4f2a-bc4b-8d4f11e78457 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.231017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8a805-1277-4f2a-bc4b-8d4f11e78457 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.232643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 363/718] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:41.233751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:41.238416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.238700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.239054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.258745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:41.260302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:41.307491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:41.367065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657acc27-e3da-4f35-b119-6b63a73d67ae None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:41.368718 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 364/719] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:41.383814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:41.419123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:41.420082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.420607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.421085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.422892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:41.424963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf769f-883b-40df-ae25-b9529ddf4985 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:41.494021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 356/720] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:41.654682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:41.777632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e4477-8905-479c-b43b-a224ba7500a0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:41.801061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f996-2807-44a3-a2fc-dfc8a38b8b38 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.801676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f996-2807-44a3-a2fc-dfc8a38b8b38 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.802147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f996-2807-44a3-a2fc-dfc8a38b8b38 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.803929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 357/721] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:41.809388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.809964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.810444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.823293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:41.823932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:41.824207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:41.824565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:41.825762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:41.827508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:41.831643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:41.833074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:41.842805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:41.843898 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:41.845493 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 365/722] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:41.850579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:41.889657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:41.933675 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 358/723] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:41.981002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8289-fe79-49d5-bbd5-76b921a3545a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:42.022226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:42.023200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.023651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.024067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.024879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:42.025416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:42.027038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:42.032897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 366/724] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:42.039231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:42.160419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:42.169400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5583c16-de18-459d-ba4a-622958a13ad5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:42.204073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:42.204619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.205509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.205782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.206536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:42.206832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:42.208240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:42.213719 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 359/725] 10.222.0.64 () {56 vars in 1114 bytes} [Wed Nov 2 12:13:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:42.219775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:42.224008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:42.325572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:42.340000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca6973-25bd-4b04-97b1-14b86e58f0cd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:42.359816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9611d-7fae-46ec-a624-7cda1013bc88 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:42.390932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:42.392360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.393345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.393937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.394638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:42.397317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94818f16-f0a0-41df-aec2-101e4c671a2c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:42.405149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:42.405878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.406220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.406548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.407388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:42.409640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e774d4-80c2-4f54-8f27-75e869f71890 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:42.479891 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 367/726] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:42.513340 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 360/727] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:42 2022] POST /identity/v3/services => generated 242 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:42.532752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5507fa-64a0-4471-aeac-c1bb437b23e2 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.533358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5507fa-64a0-4471-aeac-c1bb437b23e2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.534348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5507fa-64a0-4471-aeac-c1bb437b23e2 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.536404 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 368/728] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:42.543209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:42.543949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:42.544409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:42.566916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:42.568745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:42.583724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:42.667038 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 361/729] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:42.945501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5507fa-64a0-4471-aeac-c1bb437b23e2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:43.067858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5507fa-64a0-4471-aeac-c1bb437b23e2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:43.108723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:43.109363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:43.109638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:43.109906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:43.110493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:43.111862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:43.122168 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:43.124246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:43.125721 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 369/730] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Nov 2 12:13:42 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:43.135771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:43.247367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eae5a-7225-466b-9b76-0e08f377dae3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:43.284224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:43.285517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:43.285790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:43.286053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:43.287585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:43.287879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:43.289263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82371931-18bf-4981-94b8-0e6a34d189d0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:43.295117 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 362/731] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:43.301903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:43.322867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:43.426552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ff6a-cfd8-4983-8d75-984f411614b7 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:43.466656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:43.467270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:43.467546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:43.467928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:43.468592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] RBAC: Adding query filter params (type=image) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:43.468897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:43.470353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2bd74-7c36-413a-aea4-68930d70634e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:43.476716 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 370/732] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:44.251832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9271-93d3-4ebe-ac7d-b869f7a58e86 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.252935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9271-93d3-4ebe-ac7d-b869f7a58e86 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.253421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f9271-93d3-4ebe-ac7d-b869f7a58e86 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:44.255299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 363/733] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:44.261763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.262664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.263173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:44.283361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:44.284964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:44.364722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 371/734] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:44.648791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f9271-93d3-4ebe-ac7d-b869f7a58e86 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:44.658344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:44.765567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f9271-93d3-4ebe-ac7d-b869f7a58e86 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:44.806878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:44.807547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.807826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.808128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:44.808764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:44.810605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-34edea60-4c1e-4b56-b1e5-84251763cedc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:44.821149 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:44.822215 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:44.823083 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 364/735] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:44.831515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:44.837274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:44.945652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4216d-52b5-4d8b-b809-de6a9c200052 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.946295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4216d-52b5-4d8b-b809-de6a9c200052 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.946767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4216d-52b5-4d8b-b809-de6a9c200052 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:44.948601 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 365/736] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:44.953501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047bb1-0535-457d-8223-c55c0ff5b6f4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.954069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047bb1-0535-457d-8223-c55c0ff5b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.954545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047bb1-0535-457d-8223-c55c0ff5b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:44.957115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14c0a-4060-484b-bca7-113d6dd80b61 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:44.974391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f5047bb1-0535-457d-8223-c55c0ff5b6f4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:44.976619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5047bb1-0535-457d-8223-c55c0ff5b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:44.998649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:44.999262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:44.999544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:44.999949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.000781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:45.001094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.002597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.010045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 372/737] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:45.015622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.056472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.063694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 366/738] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:45.065508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bcdc-bbce-4ffe-89e2-a26e5fd12b15 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.066102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bcdc-bbce-4ffe-89e2-a26e5fd12b15 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.066524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95bcdc-bbce-4ffe-89e2-a26e5fd12b15 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.068267 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 367/739] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:45.074684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.075377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.075827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.103035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:45.104548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:45.121745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.160778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc673b-7e25-4fc4-8d55-557c09764f89 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.198609 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 368/740] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:45.205144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.206218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.206731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.207268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.208227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:45.208847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.210494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.217341 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 373/741] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:45.223110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.343041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52388ade-56b8-4b69-af28-612addaaec83 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.355836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.383411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.389751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.390387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.390746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.391085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.391769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] RBAC: Adding query filter params (interface=admin, service_id=1b461bee5f904a86a1f2a7d838125e33, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:45.392075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.393608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.400547 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 369/742] 10.222.0.64 () {56 vars in 1249 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/endpoints?service_id=1b461bee5f904a86a1f2a7d838125e33&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:45.406404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.490732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bcf2b-5ff7-42c4-a5fc-602fde437ae2 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.526459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.529857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8d085-25ea-4d37-93eb-81e5e67345dd None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.531958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.532481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.532788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.533138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] PATH_INFO: `/v3/services/compute` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.534509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.535121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:45.544922 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:45.546052 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.546912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 374/743] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:45.548474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.576923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.577696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.577943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.578178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.578775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.580134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.592541 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 370/744] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/services => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:13:45.592541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.670821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98348578-134d-47e0-a9c5-4ea6481ea24f None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.687568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.712873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.713726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.714111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.714491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.715292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.717132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.720559 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.common [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 12:13:45.746531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d47c6-8e41-4e2e-ae42-0b8d566f7d02 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.769508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.sql.core [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:45.769508 n-d-857339-6 devstack@keystone.service[82132]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:13:45.769508 n-d-857339-6 devstack@keystone.service[82132]: [parameters: {'id': '0f41ad9df93447f29ee150d29a7fa7a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 12:13:45.769508 n-d-857339-6 devstack@keystone.service[82132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f41ad9df93447f29ee150d29a7fa7a4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f41ad9df93447f29ee150d29a7fa7a4. Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:45.781313 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 12:13:45.782237 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application yield resource Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise self.value Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application session.commit() Nov 02 12:13:45.783214 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:13:45.784123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:13:45.786425 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:45.788769 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [parameters: {'id': '0f41ad9df93447f29ee150d29a7fa7a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.791654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:45.793936 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f41ad9df93447f29ee150d29a7fa7a4. Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:45.796776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 375/745] 10.222.0.64 () {60 vars in 1140 bytes} [Wed Nov 2 12:13:45 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:45.799150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.808799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:45.809743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:45.810081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:45.810489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:45.811193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] RBAC: Adding query filter params (name=compute) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:45.811561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:45.813245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:45.819253 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 371/746] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:45.825014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:45.893105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:45.963555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6ad50-7c63-405b-8a1f-cea76dd4d26e None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:45.981156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e507c-2e96-48c6-9c29-e1cf5096052c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:46.006334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:46.007211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.007856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.009444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.009717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.017191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.018884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.020250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.021096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.021577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.021838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.022466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] RBAC: Adding query filter params (type=compute) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:46.022764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.024849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-db20ced3-d123-4583-94d1-68c0725de91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:46.032847 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:46.033925 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:46.035979 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:46.036653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 372/747] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:46.036758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 376/748] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:46.036758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef760-dc03-4fd2-a20c-d86efa12f337 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.036758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef760-dc03-4fd2-a20c-d86efa12f337 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.036758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef760-dc03-4fd2-a20c-d86efa12f337 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.041473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:46.041874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 377/749] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:46.042622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef760-dc03-4fd2-a20c-d86efa12f337 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:46.154924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d7c96-15fb-4944-8c28-27461d27021e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:46.181728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef760-dc03-4fd2-a20c-d86efa12f337 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:46.195337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.196020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.196299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.196599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.197396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] RBAC: Adding query filter params (interface=public, service_id=b75f778bffd146e7a905a140b294373d, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:46.197704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.198456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:46.199231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa89e5bb-5076-43b4-96b9-1fc952b6dafa None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.210137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 373/750] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:46 2022] GET /identity/v3/endpoints?service_id=b75f778bffd146e7a905a140b294373d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:46.210137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.210137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.210137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.228483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.229046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.229381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.229648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.230335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:46.230673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.231085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:46.232229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.232407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:46.253132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 378/751] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:46.253987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:46.306230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:46.348519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 374/752] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:46.392611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985681d-10bd-4514-86bb-2a8b1f0cf0a7 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:46.442758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.443420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.443699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.443968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.444680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.446069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557edf81-030d-4225-a2ef-cfa2a9a92ff8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.453554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 379/753] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:46 2022] GET /identity/v3/services => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:13:46.655646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:46.764719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab567c39-34fb-421d-b557-c941122b6ad7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:46.801074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:46.801606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:46.801886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:46.802160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:46.802825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:46.804189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bfa08-4be8-453c-93f2-abe1f12714fb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:46.917241 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 375/754] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:46 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:47.985840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d617-48b3-46cf-b239-a0992100b96e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:47.986367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d617-48b3-46cf-b239-a0992100b96e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:47.986367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57d617-48b3-46cf-b239-a0992100b96e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:47.987998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 380/755] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:47.993583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:47.994034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:47.994121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.014143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:48.015340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:48.052298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:48.094506 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 376/756] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:48.374700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d617-48b3-46cf-b239-a0992100b96e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:48.415232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:48.496032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57d617-48b3-46cf-b239-a0992100b96e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:48.537430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:48.538091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.538372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.538645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.539234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:48.540843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-cd41d656-c405-4bab-9600-360a0fe30199 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:48.552086 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:48.553285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:48.554236 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 381/757] 10.222.0.64 () {56 vars in 1126 bytes} [Wed Nov 2 12:13:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:48.560234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:48.672752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bd611-7430-4b82-955a-c6645e5b463c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:48.702194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2eb1-2932-43dd-bcc4-d01c7b97d287 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.702573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2eb1-2932-43dd-bcc4-d01c7b97d287 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.702740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b2eb1-2932-43dd-bcc4-d01c7b97d287 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.704917 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 382/758] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:48.710505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6940a6-2ab3-4622-b16b-7ada768cff88 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.710768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6940a6-2ab3-4622-b16b-7ada768cff88 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.711051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6940a6-2ab3-4622-b16b-7ada768cff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.720878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:48.721502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.721774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.722060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.722688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:48.722989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:48.724516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:48.730451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 377/759] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:48.730910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2f6940a6-2ab3-4622-b16b-7ada768cff88 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:48.736547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2f6940a6-2ab3-4622-b16b-7ada768cff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:48.736724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:48.778298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:48.824672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 383/760] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:48.865850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911d85c0-ee7c-43a8-a0b4-d7a12a4e2e3a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:48.898577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2713-0a88-4906-ae28-380fc1bc648c None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.898923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2713-0a88-4906-ae28-380fc1bc648c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.899199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d2713-0a88-4906-ae28-380fc1bc648c None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.900623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 384/761] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:13:48.916158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:48.916918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.917200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.917684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.918092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:48.918251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:48.918790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:48.920575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:48.920849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:48.921512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:48.928620 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 378/762] 10.222.0.64 () {56 vars in 1122 bytes} [Wed Nov 2 12:13:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:48.933623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:48.957772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:48.960423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:49.019078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:49.128520 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 385/763] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:48 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:49.128520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.138928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:49.155859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417fc37-efc0-49c0-a2d8-b106699200e2 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.239728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.239728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.239728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.239728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.240140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.240418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c588b-d3e3-4c1e-8766-500b69e634e0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.292521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463fc9-d4e1-49d8-a2a9-e294434bca6a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.332562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 379/764] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:49.332562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ec99-fefc-4159-b85b-0153c682b314 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.332562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ec99-fefc-4159-b85b-0153c682b314 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.332562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755ec99-fefc-4159-b85b-0153c682b314 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.332963 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 380/765] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:49.340328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.340656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.340909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.355349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.356416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.358654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.359019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.359704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.361234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.397897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:49.399580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:49.403019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.sql.core [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 12:13:49.403019 n-d-857339-6 devstack@keystone.service[82132]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 12:13:49.403019 n-d-857339-6 devstack@keystone.service[82132]: [parameters: {'user_id': 'b79f7d049f6f408d965a132d1c1b34fd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 12:13:49.403019 n-d-857339-6 devstack@keystone.service[82132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:49.415489 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:49.416449 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application yield resource Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise self.value Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application session.commit() Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:13:49.417448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:13:49.418335 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = connection._execute_20( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:49.419218 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:49.421902 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b79f7d049f6f408d965a132d1c1b34fd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:49.423897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Nov 02 12:13:49.426426 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 386/766] 10.222.0.64 () {60 vars in 1131 bytes} [Wed Nov 2 12:13:49 2022] POST /identity/v3/users => generated 160 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:49.428926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.454117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:49.508980 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 381/767] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:49.510227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.578854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453611a4-f84b-4d3f-86a7-3d245d773faa None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.625078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.625731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.626075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.626347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.629126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:49.636129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.638586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.646300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f81be-d9d8-4c6e-a12d-4f16ab07d2de None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:49.654788 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:49.655856 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:49.656934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 387/768] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:49.663205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.690533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.691175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.691452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.691756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.692341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.693943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:49.704441 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:49.705518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:49.706723 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 382/769] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:49.713618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.771760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:49.798071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be6750-5798-44a1-bd22-2b48bd03f788 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.833368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5188717-aabe-4d55-8f59-273aef9a6453 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:49.840007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.840576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.840907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.841191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.841898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:49.842734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.844167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.870797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:49.871413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:49.871705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:49.875582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:49.875582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:49.875582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:49.875582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:49.881098 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 383/770] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:49.882333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.900521 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 388/771] 10.222.0.64 () {56 vars in 1101 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:49.900521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:49.909786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:50.026475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a4bf8-e133-42c0-826a-5cc5aa8defd5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.041432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223075f-0f3d-4785-a78d-2783e2fc5d96 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.076528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.077764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.078122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.078305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.078897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.080344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:50.091758 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:50.093783 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:50.095089 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 384/772] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:50.098609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.099551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.099681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:50.100256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.100787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.101682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:50.102192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.105385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.109016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:50.113911 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 389/773] 10.222.0.64 () {56 vars in 1112 bytes} [Wed Nov 2 12:13:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:50.119529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:50.216207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:50.249982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d450d-4133-4189-8138-fcfc879404b0 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.275612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb4c98-14c2-4173-9e09-342a6c1d9b61 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.299102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.299608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.299898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.300173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.301133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] RBAC: Adding query filter params (name=image) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:50.301432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.303338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.308538 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 385/774] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:50.316361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:50.346482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.347266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.347725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.348179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.349319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.351668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.448264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60615a51-eaa0-4ddf-a8b7-9a0a5a1e9276 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.450649 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 390/775] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:50.500312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.500948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.501285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.501559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.502351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] RBAC: Adding query filter params (type=image) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:50.502599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.504007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.507137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:50.511814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 386/776] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:50.519201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:50.595867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:50.650726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4a86f-c642-475f-9f74-25db05058eb3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.696570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.697441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.697988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.698511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.699463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] RBAC: Adding query filter params (interface=public, service_id=7409ca8988cb497cb37f43cb4875ac4f, region_id=RegionOne) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:50.700061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.701975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562e077-c95c-42cc-88a8-2cc5a5e2e763 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.710746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 391/777] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:13:50 2022] GET /identity/v3/endpoints?service_id=7409ca8988cb497cb37f43cb4875ac4f&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:50.716832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:50.827572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc57962-76b8-4655-aa5f-b6a2d06fd0cf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:50.865755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:50.866478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:50.866890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:50.867317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:50.868051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:50.869651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccc360-e797-40e2-b68c-f05ce5619303 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:50.884595 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 387/778] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:13:50 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:13:51.687462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d034-ddbd-4cc4-9645-33c18e905784 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:51.688047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d034-ddbd-4cc4-9645-33c18e905784 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:51.688047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431d034-ddbd-4cc4-9645-33c18e905784 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:51.689446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 392/779] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:51.694949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:51.695465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:51.695465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:51.715892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:51.717114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:51.783479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:51.794322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 388/780] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:52.068971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d034-ddbd-4cc4-9645-33c18e905784 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:52.190517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431d034-ddbd-4cc4-9645-33c18e905784 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:52.216213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:52.231891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:52.232552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:52.232835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:52.233106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:52.234251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:52.236235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8a870-3033-41ac-ad6c-761a5dde3aae None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:52.238401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 393/781] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:52.244320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:52.350281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de0b1f-975e-4533-97dd-4465c8f9f8ab None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:52.385854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:52.386467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:52.386746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:52.387018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:52.387672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:52.389132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b376013-f8f0-4acd-a372-b0a9f144aa01 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:52.471699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 389/782] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:13:52 2022] POST /identity/v3/projects => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:52.780147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f843f0-dee8-4a2f-a614-10b8069ca119 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:52.780707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f843f0-dee8-4a2f-a614-10b8069ca119 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:52.780707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f843f0-dee8-4a2f-a614-10b8069ca119 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:52.782037 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 394/783] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:52.787723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501787-f024-4677-bdd7-046337f4f081 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:52.788165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501787-f024-4677-bdd7-046337f4f081 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:52.788387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9501787-f024-4677-bdd7-046337f4f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:52.808121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b9501787-f024-4677-bdd7-046337f4f081 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:52.809331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b9501787-f024-4677-bdd7-046337f4f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:52.856072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:52.882924 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 390/784] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:53.095403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5996c6-1ed6-41b2-9535-3e2d8953de5d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.095742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5996c6-1ed6-41b2-9535-3e2d8953de5d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.095918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5996c6-1ed6-41b2-9535-3e2d8953de5d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.097965 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 395/785] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:53.103273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.103617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.103834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.122151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:53.123347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:53.151928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5996c6-1ed6-41b2-9535-3e2d8953de5d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.197791 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 391/786] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:53.258773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5996c6-1ed6-41b2-9535-3e2d8953de5d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.293466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.294087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.294360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.294625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.305780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:53.310529 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:53.311467 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:53.312321 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:53.316735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 396/787] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:53.317725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.419584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11625f5-feb4-41da-9c6d-f0cac2609ffe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.431110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:53.460022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.460661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.460928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.461188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.461840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:53.462132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:53.463472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:53.467150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.472311 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 392/788] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:53.477957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.528750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:53.591656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5bd4-4c01-4956-8dac-56b68aedffcc None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.630048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.630674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.630946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.631212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] PATH_INFO: `/v3/services/image` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.631785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:53.633175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:53.641995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:53.643003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:53.643862 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 397/789] 10.222.0.64 () {56 vars in 1105 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:53.649314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.710199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2b366-f8ea-4a1c-8234-6c82b07d0de9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.748595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.749259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.749540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.749810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.761971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:53.763435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:53.781813 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:53.782982 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:53.789677 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:53.789677 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:53.789677 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:53.789677 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 393/790] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:53.789677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.812406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:53.886247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5556-dc99-474c-b0fa-d3b642ec1bc5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.899070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681e29-bcd6-4fdd-8cec-a360301f2e39 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:53.902450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:53.923214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.925336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.925336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.925336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.925336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] RBAC: Adding query filter params (name=image) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:53.925336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:53.926666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:53.931755 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 398/791] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:53.937598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:53.939340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:53.939951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:53.940410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:53.940712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:53.942726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:53.943023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:53.944548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:53.958204 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 394/792] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:53.964082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.046338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b837ab3-2656-48b6-af28-843764133868 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.049804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.070700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a8f55-1ee9-4963-80b1-d5aace370561 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.082987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.083599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.083876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.084144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.084794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] RBAC: Adding query filter params (type=image) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:54.085108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.086473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.091455 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 399/793] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:54.096925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.108846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.109821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.110247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.110518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.118511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.119930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:54.134357 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:54.135534 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:54.136793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 395/794] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:13:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:54.141214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.145352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.208936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819c427-c8be-45eb-8481-3197bd1df920 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.243466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.243994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.244270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.244576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.245240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.246601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.249381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b962857-b3d9-4853-a8e6-7670d59f7670 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.286538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.287138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.287459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.287729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.288457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:54.288771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.290171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.299542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.308539 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 396/795] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:13:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:54.314259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.330250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 400/796] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:13:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:13:54.437338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7899ef-0600-46f7-b8f6-53527a20cdaf None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.482573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.483216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.483484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.483796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.495954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.497355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:54.515090 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:54.516081 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:54.517030 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:54.517030 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:54.517030 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:54.520431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 397/797] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:54.521844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.625253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.634117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f0cb1-e136-4011-99e4-b6870855e6a3 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.672447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.673085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.673363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.673639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.674284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:54.674585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.676022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a8969-f145-46ea-a4e6-2af6c6271cf5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.689239 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 401/798] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:54.694199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.742485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768915be-9d22-4438-b42f-c49f8f0fc733 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.742772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768915be-9d22-4438-b42f-c49f8f0fc733 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.743050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768915be-9d22-4438-b42f-c49f8f0fc733 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.744599 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 402/799] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:54.746138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.749591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.749867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.750142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.769093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:54.770655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:54.803403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5d6ad-2124-4c94-90ce-df563163599a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:54.841310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:54.841942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:54.842219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:54.842497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:54.849374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:54.852613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 403/800] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:54.852773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:54.865013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:54.865975 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:54.866898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 398/801] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:54.873441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:54.963164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:54.977374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe75241-bb4e-4a9b-8175-9606d3974b4d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:55.012301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:55.012883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:55.013156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:55.013513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:55.014098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:55.014395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:55.015812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:55.028026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 404/802] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:55.033695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:55.130311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:55.141375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0f9c0-1ebb-4fb4-9156-aa0c5c41390f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:55.149419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:55.178580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:55.179227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:55.179509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:55.179778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/54b226db266e437c9802c5339c1dfde3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:55.182872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=c48d278dd82d4be0b5a79b225c962d1a, role_id=54b226db266e437c9802c5339c1dfde3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:55.184296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:55.240150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a338d-26c5-4c0d-a8ce-b801b11612bd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:55.261361 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 399/803] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:55 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/c48d278dd82d4be0b5a79b225c962d1a/roles/54b226db266e437c9802c5339c1dfde3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:55.287527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:55.288090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:55.288512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:55.288681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:55.289943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:55.291342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5b8a2-7e68-4087-bf39-5e8c45f91670 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:55.293378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 405/804] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:55.299280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:55.411872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854df8ea-f5a9-45d4-a283-b90ce95a5ad9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:55.455828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:55.456442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:55.456767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:55.457714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:55.457714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:55.459096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fae938-4c0a-4a37-8346-780b80132dd5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:55.548262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 400/805] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:13:55 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:13:56.575407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32885d7-9ac1-4be8-8ec4-7fb6df7298f1 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:56.575921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32885d7-9ac1-4be8-8ec4-7fb6df7298f1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:56.575921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32885d7-9ac1-4be8-8ec4-7fb6df7298f1 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:56.577431 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 406/806] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:56.582602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:56.582985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:56.583157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:56.602205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:56.603370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:56.619822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:56.672801 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 401/807] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:56.935530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32885d7-9ac1-4be8-8ec4-7fb6df7298f1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:56.951944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:57.038766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32885d7-9ac1-4be8-8ec4-7fb6df7298f1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:57.073175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:57.073777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.074049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.074313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.074979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:57.076339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:57.108671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.sql.core [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:57.108671 n-d-857339-6 devstack@keystone.service[82132]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:13:57.108671 n-d-857339-6 devstack@keystone.service[82132]: [parameters: {'id': '1083c9af3b03452f945812663e0dd555', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:13:57.108671 n-d-857339-6 devstack@keystone.service[82132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:57.115983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 12:13:57.117024 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application yield resource Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise self.value Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application session.commit() Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:13:57.118838 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:13:57.119854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:13:57.120953 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:13:57.121727 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [parameters: {'id': '1083c9af3b03452f945812663e0dd555', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 12:13:57.124034 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:57.125890 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:57.131137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 407/808] 10.222.0.64 () {60 vars in 1137 bytes} [Wed Nov 2 12:13:56 2022] POST /identity/v3/domains => generated 190 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:57.133173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:57.232932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac0d9aa-1271-40a7-ab1c-5c7a2d6887eb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:57.273118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:57.273741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.274011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.274273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.284388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:57.285930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-00467df8-5989-4d91-a17c-cfcf0c9d821d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:57.300297 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:57.301372 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:57.302271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:57.302271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:57.302271 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:57.302271 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 402/809] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:57.309413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:57.396308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:57.423551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dfe30-4b41-4700-b5f4-7666b4142742 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:57.446137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14dfd9-80b0-42df-98e1-09b5344e592e None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.446493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14dfd9-80b0-42df-98e1-09b5344e592e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.446713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14dfd9-80b0-42df-98e1-09b5344e592e None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.448006 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 403/810] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:57.453134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5fc2-348c-4e0e-8c35-e46060cdf369 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.453418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5fc2-348c-4e0e-8c35-e46060cdf369 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.453695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5fc2-348c-4e0e-8c35-e46060cdf369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.459633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:57.460859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.461057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.461308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.461942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:57.462118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:57.462275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:57.463586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668be17-da07-4f0b-9571-20b273d337ca None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:57.474252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-888a5fc2-348c-4e0e-8c35-e46060cdf369 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:57.475442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-888a5fc2-348c-4e0e-8c35-e46060cdf369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:57.484740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 408/811] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:57.564657 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 404/812] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:13:57.793429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b062ab-7d4a-4660-8299-247389d1ffbb None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.793952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b062ab-7d4a-4660-8299-247389d1ffbb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.793952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b062ab-7d4a-4660-8299-247389d1ffbb None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.795294 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 409/813] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:13:57.800951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.801399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.801509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.820652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:13:57.821836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:13:57.833984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b062ab-7d4a-4660-8299-247389d1ffbb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:57.892103 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 405/814] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:13:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:13:57.941015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b062ab-7d4a-4660-8299-247389d1ffbb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:57.975679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:57.976307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:57.976640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:57.976914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:57.983691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:57.987230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:57.992561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:57.999682 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:58.000844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 410/815] 10.222.0.64 () {56 vars in 1120 bytes} [Wed Nov 2 12:13:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:58.002775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.065835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.102865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c21d1-0886-48c3-b8db-1e17be2361c5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.135992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.136624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.136895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.137159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.137807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:58.138100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.139444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.147322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 406/816] 10.222.0.64 () {56 vars in 1115 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:58.153680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.162877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.255662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac4208-b02c-4194-9f23-a92508896ffb None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.260926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520f5d9-5fd7-451a-b168-775ef801acc0 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.286015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.292512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.293136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.293406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.293668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.295362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.295974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.296244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.296527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.303921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.305564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.310598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:13:58.316084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:58.317452 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:58.318518 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 407/817] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:13:58.323364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:58.326244 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:58.327317 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:58.328197 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:58.328197 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:58.328197 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:58.328197 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 411/818] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:58.333056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.382834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.430892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825d9b-0fc2-4483-991f-919153db9006 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.436458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4475ea-502e-428d-97e7-a1bc84469bf9 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.466212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.466813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.467084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.467347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.467988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:58.468281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.469647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.472098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.472737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.473037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.473310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.473944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:58.474253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.475603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.478968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 408/819] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:58.484731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.488903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 412/820] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:58.494945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.541178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.589002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cee306-0c60-44b1-b57c-add67a75674e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.596959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09c7f-90bc-4313-9b4c-6b8706ac55f8 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.608252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.623773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.624418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.624724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.624997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] PATH_INFO: `/v3/users/d61b46b252f145e9899941b6601578e0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.632390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.633048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.633323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.633589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.638727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] RBAC: Authorizing `identity:get_user(user_id=d61b46b252f145e9899941b6601578e0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.640195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.640663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.641861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 409/821] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/users/d61b46b252f145e9899941b6601578e0 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:58.642168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.647572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:13:58.654668 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:58.655744 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:13:58.661270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 413/822] 10.222.0.64 () {56 vars in 1093 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:58.661860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.754383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1f531-8e86-470e-a3fa-e257af7fe856 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.762609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.763577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d7a44-55c4-46af-b08c-fc2a6300f4f5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.789160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.790337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.790620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.790887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.792110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] RBAC: Authorizing `identity:get_project(project_id=242f135f361d4be282c1f054cae929ee)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.793551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.795220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 410/823] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/projects/242f135f361d4be282c1f054cae929ee => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:13:58.798070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.798678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.798957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.799228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.800038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:58.800414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.801082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.801877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.819302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 414/824] 10.222.0.64 () {56 vars in 1133 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:58.824907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:58.853393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:58.906070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bca251-776b-4091-a5ee-ae0091e04e60 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.926329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de32a5c-95b4-4115-998e-fb774b925024 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:58.941089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.941747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.942022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.942293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee/users/d61b46b252f145e9899941b6601578e0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:58.944250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] RBAC: Authorizing `identity:create_grant(project_id=242f135f361d4be282c1f054cae929ee, user_id=d61b46b252f145e9899941b6601578e0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:58.945701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:58.961991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:58.966323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:58.966323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:58.966323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.014648 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 411/825] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:13:58 2022] PUT /identity/v3/projects/242f135f361d4be282c1f054cae929ee/users/d61b46b252f145e9899941b6601578e0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:13:59.039648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.041275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.072947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:59.150810 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 415/826] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:13:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 12:13:59.156907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:59.192166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:59.256810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656ca1a-5659-4ee9-83d3-c5607a521a8b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:59.291814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:59.292443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:59.292741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:59.293004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.302746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.304167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:13:59.318454 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:59.319443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:13:59.320334 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:13:59.320334 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:13:59.320334 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:59.320334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 412/827] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:59.325776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:59.428792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f087f31-4cc7-49e5-972a-3df28dd9e0c1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:59.455656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:59.463439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:59.464039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:59.464312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:59.464604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.465232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:59.465525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.466877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.479411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 416/828] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:59.485165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:59.575198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:13:59.589801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed41e-901d-4352-9618-1f57f96bd32e None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:59.622335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:59.622948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:59.623217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:59.623481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.629878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.631292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:13:59.642115 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:13:59.643201 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:13:59.644348 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:13:59.648019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 413/829] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:13:59.648992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:59.746663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abeb08-734f-4e98-a000-346909a07004 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:59.780329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:59.780949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:59.781220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:59.781481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.782147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:59.782535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.783946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dc117-2502-4c7b-b0ec-12a3821b9968 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.795145 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 417/830] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:13:59.801149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:13:59.900168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbf843-4a88-4389-b269-c356a2ffa680 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:13:59.937448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:13:59.938032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:13:59.938301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:13:59.938563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:13:59.939257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] RBAC: Adding query filter params (role.id=54b226db266e437c9802c5339c1dfde3, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=c48d278dd82d4be0b5a79b225c962d1a) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:13:59.939552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:13:59.940993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f87cc-d62b-499f-a121-f3395d5305d2 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:13:59.946647 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 414/831] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:13:59 2022] GET /identity/v3/role_assignments?user.id=c48d278dd82d4be0b5a79b225c962d1a&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=54b226db266e437c9802c5339c1dfde3 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:01.192618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269073-e311-4edf-9134-1c1caa49ed1c None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:01.193199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269073-e311-4edf-9134-1c1caa49ed1c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:01.193199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c269073-e311-4edf-9134-1c1caa49ed1c None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:01.194490 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 418/832] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:01.200539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:01.200981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:01.201149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:01.218797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:01.219977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:01.222708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:01.284331 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 415/833] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:14:01.551450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c269073-e311-4edf-9134-1c1caa49ed1c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:01.601076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:01.652881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c269073-e311-4edf-9134-1c1caa49ed1c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:01.686103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:01.686716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:01.686991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:01.687256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:01.697682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:14:01.702432 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:14:01.703555 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:14:01.704867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 419/834] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:14:01.709587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:01.804861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96a2ca-b308-443f-962c-5b88a783973a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:01.836788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:01.837378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:01.837652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:01.837919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:01.838559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:01.838854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:01.840736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:01.848432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 416/835] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:01.854373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:01.951742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290064b-0192-4f0a-905d-2d08340da559 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:01.960337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:01.985098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:01.985720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:01.985997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:01.986269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] PATH_INFO: `/v3/users/d61b46b252f145e9899941b6601578e0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:01.987376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] RBAC: Authorizing `identity:get_user(user_id=d61b46b252f145e9899941b6601578e0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:01.988847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:01.990406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 420/836] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:01 2022] GET /identity/v3/users/d61b46b252f145e9899941b6601578e0 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:01.996555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:01.999418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:02.094544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef3f02-61ea-462c-a9a1-153e3711ac12 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:02.127624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:02.128223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:02.128523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:02.128800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:02.192815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:02.194234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:02.195939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:02.288135 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 417/837] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:14:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:02.294080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:02.391169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce6e7-25b2-4370-881e-da4f341393f1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:02.423395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:02.424012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:02.424282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:02.424574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:02.425686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=242f135f361d4be282c1f054cae929ee)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:02.427100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50453a5d-943b-4ab6-8ae5-c7b8a1e3f2e1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:02.428744 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 421/838] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:02 2022] GET /identity/v3/projects/242f135f361d4be282c1f054cae929ee => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:02.435594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:02.540464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e5ea7-3e44-4275-86d0-fdd64220d0d8 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:02.541998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:02.573981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:02.574575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:02.575419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:02.575696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:02.576623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=242f135f361d4be282c1f054cae929ee, user.id=d61b46b252f145e9899941b6601578e0) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:02.576980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:02.578720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0cff6-397e-41b6-9ee2-b992b2ccd15c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:02.584457 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 418/839] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:14:02 2022] GET /identity/v3/role_assignments?user.id=d61b46b252f145e9899941b6601578e0&scope.project.id=242f135f361d4be282c1f054cae929ee&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:14:04.765732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cffb96-9ea5-4aeb-8d67-f30c2d0ad7ed None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:04.766292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cffb96-9ea5-4aeb-8d67-f30c2d0ad7ed None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:04.766292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cffb96-9ea5-4aeb-8d67-f30c2d0ad7ed None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:04.767594 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 422/840] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:04.773001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:04.773416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:04.773606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:04.792396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:04.793593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:04.860152 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 419/841] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:14:05.133824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cffb96-9ea5-4aeb-8d67-f30c2d0ad7ed None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:05.181427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:05.237052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cffb96-9ea5-4aeb-8d67-f30c2d0ad7ed None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:05.270354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:05.270974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:05.271251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:05.271525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:05.272660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:05.274083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee776dcb-f669-4f2d-a5e2-c33834659c66 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:05.275643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 423/842] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:14:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:05.281584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:05.371187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:05.377372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e86302-beaf-4bc8-b0b6-e3e2ee7ec5bf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:05.409569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:05.410093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:05.410362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:05.410651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:05.411290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:05.412745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e636fc-cd48-4e2b-b5c6-62bd0bcf896c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:05.500180 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 420/843] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:14:05 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:14:07.691167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a155-a058-437f-b9f8-e7cd5192d7a6 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:07.691688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a155-a058-437f-b9f8-e7cd5192d7a6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:07.691688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a155-a058-437f-b9f8-e7cd5192d7a6 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:07.693367 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 424/844] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:07.698535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:07.698999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:07.699093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:07.717157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:07.718358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:07.784317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 421/845] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:14:08.057074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83a155-a058-437f-b9f8-e7cd5192d7a6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:08.161323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83a155-a058-437f-b9f8-e7cd5192d7a6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:08.175024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:08.195206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:08.195817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:08.196089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:08.196354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] PATH_INFO: `/v3/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:08.197750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] RBAC: Authorizing `identity:get_role(role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:08.199100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:08.200406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 425/846] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:08 2022] GET /identity/v3/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:08.206820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:08.286556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:08.303639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984b694-67fd-44d3-ad53-9c9aadd647e9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:08.337420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:08.337976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:08.338250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:08.338514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] PATH_INFO: `/v3/users/89c3f202161647b9a5beaddca29d3624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:08.352195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] RBAC: Authorizing `identity:get_user(user_id=89c3f202161647b9a5beaddca29d3624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:08.353655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:08.355240 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 422/847] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:08 2022] GET /identity/v3/users/89c3f202161647b9a5beaddca29d3624 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:08.361078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:08.472069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0736-2e89-467f-a95c-d9875119b482 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:08.505826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:08.506443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:08.506717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:08.506985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:08.508091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] RBAC: Authorizing `identity:get_project(project_id=242f135f361d4be282c1f054cae929ee)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:08.509541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189e689-05d7-4776-995c-25aa0403d300 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:08.511298 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 426/848] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:08 2022] GET /identity/v3/projects/242f135f361d4be282c1f054cae929ee => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:08.517338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:08.616016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aad536-4730-4255-820b-4d3a7d594724 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:08.649155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:08.649807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:08.650085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:08.650359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee/users/89c3f202161647b9a5beaddca29d3624/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:08.652520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] RBAC: Authorizing `identity:create_grant(project_id=242f135f361d4be282c1f054cae929ee, user_id=89c3f202161647b9a5beaddca29d3624, role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:08.653930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507952af-c516-4d4e-90ae-2204aeafa56e None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:08.737594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:08.742315 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 423/849] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:14:08 2022] PUT /identity/v3/projects/242f135f361d4be282c1f054cae929ee/users/89c3f202161647b9a5beaddca29d3624/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:14:10.883497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f158e-4a25-4a58-96f0-2bb5d132f5d4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:10.885103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f158e-4a25-4a58-96f0-2bb5d132f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:10.885103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f158e-4a25-4a58-96f0-2bb5d132f5d4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:10.885797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 427/850] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:10.891317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:10.891726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:10.891853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:10.910686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:10.911881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:10.977462 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 424/851] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:11.249160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f158e-4a25-4a58-96f0-2bb5d132f5d4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:11.298684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:11.350089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f158e-4a25-4a58-96f0-2bb5d132f5d4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:11.382941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056990eb-1622-400b-b460-8d89f57557da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:11.383561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056990eb-1622-400b-b460-8d89f57557da None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:11.383834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056990eb-1622-400b-b460-8d89f57557da None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:11.384099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056990eb-1622-400b-b460-8d89f57557da None admin] PATH_INFO: `/v3/roles/81a2fc90eeda4eefb2eef3ff435097cb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:11.385497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056990eb-1622-400b-b460-8d89f57557da None admin] RBAC: Authorizing `identity:get_role(role_id=81a2fc90eeda4eefb2eef3ff435097cb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:11.386848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056990eb-1622-400b-b460-8d89f57557da None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:11.388162 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 428/852] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:11 2022] GET /identity/v3/roles/81a2fc90eeda4eefb2eef3ff435097cb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:11.394550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:11.488807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31e3a6-bed5-410f-a9d9-11694aeab3f1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:11.518059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:11.524323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:11.525019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:11.525286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:11.525550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] PATH_INFO: `/v3/users/89c3f202161647b9a5beaddca29d3624` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:11.526639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] RBAC: Authorizing `identity:get_user(user_id=89c3f202161647b9a5beaddca29d3624)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:11.528066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:11.529643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 425/853] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:11 2022] GET /identity/v3/users/89c3f202161647b9a5beaddca29d3624 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:11.535589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056990eb-1622-400b-b460-8d89f57557da None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:11.633330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056990eb-1622-400b-b460-8d89f57557da None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:11.649768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:11.666723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:11.667320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:11.667605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:11.667877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:11.732839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:11.734278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:11.828403 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 429/854] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:14:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:11.834956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:11.930802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b65786-7708-411c-aec3-5dc015f69003 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:11.963234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:11.963857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:11.964133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:11.964405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] PATH_INFO: `/v3/projects/242f135f361d4be282c1f054cae929ee` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:11.965634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] RBAC: Authorizing `identity:get_project(project_id=242f135f361d4be282c1f054cae929ee)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:11.967069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a7216-a3d7-47c8-9321-b2e856a7ab70 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:11.968745 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 426/855] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:11 2022] GET /identity/v3/projects/242f135f361d4be282c1f054cae929ee => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:11.975071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:11.992680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:12.072119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147640-b06e-4596-a270-efe4fc3d0b93 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:12.104090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:12.104696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:12.104969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:12.105233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:12.105940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] RBAC: Adding query filter params (role.id=81a2fc90eeda4eefb2eef3ff435097cb, scope.project.id=242f135f361d4be282c1f054cae929ee, user.id=89c3f202161647b9a5beaddca29d3624) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:12.106238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:12.107645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db507e-fefb-4182-8f98-3f1afe8ff7d7 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:12.113944 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 430/856] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:14:11 2022] GET /identity/v3/role_assignments?user.id=89c3f202161647b9a5beaddca29d3624&scope.project.id=242f135f361d4be282c1f054cae929ee&role.id=81a2fc90eeda4eefb2eef3ff435097cb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:14.367436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca207a6-26f0-4e8c-942c-942e3e5539aa None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:14.367975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca207a6-26f0-4e8c-942c-942e3e5539aa None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:14.367975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca207a6-26f0-4e8c-942c-942e3e5539aa None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:14.369388 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 427/857] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:14.374822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:14.375242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:14.375372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:14.394327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:14.395507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:14.461521 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 431/858] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:14.730870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca207a6-26f0-4e8c-942c-942e3e5539aa None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:14.795485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:14.830825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca207a6-26f0-4e8c-942c-942e3e5539aa None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:14.865040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:14.865681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:14.865957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:14.866226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:14.867360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:14.868810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d6190-eafa-453a-908b-14c64f9ac95b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:14.870367 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 428/859] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:14.876296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:14.887843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:14.974427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57589e84-9b4c-4d3e-ac5c-bc775b6f7741 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:15.006918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:15.007433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:15.007702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:15.007966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:15.008620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:15.010033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8844c53-cc35-45e5-8c94-125816a5f82c None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:15.085473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 432/860] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:14:14 2022] POST /identity/v3/projects => generated 311 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:14:17.275682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e07d-cc8f-46d6-b64f-f764361abe3d None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:17.276304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e07d-cc8f-46d6-b64f-f764361abe3d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:17.276304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40e07d-cc8f-46d6-b64f-f764361abe3d None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:17.277578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 429/861] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:17.282996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:17.283417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:17.283597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:17.302015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:17.303210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:17.359124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:17.369693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 433/862] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:17.639705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40e07d-cc8f-46d6-b64f-f764361abe3d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:17.741556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40e07d-cc8f-46d6-b64f-f764361abe3d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:17.774970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:17.775589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:17.775864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:17.776139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:17.777375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:17.778795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285754a9-c035-42c3-9c57-0ca4212e91b7 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:17.780344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 430/863] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:17.786240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:17.885208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcfbfb-2ade-4cc7-88c0-1078ea0a4f52 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:17.919836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:17.920363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:17.920676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:17.920947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:17.921602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:17.923033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa501de-2102-4a1c-b949-1a0e5edf0286 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:18.040258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 434/864] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:14:17 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:14:20.207381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d274a-3751-412c-b686-94fb5b1b62ee None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:20.207958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d274a-3751-412c-b686-94fb5b1b62ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:20.207958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d274a-3751-412c-b686-94fb5b1b62ee None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:20.209408 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 431/865] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:20.214600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:20.215033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:20.215126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:20.233340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:20.234529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:20.276472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:20.299108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 435/866] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:20.572957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d274a-3751-412c-b686-94fb5b1b62ee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:20.575818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:20.681177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d274a-3751-412c-b686-94fb5b1b62ee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:20.718971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:20.719645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:20.719919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:20.720182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:20.730104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:14:20.734838 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:14:20.736042 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:14:20.737388 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 432/867] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:14:20.741962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:20.839005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a354f-7f7a-4d42-8d38-db264aef457a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:20.872074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:20.872697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:20.872977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:20.873250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:20.873906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:20.874211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:20.875579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:20.883758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 436/868] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:20.892952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:20.953609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:20.991627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad3a26-2e40-4e37-98e0-15c5e6309555 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:21.029421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:21.030040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:21.030316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:21.030586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] PATH_INFO: `/v3/users/4b86ded6c017418a85b310a913c40dcd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:21.043763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] RBAC: Authorizing `identity:get_user(user_id=4b86ded6c017418a85b310a913c40dcd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:21.045220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:21.046841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 433/869] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:20 2022] GET /identity/v3/users/4b86ded6c017418a85b310a913c40dcd => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:21.052705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:21.094866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:21.152508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cdca7-7576-4b34-bbe2-b5c716f13ca1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:21.185905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:21.186529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:21.186806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:21.187076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] PATH_INFO: `/v3/projects/c4a403b237424a71a7b3d0d1c69e11be` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:21.188163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] RBAC: Authorizing `identity:get_project(project_id=c4a403b237424a71a7b3d0d1c69e11be)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:21.189625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d3da4-4bc7-4730-ac7e-f77ce6c0f889 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:21.191242 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 437/870] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:21 2022] GET /identity/v3/projects/c4a403b237424a71a7b3d0d1c69e11be => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:21.197301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:21.293007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef5fbf-d4f4-4205-8581-7154c621bf52 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:21.313039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:21.326513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:21.327421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:21.327695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:21.327964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] PATH_INFO: `/v3/projects/c4a403b237424a71a7b3d0d1c69e11be/users/4b86ded6c017418a85b310a913c40dcd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:21.329865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] RBAC: Authorizing `identity:create_grant(project_id=c4a403b237424a71a7b3d0d1c69e11be, user_id=4b86ded6c017418a85b310a913c40dcd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:21.331282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d41b51-881a-4046-9d13-baf1915d96bc None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:21.383934 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 434/871] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:14:21 2022] PUT /identity/v3/projects/c4a403b237424a71a7b3d0d1c69e11be/users/4b86ded6c017418a85b310a913c40dcd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:14:23.497041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842a6f-2eb0-4757-920e-24690134e693 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:23.497597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842a6f-2eb0-4757-920e-24690134e693 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:23.497597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38842a6f-2eb0-4757-920e-24690134e693 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:23.498946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 438/872] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:23.504268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:23.504711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:23.504858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:23.524773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:23.525950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:23.591985 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 435/873] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:14:23.859755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842a6f-2eb0-4757-920e-24690134e693 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:23.961093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38842a6f-2eb0-4757-920e-24690134e693 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:23.970027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:23.995165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:23.995783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:23.996062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:23.996330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.006122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:14:24.010931 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:14:24.012033 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:14:24.017692 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 439/874] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:14:24.018548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:24.112969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbc388-90e4-4669-9806-7edd84e0a74c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:24.124037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:24.146836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:24.147484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:24.147755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:24.148019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.148704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:24.149002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:24.150347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:24.158131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 436/875] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:24.164774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:24.263105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbb3b9-5aa4-413e-bdf0-0fe3f8a82e02 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:24.295809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:24.296421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:24.296731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:24.297002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] PATH_INFO: `/v3/users/4b86ded6c017418a85b310a913c40dcd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.298109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] RBAC: Authorizing `identity:get_user(user_id=4b86ded6c017418a85b310a913c40dcd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:24.299534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:24.301153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 440/876] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:24 2022] GET /identity/v3/users/4b86ded6c017418a85b310a913c40dcd => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:24.307730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:24.404370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883cd6d-03cd-40ae-8a41-654435eb1cd4 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:24.436632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:24.437237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:24.437512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:24.437780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.478354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:24.503663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:24.505141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:24.601346 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 437/877] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:14:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:24.607847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:24.646200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:24.710568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d99f9-cdc3-40db-9718-a54285ffa405 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:24.745870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:24.746491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:24.747565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:24.747565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] PATH_INFO: `/v3/projects/c4a403b237424a71a7b3d0d1c69e11be` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.748155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] RBAC: Authorizing `identity:get_project(project_id=c4a403b237424a71a7b3d0d1c69e11be)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:24.753541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18451909-f454-46ee-aafb-fdf8ef53d445 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:24.753541 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 441/878] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:24 2022] GET /identity/v3/projects/c4a403b237424a71a7b3d0d1c69e11be => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:24.758477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:24.825427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:24.854837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ab64-daf9-4215-8d09-1a0780e3148b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:24.887738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:24.888331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:24.888641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:24.888913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:24.889653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=c4a403b237424a71a7b3d0d1c69e11be, user.id=4b86ded6c017418a85b310a913c40dcd) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:24.889958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:24.891383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5155797-65ae-4659-b492-5d2b625003de None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:24.897251 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 438/879] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:14:24 2022] GET /identity/v3/role_assignments?user.id=4b86ded6c017418a85b310a913c40dcd&scope.project.id=c4a403b237424a71a7b3d0d1c69e11be&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:27.063167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699d8a-199e-4c9d-b7b3-ea83c913b5b4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:27.063741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699d8a-199e-4c9d-b7b3-ea83c913b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:27.063741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80699d8a-199e-4c9d-b7b3-ea83c913b5b4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:27.065096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 442/880] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:27.070284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd10a0-32c1-4f9a-8212-7ca09c7af38a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:27.070673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd10a0-32c1-4f9a-8212-7ca09c7af38a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:27.070809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd10a0-32c1-4f9a-8212-7ca09c7af38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:27.088676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2cdd10a0-32c1-4f9a-8212-7ca09c7af38a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:27.089840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2cdd10a0-32c1-4f9a-8212-7ca09c7af38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:27.153497 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 439/881] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:14:27.422214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699d8a-199e-4c9d-b7b3-ea83c913b5b4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:27.526429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80699d8a-199e-4c9d-b7b3-ea83c913b5b4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:27.528953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:27.560100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:27.560720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:27.560997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:27.561266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:27.561927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:27.563360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770cd09d-9ac1-4b4b-a7de-4a6e79fd5139 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:27.651442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 443/882] 10.222.0.64 () {60 vars in 1138 bytes} [Wed Nov 2 12:14:27 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:14:29.835873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122449-e3d0-4648-9e10-a128a470bdf1 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:29.836374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122449-e3d0-4648-9e10-a128a470bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:29.836374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc122449-e3d0-4648-9e10-a128a470bdf1 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:29.837689 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 440/883] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:29.842978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:29.843394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:29.843518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:29.861862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:29.863044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:29.929313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 444/884] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:30.198743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122449-e3d0-4648-9e10-a128a470bdf1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:30.263448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:30.297635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc122449-e3d0-4648-9e10-a128a470bdf1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:30.330630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:30.331246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:30.331524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:30.331797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] PATH_INFO: `/v3/domains/c169b1d1664340638e871b111bb4da65` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:30.342976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c169b1d1664340638e871b111bb4da65)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:30.344409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84b8b5-c335-4fe6-9367-917294d9fb65 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:30.346018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 441/885] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Nov 2 12:14:30 2022] GET /identity/v3/domains/c169b1d1664340638e871b111bb4da65 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:30.352758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:30.442105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:30.454488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5fbd5-603b-41fc-8339-bdc27f6534b0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:30.483398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:30.483988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:30.484262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:30.484761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:30.485411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:30.486839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbc1b7-5e3f-49fc-8d86-e92b03c94f46 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:30.570291 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 445/886] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:14:30 2022] POST /identity/v3/projects => generated 361 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:14:32.733375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bf2f-0f7b-439e-bb32-0fe3b786753a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:32.733922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bf2f-0f7b-439e-bb32-0fe3b786753a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:32.733922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456bf2f-0f7b-439e-bb32-0fe3b786753a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:32.735214 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 442/887] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:32.740747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:32.741142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:32.741285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:32.758967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:32.760133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:32.825712 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 446/888] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:33.096429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456bf2f-0f7b-439e-bb32-0fe3b786753a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:33.194766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456bf2f-0f7b-439e-bb32-0fe3b786753a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:33.221842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:33.230089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] PATH_INFO: `/v3/domains/c169b1d1664340638e871b111bb4da65` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c169b1d1664340638e871b111bb4da65)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fa115-ba86-41bd-aa3b-d58108ba8ad1 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:33.238053 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 443/889] 10.222.0.64 () {56 vars in 1183 bytes} [Wed Nov 2 12:14:33 2022] GET /identity/v3/domains/c169b1d1664340638e871b111bb4da65 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:33.241541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:33.315671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:33.338506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec7701-0816-448f-b5a5-789606c1cfe2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:33.371425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:33.371944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:33.372215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:33.372476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:33.373150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:33.374607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55beeb9-e0c1-42b1-8f87-fc454ec9affd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:33.453879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 447/890] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:14:33 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:14:35.644683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82507-ca08-4add-b086-cfc0c247eb6e None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:35.645236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82507-ca08-4add-b086-cfc0c247eb6e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:35.645236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d82507-ca08-4add-b086-cfc0c247eb6e None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:35.646552 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 444/891] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:35.651789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:35.652206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:35.652343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:35.671292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:35.672506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:35.738801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 448/892] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:36.006416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82507-ca08-4add-b086-cfc0c247eb6e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:36.105963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d82507-ca08-4add-b086-cfc0c247eb6e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:36.141833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:36.142447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:36.142723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:36.142988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:36.153177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:14:36.157938 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:14:36.159084 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:14:36.160471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 445/893] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:14:36.165783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:36.231492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:36.271125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7cf6-5909-463c-9624-2920368ba96c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:36.307479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:36.308113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:36.308387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:36.308684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:36.309334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:36.309631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:36.310976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:36.319254 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 449/894] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:36.325463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:36.381353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:36.424041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294d4b0-8957-4aba-b76c-bbe19482a183 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:36.457710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:36.458332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:36.458607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:36.458876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] PATH_INFO: `/v3/users/5e714c5af61c48d38927b1ab928547ab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:36.471921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5e714c5af61c48d38927b1ab928547ab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:36.473387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:36.474982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 446/895] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:36 2022] GET /identity/v3/users/5e714c5af61c48d38927b1ab928547ab => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:36.481064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:36.584351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e77333-afd9-4df0-b948-7f631c798efd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:36.606548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:36.617491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:36.618166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:36.618445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:36.618723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] PATH_INFO: `/v3/projects/f3bc12ae57764c3daf731608243d286f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:36.619833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] RBAC: Authorizing `identity:get_project(project_id=f3bc12ae57764c3daf731608243d286f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:36.621307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4519a540-8881-4d4e-9406-0bf577680003 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:36.622926 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 450/896] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:36 2022] GET /identity/v3/projects/f3bc12ae57764c3daf731608243d286f => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:36.629607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:36.726591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7192-2eb4-43b5-91f4-2e67172203b5 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:36.739781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:36.760016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:36.760694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:36.760966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:36.765160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] PATH_INFO: `/v3/projects/f3bc12ae57764c3daf731608243d286f/users/5e714c5af61c48d38927b1ab928547ab/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:36.765160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] RBAC: Authorizing `identity:create_grant(project_id=f3bc12ae57764c3daf731608243d286f, user_id=5e714c5af61c48d38927b1ab928547ab, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:36.765160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd695c-ae29-40ca-8c7b-2b5446bbe198 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:36.966817 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 447/897] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:14:36 2022] PUT /identity/v3/projects/f3bc12ae57764c3daf731608243d286f/users/5e714c5af61c48d38927b1ab928547ab/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:14:39.100792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e187-997e-49f4-b753-9c23ae58ad52 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:39.101323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e187-997e-49f4-b753-9c23ae58ad52 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:39.101323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e187-997e-49f4-b753-9c23ae58ad52 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:39.102690 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 451/898] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:14:39.108025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:39.108468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:39.108594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:39.126808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:14:39.128013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:14:39.191813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 448/899] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:14:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:14:39.460225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e187-997e-49f4-b753-9c23ae58ad52 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:39.561612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e187-997e-49f4-b753-9c23ae58ad52 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:39.595196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:39.595805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:39.596110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:39.596913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:39.606994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:14:39.611783 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:14:39.612809 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:14:39.613680 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 452/900] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:14:39.618962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:39.713490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7b7bd-b934-492b-8d99-092ad60e77c7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:39.714888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:39.745789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:39.746382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:39.746655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:39.746922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:39.747573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:39.747869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:39.749242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:39.757426 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 449/901] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:39.763354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:39.815914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:39.862074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3e9a7-a671-40e0-91c2-aa9355511a36 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:39.895723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:39.896330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:39.896632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:39.896898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] PATH_INFO: `/v3/users/5e714c5af61c48d38927b1ab928547ab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:39.897992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] RBAC: Authorizing `identity:get_user(user_id=5e714c5af61c48d38927b1ab928547ab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:39.899402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:39.900981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 453/902] 10.222.0.64 () {56 vars in 1177 bytes} [Wed Nov 2 12:14:39 2022] GET /identity/v3/users/5e714c5af61c48d38927b1ab928547ab => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:39.906763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:40.003639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee3012-0b7a-4ce2-a934-8cd7d492a0eb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:40.036773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:40.037369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:40.037639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:40.037901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:40.067115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:40.102601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:40.104024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:40.199461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 450/903] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:14:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:14:40.205504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:40.301338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f662a-9cf5-4ae1-a865-c1f5d2d79311 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:40.321359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:40.334941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:40.335692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:40.335803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:40.336072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] PATH_INFO: `/v3/projects/f3bc12ae57764c3daf731608243d286f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:40.337187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] RBAC: Authorizing `identity:get_project(project_id=f3bc12ae57764c3daf731608243d286f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:40.338596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9de5e7-9bef-4db2-aaf1-d2b02469fb41 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:40.340206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 454/904] 10.222.0.64 () {56 vars in 1186 bytes} [Wed Nov 2 12:14:40 2022] GET /identity/v3/projects/f3bc12ae57764c3daf731608243d286f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:40.346471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:14:40.406115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:40.442921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe799a75-209a-45c6-8313-bc39a6820256 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:14:40.476824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:14:40.477419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:14:40.477695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:14:40.477965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:14:40.478669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=f3bc12ae57764c3daf731608243d286f, user.id=5e714c5af61c48d38927b1ab928547ab) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:14:40.478975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:14:40.480389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79a4e5-8dfd-403d-a5d2-f36ac1c77146 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:14:40.485997 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 451/905] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:14:40 2022] GET /identity/v3/role_assignments?user.id=5e714c5af61c48d38927b1ab928547ab&scope.project.id=f3bc12ae57764c3daf731608243d286f&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:14:50.360056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:14:50.483430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=36 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:56.251068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294b14-8bda-420a-9080-907eb017bc38 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:56.251742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294b14-8bda-420a-9080-907eb017bc38 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:56.251742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07294b14-8bda-420a-9080-907eb017bc38 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:56.253109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 455/906] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:15:56.258476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:56.260409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:56.260409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:56.277527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:15:56.278711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:15:56.348809 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 452/907] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:15:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:15:56.619896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07294b14-8bda-420a-9080-907eb017bc38 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:15:56.724128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07294b14-8bda-420a-9080-907eb017bc38 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:15:56.762930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:15:56.763770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:56.764047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:56.764315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:56.774900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:15:56.776274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:15:56.791230 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:15:56.792471 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:15:56.793474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:15:56.793474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:15:56.793474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:15:56.793474 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 456/908] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:15:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:15:56.798924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:15:56.901612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094c3bd-3b50-4fff-aaa3-ab7de6f27df7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:15:56.930136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:56.938589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:15:56.940239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:56.940239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:56.940239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:56.940794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:15:56.941137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:15:56.942739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51ecd9-7a37-4d70-8d79-815642d3fd01 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:15:56.954740 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 453/909] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:15:56.960905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:15:57.020632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:15:57.072412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5eff4-0267-41fc-9d1d-d37c4979e96d None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:15:57.105656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:15:57.106255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:57.106524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:57.106782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:57.107416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:15:57.109575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601421bb-29a3-427a-8261-531e56fc1df5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:15:57.226260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 457/910] 10.222.0.64 () {60 vars in 1132 bytes} [Wed Nov 2 12:15:56 2022] POST /identity/v3/users => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:15:59.391144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d741a7-e5d4-437e-8141-701a59162c1d None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:59.391689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d741a7-e5d4-437e-8141-701a59162c1d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:59.391800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d741a7-e5d4-437e-8141-701a59162c1d None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:59.393071 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 454/911] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:15:59.398349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:59.398799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:59.398899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:59.417612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:15:59.419264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:15:59.487009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 458/912] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:15:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:15:59.754991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d741a7-e5d4-437e-8141-701a59162c1d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:15:59.863160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d741a7-e5d4-437e-8141-701a59162c1d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:15:59.896010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:15:59.896661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:15:59.896938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:15:59.897206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:15:59.907610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:15:59.912406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:15:59.913568 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:15:59.914795 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 455/913] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:15:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:15:59.919585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:15:59.963666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:00.031399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e2d9c-712e-4d41-a05e-dc1d30c8545b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.068332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.069092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.069372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.069639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.070296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] RBAC: Adding query filter params (name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:00.070646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.071950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.080567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 459/914] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:15:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:00.087555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.144254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:00.196821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600db2b-4316-4e75-b893-947854e1707f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.229867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.230490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.230767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.231037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.241337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.242784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:00.256622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:00.257803 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:00.258690 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:00.258690 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:00.258690 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:00.258690 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 456/915] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:00.264017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.362850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:00.365873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d83b0e-d2ca-4bba-8ab7-1e085e824ebd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.402490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.403172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.403384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.403654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.404287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:00.404623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.405990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.417552 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 460/916] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:00.423500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.533976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d15c36-77f3-41a8-93cc-1c400d3d7660 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.535537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:00.568371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.569022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.569293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.569558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.576512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.577987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:16:00.590080 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:00.596951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:00.598152 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 457/917] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:00.598946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.702235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e4ba5-05a3-4503-9b4e-3ac2e74e7792 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.737723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.738450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.738726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.739031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.739715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:00.740017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.741556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.759760 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 461/918] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:00.765805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.872191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75616a-e648-4374-92a4-525aef8b7b93 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:00.908240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:00.908944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:00.909262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:00.909593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:00.921124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:00.923126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:00.938800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:00.944124 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:00.947322 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:00.947322 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:00.947322 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:00.947322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 458/919] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:00.948119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:00.968280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:01.051802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dc91f-04a2-4f4f-9d57-c56bce4b7a0a None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:01.088211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:01.088884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:01.089161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:01.089427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:01.090058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:01.090357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:01.091769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:01.103948 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 462/920] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:01.109703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:01.126374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:01.208354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fd22-c1b8-4cf3-8408-6d102427397c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:01.243886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:01.244428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:01.244730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:01.244993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:01.251596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:01.253064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:16:01.263989 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:01.265572 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:01.266646 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 459/921] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:16:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:01.271431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:01.352041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:01.377668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a1ee1-e8a7-4421-b16a-5695a669ec68 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:01.411338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:01.412006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:01.412189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:01.412452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:01.413156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:01.413455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:01.414898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064de82-4708-4190-9ad3-ea25abdb0dea None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:01.427198 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 463/922] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:16:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:01.433284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:01.511432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:01.537772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f386c-7161-40cf-ad1c-f71157151aff None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:01.571796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:01.572439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:01.572747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:01.573023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6af56c33cae041dfbfe1cddcd37db3ba/roles/58b76ececfba4c6c970f11315fccbaf0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:01.588334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=6af56c33cae041dfbfe1cddcd37db3ba, role_id=58b76ececfba4c6c970f11315fccbaf0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:01.589805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5cddc-bb3c-496c-a943-3239c8abd228 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:01.672546 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 460/923] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:16:01 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6af56c33cae041dfbfe1cddcd37db3ba/roles/58b76ececfba4c6c970f11315fccbaf0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:16:03.886774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea004d-1a0b-41de-8936-8d618b8db7d4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:03.886774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea004d-1a0b-41de-8936-8d618b8db7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:03.886774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea004d-1a0b-41de-8936-8d618b8db7d4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:03.886774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 464/924] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:16:03.887544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:03.887544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:03.887544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:03.887544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:03.887544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:03.953499 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 461/925] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:04.225676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea004d-1a0b-41de-8936-8d618b8db7d4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:04.328271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea004d-1a0b-41de-8936-8d618b8db7d4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:04.364716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:04.365345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:04.365670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:04.365891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:04.373050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:04.377517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:16:04.382328 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:04.383395 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:04.384221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 465/926] 10.222.0.64 () {56 vars in 1102 bytes} [Wed Nov 2 12:16:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:04.391659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:04.453092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:04.501014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb87e58-9f89-4e9d-925f-53fafbe93ddc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:04.540862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:04.544941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:04.553471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 462/927] 10.222.0.64 () {56 vars in 1103 bytes} [Wed Nov 2 12:16:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:04.559757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:04.662483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84393150-20b1-44aa-a7d1-1cfbc909b23c None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:04.697312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:04.697945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:04.698221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:04.698491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:04.708703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:04.710169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:04.725123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:04.731860 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:04.733966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:04.733966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:04.733966 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:04.733966 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 466/928] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:04.734447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:04.836694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a5550-8be4-4af1-84a7-506e624b2ceb None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:04.853717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:04.879772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:04.880394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:04.880695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:04.880967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:04.881603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:04.881904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:04.883275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:04.895540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 463/929] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:04.901541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:04.955736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.011425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7fa84-77ec-4dee-854b-b9256f009bbd None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:05.046720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867755-87ba-4059-946a-308a6858016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:05.047366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867755-87ba-4059-946a-308a6858016b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:05.047641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867755-87ba-4059-946a-308a6858016b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:05.047902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867755-87ba-4059-946a-308a6858016b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:05.056563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867755-87ba-4059-946a-308a6858016b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:05.058182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867755-87ba-4059-946a-308a6858016b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c0867755-87ba-4059-946a-308a6858016b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:16:05.069845 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:05.071174 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:05.072368 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 467/930] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:05.077562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:05.191148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b3f7-5a0a-4b47-9fc1-77e14224f080 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:05.229813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:05.230696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:05.230974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:05.231320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:05.232051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:05.232350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:05.233811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:05.251981 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 464/931] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Nov 2 12:16:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:05.258160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867755-87ba-4059-946a-308a6858016b None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:05.360738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867755-87ba-4059-946a-308a6858016b None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:05.372684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.398453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:05.399053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:05.399327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:05.399592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:05.476035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:05.477655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:05.588475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 468/932] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:16:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Nov 02 12:16:05.594965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:05.631328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.700015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0043-07ac-443d-a31c-7cfa267ffbe9 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:05.737334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:05.737939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:05.738221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:05.738487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:05.749293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:05.750992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:05.772260 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:05.774621 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:05.777278 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:05.777278 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:05.777278 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:05.777278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 465/933] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:05.781133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:05.793961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:05.886859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f18f3b-ee9e-4df4-a9d0-fb46d85e9117 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:05.923034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:05.923689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:05.923897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:05.924204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:05.924866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:05.925192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:05.926546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:05.937853 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 469/934] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:05.944887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:06.035141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:06.050687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722f9e-c1f0-49ae-96ee-c5749253247b None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:06.085090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:06.085774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:06.085997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:06.086577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:06.093735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:06.095341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:16:06.106925 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:06.108640 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:06.110855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 466/935] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:16:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:16:06.116005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:06.188191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:06.219804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae7a5f-19d9-4e18-b6f9-8fe00be35bdf None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:06.256619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:06.257150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:06.257469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:06.257697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:06.258366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:06.258667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:06.260086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e6cdd-73de-4218-9761-8b2ffda14ebd None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:06.272941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 470/936] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:16:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:06.279396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:06.384266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c53eaf-5981-489a-8ae7-f48190cf485d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:06.419461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:06.420063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:06.420359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:06.420655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:06.421367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] RBAC: Adding query filter params (role.id=58b76ececfba4c6c970f11315fccbaf0, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=6af56c33cae041dfbfe1cddcd37db3ba) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:06.421740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:06.423205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346f0ec-2ce5-4dde-abd2-c88de4543c88 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:06.430117 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 467/937] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:16:06 2022] GET /identity/v3/role_assignments?user.id=6af56c33cae041dfbfe1cddcd37db3ba&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=58b76ececfba4c6c970f11315fccbaf0 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:08.613534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ca6-29bb-49e5-9539-4e33ae503905 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:08.614194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ca6-29bb-49e5-9539-4e33ae503905 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:08.614194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3ca6-29bb-49e5-9539-4e33ae503905 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:08.615434 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 471/938] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:16:08.621227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:08.621691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:08.621916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:08.640195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:08.641422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:08.644267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:08.710164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 468/939] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:08.979629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3ca6-29bb-49e5-9539-4e33ae503905 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.083073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3ca6-29bb-49e5-9539-4e33ae503905 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.112896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:09.118312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.118980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.119297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.119612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.130100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:16:09.134995 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:09.136330 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:09.141316 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 472/940] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:09.142847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.241710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b952311a-4f7d-4c0b-ba5b-8c7443d75651 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.275455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.276052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.276322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.276624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.277270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:09.277565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:09.278908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:09.287862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 469/941] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:16:09.294116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.397771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f0587-6058-4299-b032-b94f3107ae61 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.431564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.432186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.432455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.432751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.443233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:09.444693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:09.464123 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:09.465625 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:09.466975 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:09.466975 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:09.466975 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:09.466975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 473/942] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:09.471236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.475326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:09.577111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcc9cd-f25c-4096-ae35-16c3de0f7d5a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.610683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.611295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.611623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.611888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.612535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:09.612838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:09.617627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:09.625719 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 470/943] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:09.632166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.677406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:09.734275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c685d53-30d0-4833-a040-26e4d5f58504 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.769279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.769900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.770177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.770448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.778234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:09.779603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:16:09.790874 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:09.792622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:09.794291 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:09.796675 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 474/944] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:09.797886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:09.862172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:09.901062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7565d75-e692-4cdb-8ac5-ffab741aad8a None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:09.947235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:09.948251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:09.948602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:09.952027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:09.952027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:09.952027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:09.953339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:09.971269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 471/945] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:09.977372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:10.108820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdbbde-856c-4f1d-a0d2-9a5aafbe9664 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:10.111391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:10.149984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:10.150631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:10.150900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:10.151143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:10.163788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:10.165288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:10.181207 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:10.183022 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:10.184320 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:10.184320 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:10.184320 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:10.184320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 475/946] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:10.190668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:10.304831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b7863-fc5f-4b52-bb95-efcc4432b869 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:10.326853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:10.341192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:10.341877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:10.342049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:10.342313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:10.342935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:10.343288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:10.344675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:10.356475 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 472/947] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:10.366098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:10.471915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd7603-0f0a-442a-bac6-88caf91002fe None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:10.508077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:10.508731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:10.509008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:10.509397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:10.516695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:10.518139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:16:10.530508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:10.531599 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:10.532510 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 476/948] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:16:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:10.538527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:10.643614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b65e4-fa72-48c4-9390-9a1a7a688c84 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:10.678654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:10.679253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:10.679529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:10.679838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:10.680578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:10.680880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:10.682300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d7f99-750e-40a0-b491-6c8a0ced0235 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:10.694399 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 473/949] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:16:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:10.700750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:10.717899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:10.804897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b826f-145c-4b94-a12e-8a04992b8e02 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:10.841484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:10.842139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:10.842417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:10.842687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] PATH_INFO: `/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6af56c33cae041dfbfe1cddcd37db3ba/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:10.844761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba600d2ed70a473da94973c7bf9a691d, user_id=6af56c33cae041dfbfe1cddcd37db3ba, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:10.846197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f415da-a32d-4ecc-9d30-566530aee266 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:10.968275 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 477/950] 10.222.0.64 () {58 vars in 1439 bytes} [Wed Nov 2 12:16:10 2022] PUT /identity/v3/projects/ba600d2ed70a473da94973c7bf9a691d/users/6af56c33cae041dfbfe1cddcd37db3ba/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:16:13.134556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098cdd9-3af7-4bba-8eaf-ca4a52de3d88 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:13.135234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098cdd9-3af7-4bba-8eaf-ca4a52de3d88 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:13.135234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098cdd9-3af7-4bba-8eaf-ca4a52de3d88 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:13.136460 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 474/951] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:16:13.142120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:13.142605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:13.142697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:13.161752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:13.162946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:13.233140 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 478/952] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Nov 02 12:16:13.503783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098cdd9-3af7-4bba-8eaf-ca4a52de3d88 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:13.550098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:13.608472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098cdd9-3af7-4bba-8eaf-ca4a52de3d88 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:13.645130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:13.646275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:13.646550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:13.646818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:13.657172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(role_id) Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Nov 02 12:16:13.662600 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:13.663714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Nov 02 12:16:13.664779 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:13.665472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 475/953] 10.222.0.64 () {56 vars in 1096 bytes} [Wed Nov 2 12:16:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:16:13.670800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:13.673985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:13.771505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b8992-713f-4b3e-ad1d-ff557bc0b31e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:13.805997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:13.806600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:13.806874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:13.807143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:13.807843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] RBAC: Adding query filter params (name=admin) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:13.808141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:13.809540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:13.818319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 479/954] 10.222.0.64 () {56 vars in 1099 bytes} [Wed Nov 2 12:16:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:13.824761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:13.929269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:13.932190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44492b3-2a62-43ba-8c13-cfd88c09538d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:13.970262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:13.970903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:13.971174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:13.971441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:13.982398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:13.983842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:13.999046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:14.000551 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:14.001898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:14.001898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:14.001898 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:14.001898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 476/955] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:14.007278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:14.080728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:14.117630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eb97-4ed2-490c-abbf-5e7aa1a47cce None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:14.152448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:14.153693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:14.153693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:14.153693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:14.154225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:14.154615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:14.156001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:14.168310 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 480/956] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:14.174257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:14.276344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76559811-2c3c-49f5-ac26-3b4a93ed0850 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:14.310724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:14.311342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:14.311616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:14.311883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:14.320022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:14.321496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:16:14.332749 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:14.334156 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:14.335379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 477/957] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:14.340370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:14.443846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98047b70-0525-4c3f-880a-97c726c89bb5 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:14.469934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:14.478585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:14.479191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:14.479464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:14.479727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:14.480446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:14.480776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:14.482205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:14.500555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 481/958] 10.222.0.64 () {56 vars in 1143 bytes} [Wed Nov 2 12:16:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:14.507130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:14.524218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:14.614381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb572b-ba07-468f-b3b8-6c399d529787 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:14.649796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:14.650439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:14.650709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:14.650974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:14.721923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:14.723432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:14.737057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:14.824199 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 478/959] 10.222.0.64 () {58 vars in 1282 bytes} [Wed Nov 2 12:16:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Nov 02 12:16:14.830547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:14.936183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42606b92-defe-42ce-b713-c41299776b48 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:14.974085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:14.974782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:14.975100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:14.975425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:14.986118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:14.987568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:16:15.003311 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:15.004837 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Nov 02 12:16:15.006388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:16:15.006388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Nov 02 12:16:15.006388 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:15.006388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 482/960] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:15.010998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:15.117389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54efa83-7530-4751-8c07-cb27f4278568 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:15.131151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:15.151664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:15.152262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:15.152566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:15.152835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:15.153490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:15.153763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:15.155115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:15.170555 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 479/961] 10.222.0.64 () {56 vars in 1109 bytes} [Wed Nov 2 12:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:15.176583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:15.216014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:15.287021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f752e-698b-43e7-966e-90f2c366b5d1 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:15.325412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:15.326032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:15.326303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:15.326567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:15.333303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:15.334799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(project_id) Nov 02 12:16:15.347387 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:15.349694 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:16:15.351796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 483/962] 10.222.0.64 () {56 vars in 1111 bytes} [Wed Nov 2 12:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:15.357697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:15.464140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b3b7b-1751-483a-a1b7-930ad9a6e337 None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:15.502103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:15.502625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:15.502897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:15.503165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:15.503850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:15.504152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:15.505684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc63e2-f949-4260-ba13-847f44d43225 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:15.523302 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 480/963] 10.222.0.64 () {56 vars in 1148 bytes} [Wed Nov 2 12:16:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:15.529831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:15.635738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:15.641493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b4f9b-5179-4e2a-90f5-a8d342c1fa23 None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:15.678155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:15.678766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:15.679258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:15.679452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:15.680139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] RBAC: Adding query filter params (role.id=4a6c8234b6f1406c9820f1c2b4c94c32, scope.project.id=ba600d2ed70a473da94973c7bf9a691d, user.id=6af56c33cae041dfbfe1cddcd37db3ba) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:15.680442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:15.681911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a3976-557d-4026-9375-6d6bef88c4cb None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:15.688356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 484/964] 10.222.0.64 () {56 vars in 1374 bytes} [Wed Nov 2 12:16:15 2022] GET /identity/v3/role_assignments?user.id=6af56c33cae041dfbfe1cddcd37db3ba&scope.project.id=ba600d2ed70a473da94973c7bf9a691d&role.id=4a6c8234b6f1406c9820f1c2b4c94c32 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:17.938709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e825b-1cd2-426c-9fed-78eca45e5251 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:17.939515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e825b-1cd2-426c-9fed-78eca45e5251 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:17.939697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e825b-1cd2-426c-9fed-78eca45e5251 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:17.941324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 481/965] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:16:17.946622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:17.947070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:17.947165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:17.965992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:17.967187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:18.042231 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 485/966] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:18.311063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e825b-1cd2-426c-9fed-78eca45e5251 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:18.344396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:18.416077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e825b-1cd2-426c-9fed-78eca45e5251 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:18.453249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:18.453877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:18.454154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:18.454424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] PATH_INFO: `/v3/services/placement` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:18.455004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:18.456373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:18.466766 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:18.468110 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:18.469224 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 482/967] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:16:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:18.474086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:18.573121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:18.583358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7aa08-4081-4650-b823-8a01e5068ee4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:18.619221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:18.619832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:18.620109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:18.620378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:18.621082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:18.621386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:18.622790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3c2d0-5d04-4c14-94bb-d8de437d6555 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:18.627555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 486/968] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Nov 2 12:16:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:18.633993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:18.727932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:18.733540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf86f5-ca3c-467f-a2e9-f2249ca8098f None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:18.767466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:18.768061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:18.768338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:18.768638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:18.769257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:18.769605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:18.770957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8940761-1484-4bd0-939c-b28cc363a499 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:18.776461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 483/969] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Nov 2 12:16:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:21.002818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238204-bf92-4c89-ab8b-73b182341273 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:21.003414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238204-bf92-4c89-ab8b-73b182341273 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:21.003414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28238204-bf92-4c89-ab8b-73b182341273 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:21.004739 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 487/970] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:16:21.010366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243ff50-3c1f-4da4-8147-79e8bd198489 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:21.010768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243ff50-3c1f-4da4-8147-79e8bd198489 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:21.010915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243ff50-3c1f-4da4-8147-79e8bd198489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:21.029324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f243ff50-3c1f-4da4-8147-79e8bd198489 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:21.030520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f243ff50-3c1f-4da4-8147-79e8bd198489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:21.096161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 484/971] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:21.367411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238204-bf92-4c89-ab8b-73b182341273 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:21.471405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28238204-bf92-4c89-ab8b-73b182341273 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:21.505177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:21.505775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:21.506073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:21.506342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:21.506970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:21.508845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05f0b-c2a8-4e18-a7ec-fbd15a9317b8 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:21.582056 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 488/972] 10.222.0.64 () {60 vars in 1141 bytes} [Wed Nov 2 12:16:21 2022] POST /identity/v3/services => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:16:23.781608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d197a-6bf6-4c0b-9cfc-461e9fc395ee None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:23.782146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d197a-6bf6-4c0b-9cfc-461e9fc395ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:23.782146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d197a-6bf6-4c0b-9cfc-461e9fc395ee None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:23.783399 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 485/973] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:16:23.788625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:23.794590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:23.794590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:23.807431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:23.808660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:23.818399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:23.882663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 489/974] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:23 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:24.160692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d197a-6bf6-4c0b-9cfc-461e9fc395ee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:24.250458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:24.261466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d197a-6bf6-4c0b-9cfc-461e9fc395ee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:24.294044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:24.294666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:24.294940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:24.295208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] PATH_INFO: `/v3/services/placement` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:24.295779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:24.297162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:24.306118 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:24.307354 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:24.308280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 486/975] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:16:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:24.313333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:24.410141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b5df-595c-475e-85c9-4693ce1cd7c7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:24.444683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:24.445212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:24.445483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:24.445748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:24.446391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] RBAC: Adding query filter params (name=placement) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:24.446687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:24.448043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:24.453127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 490/976] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Nov 2 12:16:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:24.459922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:24.561650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f11e-6c42-49b0-b661-b62a4e33720d None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:24.594934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:24.595537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:24.595820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:24.596089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:24.596806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] RBAC: Adding query filter params (interface=public, service_id=f17efc1962734aab9b1b4d37832862ad, region_id=RegionOne) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:24.597113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:24.598472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988525d-1433-4865-b421-ec005d750dd0 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:24.604043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 487/977] 10.222.0.64 () {56 vars in 1251 bytes} [Wed Nov 2 12:16:24 2022] GET /identity/v3/endpoints?service_id=f17efc1962734aab9b1b4d37832862ad&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:24.610050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:24.613811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:24.708276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb563a-ecd5-4245-b93f-fdb9a9692fac None admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:24.741824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:24.742419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:24.742694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:24.742971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:24.743543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:24.744950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10ae53-ba2b-4876-a0df-98874c2c432b None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:24.751688 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 491/978] 10.222.0.64 () {56 vars in 1087 bytes} [Wed Nov 2 12:16:24 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:16:26.920435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2218-2131-4e41-b698-1b4009d1bd4b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:26.920951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2218-2131-4e41-b698-1b4009d1bd4b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:26.921072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c2218-2131-4e41-b698-1b4009d1bd4b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:26.922617 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 488/979] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:16:26.928349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:26.928902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:26.928902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:26.948827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:16:26.950007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:16:27.019066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:27.024924 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 492/980] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:16:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 12:16:27.303056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c2218-2131-4e41-b698-1b4009d1bd4b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:27.325343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:27.411426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c2218-2131-4e41-b698-1b4009d1bd4b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:27.444225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:27.444938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:27.445207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:27.445473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] PATH_INFO: `/v3/services/placement` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:27.446037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:27.447412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:16:27.456544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:16:27.457699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:16:27.458926 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 489/981] 10.222.0.64 () {56 vars in 1117 bytes} [Wed Nov 2 12:16:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:16:27.466774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:27.573818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a12e-740d-44e5-a508-038f80e677b0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:27.608046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:27.608681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:27.608956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:27.609225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:27.609846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:16:27.610141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:27.611498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcdf62-3fb4-48c5-a062-7fe2a16f4533 None admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:27.616550 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 493/982] 10.222.0.64 () {56 vars in 1116 bytes} [Wed Nov 2 12:16:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:16:27.623200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:16:27.709208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:27.730599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6e11-38d8-4294-a67b-f6f32696b81c None admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:16:27.775175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:16:27.775797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:16:27.776079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:16:27.776377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:16:27.777090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:16:27.778473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c53c4-be21-4916-b213-21cc0a9e32d3 None admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:16:27.953870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 490/983] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:16:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:16:37.613546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=69 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:16:37.948121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:46.318734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b89a-3a38-4834-8e4b-1984b065767e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:46.319727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b89a-3a38-4834-8e4b-1984b065767e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:46.320226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63b89a-3a38-4834-8e4b-1984b065767e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:46.327524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f760-730b-43e1-99aa-06630512c7a6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:46.328678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f760-730b-43e1-99aa-06630512c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:46.329187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4f760-730b-43e1-99aa-06630512c7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:46.335019 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 494/984] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:23:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:46.448735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-69b4f760-730b-43e1-99aa-06630512c7a6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:46.451566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69b4f760-730b-43e1-99aa-06630512c7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:46.686967 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 491/985] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:23:46.988882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:46.989532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:46.990126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:46.992310 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 495/986] 10.222.0.64 () {54 vars in 965 bytes} [Wed Nov 2 12:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:46.997994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8deb8b-005e-432c-9823-7afe92088793 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:46.998583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8deb8b-005e-432c-9823-7afe92088793 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:46.999064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8deb8b-005e-432c-9823-7afe92088793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:47.094836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8d8deb8b-005e-432c-9823-7afe92088793 None None] MFA Rules not processed for user `b46383fc54d5469884898c1b75ce41ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:47.097177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8d8deb8b-005e-432c-9823-7afe92088793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:47.122326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:47.192449 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 492/987] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Nov 2 12:23:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:23:47.201272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:23:47.203345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:47.324850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9563f9-d551-4e0e-927d-697a6004b9fe None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:23:47.407321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:23:47.408231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:47.408980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:47.409400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:47.411408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:47.473326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:47.536904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:23:47.538711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e860994c-a797-4549-a4d2-6a6ce89000e5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:23:47.560949 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 496/988] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:23:50.132365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:50.133009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:50.133009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:50.134255 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 493/989] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:50.139819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aef3-7bef-44e1-bd4a-8b4fd204686c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:50.140298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aef3-7bef-44e1-bd4a-8b4fd204686c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:50.140394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60aef3-7bef-44e1-bd4a-8b4fd204686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:50.211858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0f60aef3-7bef-44e1-bd4a-8b4fd204686c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:50.213110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0f60aef3-7bef-44e1-bd4a-8b4fd204686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:50.313309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 497/990] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:23:50.599359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:23:50.600912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:50.709885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d44b5-a319-41ca-a7e1-f7c3649934f2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:23:50.783062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:50.785667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:23:50.786284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:50.786557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:50.786827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:50.788481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:50.897520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:23:50.898952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2db504-197a-474e-88f3-93b686253e3a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:23:50.917002 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 494/991] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:23:53.686561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:53.687086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:53.687086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:53.688463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 498/992] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:53.693807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa89-0f9d-48b7-80a0-58a8d4144d59 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:53.694207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa89-0f9d-48b7-80a0-58a8d4144d59 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:53.694456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa89-0f9d-48b7-80a0-58a8d4144d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:53.759002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ce34aa89-0f9d-48b7-80a0-58a8d4144d59 None None] MFA Rules not processed for user `25285d71f0ed4b71b81cb814f99299bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:53.760209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce34aa89-0f9d-48b7-80a0-58a8d4144d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:53.816772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:53.863775 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 495/993] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:23:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:23:54.148406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:23:54.149973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:54.160735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.254260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760de1b-2955-4712-9aff-5fcf44d6371c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:23:54.327721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:23:54.328320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:54.328623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:54.328894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:54.330546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:54.393525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:54.441233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:23:54.442681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cec9d-f572-4940-a385-e0412095afb3 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:23:54.461473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 499/994] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:23:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:23:57.534956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb95e-63db-45cc-9a68-3597cda46725 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:57.535464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb95e-63db-45cc-9a68-3597cda46725 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:57.535663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6abb95e-63db-45cc-9a68-3597cda46725 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:57.536925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 496/995] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:57.542082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca08e-f718-4335-90d3-740a617d05ff None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:57.545576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca08e-f718-4335-90d3-740a617d05ff None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:57.545576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca08e-f718-4335-90d3-740a617d05ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:57.609279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c47ca08e-f718-4335-90d3-740a617d05ff None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:57.610538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c47ca08e-f718-4335-90d3-740a617d05ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:57.707575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 500/996] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:23:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:23:58.011566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:58.011848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:58.012122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:58.013490 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 497/997] 10.222.0.64 () {54 vars in 965 bytes} [Wed Nov 2 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:23:58.019753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f9b7-62e7-45f9-99ec-30c9e97d667e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:58.020038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f9b7-62e7-45f9-99ec-30c9e97d667e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:58.020322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f9b7-62e7-45f9-99ec-30c9e97d667e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:58.043144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:58.098908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fba7f9b7-62e7-45f9-99ec-30c9e97d667e None None] MFA Rules not processed for user `b46383fc54d5469884898c1b75ce41ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:23:58.100115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fba7f9b7-62e7-45f9-99ec-30c9e97d667e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:58.177829 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 501/998] 10.222.0.64 () {58 vars in 1062 bytes} [Wed Nov 2 12:23:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:23:58.186900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:23:58.188450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:58.292716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e918868-5d16-4bbb-8571-bf161e3e0fc4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:23:58.367055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:23:58.367659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:23:58.367931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:23:58.368197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:23:58.369837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:23:58.376873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:58.481720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:23:58.483060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d311e53-9df0-4d25-855f-02de28b0c6ce service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:23:58.500730 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 498/999] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:23:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:02.191644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:02.192217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:02.192217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:02.193668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 502/1000] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:24:02.198972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59c2c-1722-4df4-a980-274a311b6642 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:02.199575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59c2c-1722-4df4-a980-274a311b6642 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:02.199575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59c2c-1722-4df4-a980-274a311b6642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:02.267283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e7f59c2c-1722-4df4-a980-274a311b6642 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:02.268436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e7f59c2c-1722-4df4-a980-274a311b6642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:02.327401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:02.373491 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 499/1001] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:02.661341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:02.662886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:02.780411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0797ea-7848-45d8-981c-0d1dd54c9c92 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:02.796313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:02.887165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:02.887771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:02.888065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:02.888290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:02.890026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:03.031271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:03.032740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4ba06-bd5d-4167-946c-32f756e5f721 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:03.053308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 503/1002] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:05.295372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:05.295928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:05.295928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:05.297256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 500/1003] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:05.302734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d578-5193-48a1-b120-23f9484b0342 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:05.303208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d578-5193-48a1-b120-23f9484b0342 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:05.303328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022d578-5193-48a1-b120-23f9484b0342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:05.353998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:05.372589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a022d578-5193-48a1-b120-23f9484b0342 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:05.373753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a022d578-5193-48a1-b120-23f9484b0342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:05.483329 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 504/1004] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:05.779308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:05.780972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:05.895301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e573b7dc-4feb-46c0-a053-52ab88c120fc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:05.974369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:05.974974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:05.975245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:05.975510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:05.977170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:05.995120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:06.115929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:06.117423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d17bc-45f0-4cf7-b280-ff6284eeaf37 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:06.136838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 501/1005] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:08.382156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:08.382664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:08.382664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:08.384007 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 505/1006] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:08.389744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9398ed-51a9-44cf-89a2-f0d90ac38c2d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:08.390264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9398ed-51a9-44cf-89a2-f0d90ac38c2d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:08.390374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9398ed-51a9-44cf-89a2-f0d90ac38c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:08.459577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb9398ed-51a9-44cf-89a2-f0d90ac38c2d None None] MFA Rules not processed for user `25285d71f0ed4b71b81cb814f99299bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:08.460725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb9398ed-51a9-44cf-89a2-f0d90ac38c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:08.528290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:08.559294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 502/1007] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:08.842590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:08.844118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:08.956825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59db49-4e56-4297-9144-0da41dd6c71b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:08.978924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:09.033892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:09.034521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:09.034824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:09.035130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:09.036734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:09.147025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:09.148456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89c9d8-212d-48ac-b4b9-b974ff7a6543 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:09.167489 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 506/1008] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:11.987567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:11.988097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:11.988097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:11.989530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 503/1009] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:11.995164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391d95-4ebe-405d-8ee2-c329cf8bd835 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:11.995644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391d95-4ebe-405d-8ee2-c329cf8bd835 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:11.996088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd391d95-4ebe-405d-8ee2-c329cf8bd835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:12.060998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:12.063549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bd391d95-4ebe-405d-8ee2-c329cf8bd835 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:12.064809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd391d95-4ebe-405d-8ee2-c329cf8bd835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:12.168357 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 507/1010] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:12.455080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:12.457269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:12.559805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ee885-2dc1-4e73-9bfe-dabdffff4773 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:12.635312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:12.635912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:12.636184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:12.636453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:12.638101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:12.664964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:12.747918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:12.749309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6437d71-4db8-4e5d-b670-f9b7e87f667f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:12.769056 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 504/1011] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:15.008642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:15.009243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:15.009243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:15.010650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 508/1012] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:15.016056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1581-2ab7-4bdc-bc7e-be70a6882911 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:15.016455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1581-2ab7-4bdc-bc7e-be70a6882911 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:15.016632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca1581-2ab7-4bdc-bc7e-be70a6882911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:15.083556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6fca1581-2ab7-4bdc-bc7e-be70a6882911 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:15.084807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6fca1581-2ab7-4bdc-bc7e-be70a6882911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:15.160347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:15.182233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 505/1013] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:15.470197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:15.472216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:15.579882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2c175-6016-42d2-8173-324fe742ddaf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:15.609626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:15.655317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:15.655909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:15.656183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:15.656447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:15.658027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:15.769159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:15.770563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a492f-744a-416e-9bc7-8519e43aa32c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:15.789456 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 509/1014] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:18.729510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:18.730039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:18.730039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:18.731397 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 506/1015] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:18.737190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c8d6-7b18-4d49-a92e-f5fb90186f02 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:18.737608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c8d6-7b18-4d49-a92e-f5fb90186f02 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:18.737718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081c8d6-7b18-4d49-a92e-f5fb90186f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:18.804219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9081c8d6-7b18-4d49-a92e-f5fb90186f02 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:18.805356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9081c8d6-7b18-4d49-a92e-f5fb90186f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:18.813509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:18.903974 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 510/1016] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:19.189738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:19.191273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:19.293898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d9c40-5c48-4e10-bf59-816ebaeed11d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:19.366463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:19.367066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:19.367341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:19.367612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:19.369273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:19.405169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:19.479895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:19.481272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715aab8-dd66-4318-9d49-606a48b7ecf9 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:19.499293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 507/1017] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:23.983267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:23.983267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:23.983267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:23.984592 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 511/1018] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:23.991014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee70aa-00a2-4a65-a02d-55d6345aa5ba None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:23.991503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee70aa-00a2-4a65-a02d-55d6345aa5ba None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:23.991593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee70aa-00a2-4a65-a02d-55d6345aa5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:24.063014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-03ee70aa-00a2-4a65-a02d-55d6345aa5ba None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:24.064229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03ee70aa-00a2-4a65-a02d-55d6345aa5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:24.155458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:24.168234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 508/1019] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:24.457786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:24.459516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:24.592010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af0130-8dc7-44d3-af77-62d95e7c8c39 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:24.634102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:24.672979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:24.673588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:24.673861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:24.674143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:24.676376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:24.790802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:24.792228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e9bf1-452c-44e4-9c07-09fcc22331ef service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:24.812374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 512/1020] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:24:28.223377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:28.223905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:28.223905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:28.225181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 509/1021] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:28.230623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746781-a63b-42e5-b966-833b40180642 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:28.231104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746781-a63b-42e5-b966-833b40180642 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:28.231215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f746781-a63b-42e5-b966-833b40180642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:28.302316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4f746781-a63b-42e5-b966-833b40180642 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:28.303565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4f746781-a63b-42e5-b966-833b40180642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:28.324223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:28.413356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 513/1022] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:28.704122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:28.705791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:28.830283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab811d-f162-47d7-a1fe-3bea8b581fd5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:28.916058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:28.916781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:28.917056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:28.917327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:28.919033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:28.967762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:29.050817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:29.052256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac6270-ce9d-46a6-b1c6-981045d29a45 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:29.078925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 510/1023] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:33.673816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:33.674420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:33.674420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:33.675793 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 514/1024] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:33.681715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342088bf-0313-4e72-883b-71754abb3e7d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:33.682259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342088bf-0313-4e72-883b-71754abb3e7d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:33.682357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342088bf-0313-4e72-883b-71754abb3e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:33.761203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-342088bf-0313-4e72-883b-71754abb3e7d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:33.762506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-342088bf-0313-4e72-883b-71754abb3e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:33.868759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:33.871196 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 511/1025] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:34.156102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:34.157710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:34.271010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9831f-8766-4820-839c-3cf20691e2d9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:34.322146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:34.347454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:34.356482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:34.356482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:34.356482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:34.356482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:34.465262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:34.466650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4dc038-29e4-426b-ad5d-0f1986a0ca79 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:34.485319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 515/1026] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:39.546388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa52a-9e6f-4721-be92-8cb1c96e8878 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:39.546880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa52a-9e6f-4721-be92-8cb1c96e8878 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:39.546960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dfa52a-9e6f-4721-be92-8cb1c96e8878 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:39.548576 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 512/1027] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:39.555745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a0b3-c62a-4fbc-a55d-7097c0a410c8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:39.556911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a0b3-c62a-4fbc-a55d-7097c0a410c8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:39.557396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645a0b3-c62a-4fbc-a55d-7097c0a410c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:39.673179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0645a0b3-c62a-4fbc-a55d-7097c0a410c8 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:39.674666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0645a0b3-c62a-4fbc-a55d-7097c0a410c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:39.699349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:39.855630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 516/1028] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:24:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:43.957799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97713b-7585-4e94-bf64-6ffe8dc6755b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:43.958331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97713b-7585-4e94-bf64-6ffe8dc6755b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:43.958459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97713b-7585-4e94-bf64-6ffe8dc6755b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:43.959730 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 513/1029] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:43.965155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fca71-2a45-472f-81d8-3169b9763116 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:43.965593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fca71-2a45-472f-81d8-3169b9763116 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:43.965765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fca71-2a45-472f-81d8-3169b9763116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:44.048595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-631fca71-2a45-472f-81d8-3169b9763116 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:44.050710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-631fca71-2a45-472f-81d8-3169b9763116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:44.127377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:44.183559 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 517/1030] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:24:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:45.842327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc430a3-7f4f-42f9-8b1e-2a26b2819fd4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:45.842886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc430a3-7f4f-42f9-8b1e-2a26b2819fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:45.842886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc430a3-7f4f-42f9-8b1e-2a26b2819fd4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:45.844246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 514/1031] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:45.849375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ef25-d9d8-4263-9153-7ed424493dd9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:45.850142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ef25-d9d8-4263-9153-7ed424493dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:45.850418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907ef25-d9d8-4263-9153-7ed424493dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:45.937676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9907ef25-d9d8-4263-9153-7ed424493dd9 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:45.938894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9907ef25-d9d8-4263-9153-7ed424493dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:46.078411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 518/1032] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:24:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:49.579487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3f9e-1505-4896-b6bf-a41063e5bbf0 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:49.580007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3f9e-1505-4896-b6bf-a41063e5bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:49.580007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3f9e-1505-4896-b6bf-a41063e5bbf0 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:49.581959 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 515/1033] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:49.588372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e934-4ef0-4e4d-9baa-4deb755e9844 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:49.588880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e934-4ef0-4e4d-9baa-4deb755e9844 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:49.588960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249e934-4ef0-4e4d-9baa-4deb755e9844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:49.638248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:49.681143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5249e934-4ef0-4e4d-9baa-4deb755e9844 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:49.682501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5249e934-4ef0-4e4d-9baa-4deb755e9844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:49.825055 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 519/1034] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:50.185446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:50.186048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:50.186574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:50.188369 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 516/1035] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:50.200742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390951c-010d-4270-9e79-6cc5f2c3d8df None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:50.201726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390951c-010d-4270-9e79-6cc5f2c3d8df None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:50.202767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390951c-010d-4270-9e79-6cc5f2c3d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:50.289292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1390951c-010d-4270-9e79-6cc5f2c3d8df None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:50.291424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1390951c-010d-4270-9e79-6cc5f2c3d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:50.349516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.423149 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 520/1036] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:24:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:24:50.433276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:50.434799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:50.604233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0578-e140-477e-af99-8e1a3ae65146 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:50.685000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.727117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:50.727722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:50.728000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:50.728268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:50.729996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:50.831641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:50.833408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41d34c-37e8-4c4e-aa5a-629c2d91af42 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:50.852948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 517/1037] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:53.297091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:53.297600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:53.297600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:53.298906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 521/1038] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:53.305663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6117-7cbb-40bb-a090-92dabe6a767b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:53.306440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6117-7cbb-40bb-a090-92dabe6a767b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:53.306440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac6117-7cbb-40bb-a090-92dabe6a767b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:53.423185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8eac6117-7cbb-40bb-a090-92dabe6a767b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:53.425277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8eac6117-7cbb-40bb-a090-92dabe6a767b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:53.476554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:53.551183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 518/1039] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:24:53.842452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:53.843913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:54.024694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04633b-bdb8-4ea0-b276-98e8076e7855 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:54.035943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:54.164291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:54.165044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:54.165543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:54.165814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:54.167421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:54.266583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:54.268867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3cc0-ed31-434d-be32-4bc0d5771138 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:54.288144 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 522/1040] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:24:56.928377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8dc92-bbdb-4559-85cb-d1f4b645d912 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:56.928954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8dc92-bbdb-4559-85cb-d1f4b645d912 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:56.928954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8dc92-bbdb-4559-85cb-d1f4b645d912 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:56.930544 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 519/1041] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:56.935995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551e2d-8d39-40bd-bd86-c07153c376f2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:56.936415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551e2d-8d39-40bd-bd86-c07153c376f2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:56.936664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6551e2d-8d39-40bd-bd86-c07153c376f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:56.953475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:57.006344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6551e2d-8d39-40bd-bd86-c07153c376f2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:57.007952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6551e2d-8d39-40bd-bd86-c07153c376f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:57.124511 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 523/1042] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:24:57.437690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:57.438275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:57.438662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:57.440794 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 520/1043] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:24:57.446481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270837b-b589-47e6-8e53-582a9b86bbf5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:57.453831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270837b-b589-47e6-8e53-582a9b86bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:57.453831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270837b-b589-47e6-8e53-582a9b86bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:57.541793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9270837b-b589-47e6-8e53-582a9b86bbf5 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:24:57.543247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9270837b-b589-47e6-8e53-582a9b86bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:57.583528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:57.676624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 524/1044] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:24:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:24:57.691214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:24:57.693372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:57.894776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f1509-848b-4926-bb4e-525232e4b46b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:24:57.922761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:58.047889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:24:58.048664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:24:58.049097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:24:58.049471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:24:58.051505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:24:58.175974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:24:58.177910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f52f9f-0d5a-4030-b9b6-f68985e4c16d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:24:58.213256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 521/1045] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:00.880347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:00.881470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:00.882019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:00.889664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2fb3e-ade4-4789-84e3-3bb031660426 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:00.890654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2fb3e-ade4-4789-84e3-3bb031660426 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:00.891146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2fb3e-ade4-4789-84e3-3bb031660426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:00.896367 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 525/1046] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:00 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:00.926869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:00.966278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fea2fb3e-ade4-4789-84e3-3bb031660426 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:00.967830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fea2fb3e-ade4-4789-84e3-3bb031660426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:01.071343 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 522/1047] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:25:01.371623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:01.373355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:01.674483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:01.680438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600227fb-a896-4c3c-9751-4adaf5590dcf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:01.870899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:01.871496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:01.871777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:01.872051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:01.874207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:02.002095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:02.003993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce9fab-e8c4-49ff-8042-fdf0ea25b9f6 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:02.023147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:02.260365 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 526/1048] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:02.262315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e54ed-93ea-42b4-a98f-b973bf886331 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:02.262315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e54ed-93ea-42b4-a98f-b973bf886331 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:02.262315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e54ed-93ea-42b4-a98f-b973bf886331 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:02.262315 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 523/1049] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:02.263091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03c6b-d7eb-4e25-b9a2-e8a34c70d82f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:02.263091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03c6b-d7eb-4e25-b9a2-e8a34c70d82f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:02.263091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b03c6b-d7eb-4e25-b9a2-e8a34c70d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:02.327553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-28b03c6b-d7eb-4e25-b9a2-e8a34c70d82f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:02.327553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-28b03c6b-d7eb-4e25-b9a2-e8a34c70d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:02.430769 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 527/1050] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:02.786071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494196-858b-43be-a14a-459c1921aaef None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:02.786071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494196-858b-43be-a14a-459c1921aaef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:02.786071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494196-858b-43be-a14a-459c1921aaef None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:02.786071 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 524/1051] 10.222.0.64 () {54 vars in 963 bytes} [Wed Nov 2 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:02.791895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46983-7a84-4036-807c-dfc4d14da2db None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:02.792192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46983-7a84-4036-807c-dfc4d14da2db None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:02.792443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb46983-7a84-4036-807c-dfc4d14da2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:02.891267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4fb46983-7a84-4036-807c-dfc4d14da2db None None] MFA Rules not processed for user `6b073a335e944427a8560a4864364434`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:02.892941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4fb46983-7a84-4036-807c-dfc4d14da2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:02.918614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:02.984902 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 528/1052] 10.222.0.64 () {58 vars in 1060 bytes} [Wed Nov 2 12:25:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:02.993254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494196-858b-43be-a14a-459c1921aaef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:02.995056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a494196-858b-43be-a14a-459c1921aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:03.163537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494196-858b-43be-a14a-459c1921aaef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:03.169918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:03.291447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:03.292441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:03.292441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:03.292772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:03.294954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:03.445351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:03.447027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc1a15-9570-44e5-b637-af42277c440b service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:03.472904 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 525/1053] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:04.919436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:04.920003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:04.920003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:04.921418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 529/1054] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:25:04.927688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7188b4-d51a-4a26-90bd-9ad1150e4943 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:04.928119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7188b4-d51a-4a26-90bd-9ad1150e4943 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:04.928229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7188b4-d51a-4a26-90bd-9ad1150e4943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:04.973363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:04.997228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4e7188b4-d51a-4a26-90bd-9ad1150e4943 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:04.998522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4e7188b4-d51a-4a26-90bd-9ad1150e4943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:05.108437 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 526/1055] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:05.409725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:05.413318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:05.602259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1effcff-2d2c-44f1-bff1-0c70dca098d0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:05.631488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:05.756270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:05.756453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:05.756672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:05.756943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:05.758539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:05.876795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:05.878611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5de4fa-d1a5-4b56-bee5-14106bb55282 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:05.902607 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 530/1056] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:08.510332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:08.511232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:08.511633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:08.519371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01435-fe71-445e-9536-9666bfe603c4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:08.520197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01435-fe71-445e-9536-9666bfe603c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:08.520793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d01435-fe71-445e-9536-9666bfe603c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:08.523461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 527/1057] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:08.568438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:08.604533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-86d01435-fe71-445e-9536-9666bfe603c4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:08.606968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-86d01435-fe71-445e-9536-9666bfe603c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:08.752029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 531/1058] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:25:09.068971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:09.071619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:09.207445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:09.252738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88cdc75-1d58-4c69-8c8f-9998d51dcbdb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:09.400658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:09.401446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:09.401806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:09.402140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:09.403799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:09.500722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:09.520015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:09.521844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4bd87-244f-45a3-ba76-4ba2e547bea6 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:09.554488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 528/1059] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:12.235054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:12.235054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:12.235054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:12.241595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077405e-1fda-4a70-a196-91e3b78e21a5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:12.241595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077405e-1fda-4a70-a196-91e3b78e21a5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:12.243979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077405e-1fda-4a70-a196-91e3b78e21a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:12.246797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 532/1060] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:12.342288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e077405e-1fda-4a70-a196-91e3b78e21a5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:12.342288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e077405e-1fda-4a70-a196-91e3b78e21a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:12.476330 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 529/1061] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:12.771457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:12.773391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:12.895858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:12.938780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047ce38-390f-40b7-99c1-65baaa2d5a84 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:13.076897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:13.077446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:13.077720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:13.078053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:13.079680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:13.169976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:13.188214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:13.190972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d185dc4-436d-4945-9c5c-44c5e5d6c5d9 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:13.215257 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 533/1062] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:15.513513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:15.514510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:15.514784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:15.516469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 530/1063] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:15.524075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657de-2694-4a34-a113-386c6ebe3701 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:15.524604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657de-2694-4a34-a113-386c6ebe3701 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:15.525085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941657de-2694-4a34-a113-386c6ebe3701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:15.625195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-941657de-2694-4a34-a113-386c6ebe3701 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:15.626675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-941657de-2694-4a34-a113-386c6ebe3701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:15.770720 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 534/1064] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:25:16.083825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:16.085775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:16.163741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:16.273695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a4bf2-556d-4efc-9836-0d151802dbda None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:16.432479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:16.433115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:16.433383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:16.433718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:16.435320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:16.451124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:16.550487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:16.552144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a89c1c-3c77-4d9c-91c1-bc5ec6422066 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:16.571333 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 531/1065] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:19.426120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:19.426737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:19.426737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:19.428247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 535/1066] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:19.433893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8c5e-4b52-4b34-8593-d4dcd8134f5b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:19.434453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8c5e-4b52-4b34-8593-d4dcd8134f5b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:19.434453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea8c5e-4b52-4b34-8593-d4dcd8134f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:19.505108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98ea8c5e-4b52-4b34-8593-d4dcd8134f5b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:19.506310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98ea8c5e-4b52-4b34-8593-d4dcd8134f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:19.607145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:19.620250 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 532/1067] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:19.929462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:19.931208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:19.990695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:20.107679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff31c7-f179-4877-bb2a-62db9d88c7cf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:20.241889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:20.243135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:20.243414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:20.243716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:20.245359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:20.258899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:20.351973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:20.353748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ec785-f1f9-4694-b544-65fcc33c6d83 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:20.382386 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 536/1068] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:20.613461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6bfd0-64e4-46e2-ae59-7a6d7c84bb85 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:20.614097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6bfd0-64e4-46e2-ae59-7a6d7c84bb85 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:20.614097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6bfd0-64e4-46e2-ae59-7a6d7c84bb85 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:20.615391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 533/1069] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:20.621672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf816-d2c1-4dbc-91d3-447fdc456464 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:20.626516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf816-d2c1-4dbc-91d3-447fdc456464 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:20.626516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf816-d2c1-4dbc-91d3-447fdc456464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:20.706768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7dddf816-d2c1-4dbc-91d3-447fdc456464 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:20.710849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7dddf816-d2c1-4dbc-91d3-447fdc456464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:20.826007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:20.841925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 537/1070] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:25:21.152283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:21.152647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:21.154187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:21.154472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 534/1071] 10.222.0.64 () {54 vars in 962 bytes} [Wed Nov 2 12:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:21.165783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fffb-7499-405e-98de-977638559afc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:21.166086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fffb-7499-405e-98de-977638559afc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:21.166353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5fffb-7499-405e-98de-977638559afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:21.270029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cae5fffb-7499-405e-98de-977638559afc None None] MFA Rules not processed for user `7bca0e59f8374e88bc91ef8145bb7f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:21.271255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cae5fffb-7499-405e-98de-977638559afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:21.360898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 538/1072] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Nov 2 12:25:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:21.370039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:21.371648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:21.490305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73de7f3-d064-49da-add9-45f10f7d6a67 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:21.589704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:21.590473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:21.590720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:21.591297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:21.592693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:21.647591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:21.736812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:21.738282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216400b-b1a2-437f-8ed9-578b8807d599 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:21.758291 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 535/1073] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:22.685521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02116-b61a-4058-a3d9-d9eb2df36867 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:22.686064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02116-b61a-4058-a3d9-d9eb2df36867 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:22.686064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd02116-b61a-4058-a3d9-d9eb2df36867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:22.761793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bfd02116-b61a-4058-a3d9-d9eb2df36867 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:22.763074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bfd02116-b61a-4058-a3d9-d9eb2df36867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:22.806337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:22.867841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 539/1074] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:22.888573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75083be-f95e-4909-bc93-3d84e034e873 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:22.889038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75083be-f95e-4909-bc93-3d84e034e873 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:22.889158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75083be-f95e-4909-bc93-3d84e034e873 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:22.890467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 536/1075] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:22.896812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:22.897101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:22.897377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:22.920311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d2bc-52a8-401f-979b-7a610abce8bd None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:22.921283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d2bc-52a8-401f-979b-7a610abce8bd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:22.921627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426d2bc-52a8-401f-979b-7a610abce8bd None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:22.923485 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 537/1076] 10.222.0.64 () {54 vars in 943 bytes} [Wed Nov 2 12:25:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:25:22.932199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:22.932475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:22.932796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:22.973471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:22.974738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.017559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] MFA Rules not processed for user `5d62c23e1f774db1bfa311c813861c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:23.019367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.091535 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 540/1077] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:23.120331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:23.149936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 538/1078] 10.222.0.64 () {58 vars in 1040 bytes} [Wed Nov 2 12:25:22 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:23.160171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:23.161427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.193632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:23.280016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e09c3-8573-4a5b-95c2-ae7ca368b964 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:23.385949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:23.387276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.402774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:23.403805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:23.404248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:23.404534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:23.406232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.465723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:23.509806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:23.511627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5aa67c-84fe-431c-91ad-40f2bb1644b9 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:23.514683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1e4a2-2122-41b7-8b46-8f452b83bc82 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:23.521874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 541/1079] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:25:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:25:23.649046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:23.660370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:23.661029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:23.661300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:23.661568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:23.663192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:23.767160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:23.769470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ac66-c66a-4224-8d97-f8cd43c792bb service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:23.787841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 539/1080] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:26.955520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:26.956099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:26.956099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:26.957696 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 542/1081] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:26.966237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42831-9dcb-436e-9ea0-b5d194e86380 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:26.966819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42831-9dcb-436e-9ea0-b5d194e86380 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:26.966819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af42831-9dcb-436e-9ea0-b5d194e86380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:27.056808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2af42831-9dcb-436e-9ea0-b5d194e86380 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:27.058038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2af42831-9dcb-436e-9ea0-b5d194e86380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:27.139242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:27.196514 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 540/1082] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:27.491143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:27.492963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:27.679733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975ae0-00bd-4548-9a3e-e8d281a4dde4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:27.725062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:27.826593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:27.827372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:27.827655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:27.827919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:27.829618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:27.945660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:27.947281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b380d-feb0-4118-8822-42ba8d1dbe50 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:27.976440 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 543/1083] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:30.412895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:30.413439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:30.413439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:30.414769 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 541/1084] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:30.422836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222c9ec-f6de-4088-86bd-3d356f42f76e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:30.422836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222c9ec-f6de-4088-86bd-3d356f42f76e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:30.422836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222c9ec-f6de-4088-86bd-3d356f42f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:30.480784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:30.494792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e222c9ec-f6de-4088-86bd-3d356f42f76e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:30.496031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e222c9ec-f6de-4088-86bd-3d356f42f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:30.606778 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 544/1085] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:30.900674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:30.902197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:31.070483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3affdc-17a1-41ee-a0f0-13ae32af2e94 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:31.131632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:31.203643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:31.204171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:31.204448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:31.204764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:31.206409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:31.311582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:31.313650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331cf7-4eb1-41ea-9b48-074461cb48f8 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:31.337237 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 542/1086] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:25:40.605168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=46 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:41.332101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=76 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:48.893761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e79fa-fffa-4b09-b9ff-99bad4f17f93 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:48.894311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e79fa-fffa-4b09-b9ff-99bad4f17f93 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:48.894311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e79fa-fffa-4b09-b9ff-99bad4f17f93 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:48.895661 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 545/1087] 10.222.0.64 () {54 vars in 918 bytes} [Wed Nov 2 12:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:48.901052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca722fb-cf5d-4338-8473-5914a71f69ef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:48.901532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca722fb-cf5d-4338-8473-5914a71f69ef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:48.901637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca722fb-cf5d-4338-8473-5914a71f69ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:48.981473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aca722fb-cf5d-4338-8473-5914a71f69ef None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:48.982707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aca722fb-cf5d-4338-8473-5914a71f69ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:49.098529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 543/1088] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Nov 2 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:49.113550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e974a-4117-4045-820d-e172f5d3bd0c None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:49.113829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e974a-4117-4045-820d-e172f5d3bd0c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:49.114105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e974a-4117-4045-820d-e172f5d3bd0c None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:49.115448 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 546/1089] 10.222.0.64 () {54 vars in 918 bytes} [Wed Nov 2 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:49.120539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4939de-5454-4aa5-9c7d-f38baf10c673 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:49.120825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4939de-5454-4aa5-9c7d-f38baf10c673 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:49.121093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4939de-5454-4aa5-9c7d-f38baf10c673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:49.198426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:49.201039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bd4939de-5454-4aa5-9c7d-f38baf10c673 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:49.202272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bd4939de-5454-4aa5-9c7d-f38baf10c673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:49.327783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 544/1090] 10.222.0.64 () {58 vars in 1015 bytes} [Wed Nov 2 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:51.967830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:51.968225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:51.968445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:51.969751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 547/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:51.975869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89aa65-873a-45c9-9016-ad33f87c3e64 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:51.976364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89aa65-873a-45c9-9016-ad33f87c3e64 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:51.976471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89aa65-873a-45c9-9016-ad33f87c3e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:52.047004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ef89aa65-873a-45c9-9016-ad33f87c3e64 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:52.048229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ef89aa65-873a-45c9-9016-ad33f87c3e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:52.104766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:52.148021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 545/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:25:52.440037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:52.442379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:52.606229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bf09a-02e9-4e58-9c5e-1f6d18994ec4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:52.681393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:52.721963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:52.722571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:52.722850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:52.723121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:52.724780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:52.815279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:52.816936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae106cab-c433-4c5a-a7a2-fe7cf88d8e96 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:52.835481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 548/1093] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:53.977590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:53.978037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:53.978180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:53.979447 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 546/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:53.984405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53058711-8d77-46ac-8f44-2a8f293206aa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:53.984906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53058711-8d77-46ac-8f44-2a8f293206aa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:53.985020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53058711-8d77-46ac-8f44-2a8f293206aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:54.062996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-53058711-8d77-46ac-8f44-2a8f293206aa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:54.064212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-53058711-8d77-46ac-8f44-2a8f293206aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:54.092354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:54.161243 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 549/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:54.335976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:54.337443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:54.486670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657910a-60e9-49c6-ab2f-fbe6a8a45aca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:54.528032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:54.600269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:54.600902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:54.601176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:54.601440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:54.603024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:54.694594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:54.696176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b30a1-034e-4f76-8e1e-0200c179f144 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:54.714294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 547/1096] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:55.848828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:55.849367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:55.849478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:55.850789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 550/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:55.856721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0887ae-8222-4fb0-99d9-4dcabcfb7fa1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:55.857286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0887ae-8222-4fb0-99d9-4dcabcfb7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:55.857286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0887ae-8222-4fb0-99d9-4dcabcfb7fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:55.915290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:55.937212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2a0887ae-8222-4fb0-99d9-4dcabcfb7fa1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:55.938459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a0887ae-8222-4fb0-99d9-4dcabcfb7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:56.042216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 548/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:56.195909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:56.197385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:56.347026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46c61-7fe8-4568-8051-94323d22ce60 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:56.359644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:56.465471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:56.465984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:56.466258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:56.466524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:56.468110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:56.559277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:56.560924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae43290-3233-4fa2-9ae7-70b9c0e17aae service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:56.578719 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 551/1099] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:57.693786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:57.694349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:57.694349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:57.695660 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 549/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:57.700894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4445-ed57-41a3-bbaf-f420ce096412 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:57.701293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4445-ed57-41a3-bbaf-f420ce096412 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:57.701442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c4445-ed57-41a3-bbaf-f420ce096412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:57.721969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:57.781634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c30c4445-ed57-41a3-bbaf-f420ce096412 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:57.782814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c30c4445-ed57-41a3-bbaf-f420ce096412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:57.882789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 552/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:25:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:58.034302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:58.035841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:58.161589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:58.202585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f913-ee22-4354-8a0d-e7a0be08e0f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:25:58.318958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:25:58.319470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:58.319743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:58.320009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:58.321626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:58.399015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:58.413117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:25:58.415931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661dc893-9cfa-4bba-95ff-4bedcdf44fb4 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:25:58.433821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 550/1102] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:59.561908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:59.562441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:59.562441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:59.563803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 553/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:25:59.569979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20431dd-6c41-4ed6-9edb-819460f9fb5f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:25:59.570473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20431dd-6c41-4ed6-9edb-819460f9fb5f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:25:59.570694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20431dd-6c41-4ed6-9edb-819460f9fb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:25:59.652821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c20431dd-6c41-4ed6-9edb-819460f9fb5f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:25:59.654050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c20431dd-6c41-4ed6-9edb-819460f9fb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:25:59.758434 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 551/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:25:59.911524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:25:59.914246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:00.006734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:00.071460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74692da4-a1c7-4399-80e6-14a5bf8e59b7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:00.207496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:00.208004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:00.208280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:00.208574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:00.210223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:00.265562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:00.311408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:00.313060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487744cd-9012-4ca8-b8a0-ffc80c8773d9 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:00.335268 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 554/1105] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:01.488334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:01.488916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:01.488916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:01.490804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 552/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:01.496199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294309-5949-4d27-af04-9a6c941a19de None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:01.496744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294309-5949-4d27-af04-9a6c941a19de None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:01.496837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9294309-5949-4d27-af04-9a6c941a19de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:01.589912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c9294309-5949-4d27-af04-9a6c941a19de None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:01.591147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c9294309-5949-4d27-af04-9a6c941a19de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:01.706032 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 555/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:26:01.856275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:01.857905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:01.912247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:02.013744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0528-d321-4487-a6fe-599b70a7f048 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:02.137212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:02.137735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:02.138008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:02.138276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:02.139895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:02.150478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:02.245550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:02.248348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911ec14-bdc2-4618-b571-087baece5778 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:02.266899 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 553/1108] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:03.407658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:03.408389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:03.409413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:03.411715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 556/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:26:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:03.418358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7ac3-a903-4b66-ba6f-71febda22a8c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:03.418942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7ac3-a903-4b66-ba6f-71febda22a8c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:03.418942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e7ac3-a903-4b66-ba6f-71febda22a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:03.515509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a55e7ac3-a903-4b66-ba6f-71febda22a8c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:03.516862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a55e7ac3-a903-4b66-ba6f-71febda22a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:03.609225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:03.647597 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 554/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:03.800473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:03.801933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:03.820690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:03.994756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a31ac-655a-4fbc-9490-30c339be004f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:04.089732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:04.116857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:04.117491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:04.117790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:04.118038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:04.120326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:04.218410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:04.220013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3807f-fb7c-4915-b5fd-d00c9f0ec697 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:04.240693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 557/1111] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:26:05.397047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:05.397683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:05.397683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:05.398933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 555/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:05.404278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc47d-75e4-4870-9e18-8666157731e9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:05.404784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc47d-75e4-4870-9e18-8666157731e9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:05.407250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc47d-75e4-4870-9e18-8666157731e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:05.490423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1b1dc47d-75e4-4870-9e18-8666157731e9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:05.491671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b1dc47d-75e4-4870-9e18-8666157731e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:05.538353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:05.597679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 558/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:05.749277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:05.750743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:05.913443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54ac71-463a-4fc7-aefa-01de8552c70f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:05.980450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:06.044595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:06.045092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:06.045362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:06.045628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:06.047240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:06.142947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:06.144593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c1744-09d4-4796-9106-b028ab997e11 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:06.164081 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 556/1114] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:07.327497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:07.328088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:07.328088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:07.329403 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 559/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:07.335332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e695-ffc0-40eb-b94e-a4945b59339c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:07.335903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e695-ffc0-40eb-b94e-a4945b59339c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:07.335903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10e695-ffc0-40eb-b94e-a4945b59339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:07.421411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fd10e695-ffc0-40eb-b94e-a4945b59339c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:07.422653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fd10e695-ffc0-40eb-b94e-a4945b59339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:07.424968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:07.535881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 557/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:07.687386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:07.688939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:07.854026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fceff7d-af6f-496a-b117-7afb29115f51 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:07.883967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:07.978957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:07.979562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:07.979834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:07.980108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:07.981746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:08.083553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:08.085185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3591871-30ce-49de-b6d0-290c1598df38 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:08.105597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 560/1117] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:10.222010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:10.222567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:10.222567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:10.224068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 558/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:10.232339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edc5d-3db5-4e59-9f48-d50e54479b78 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:10.232997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edc5d-3db5-4e59-9f48-d50e54479b78 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:10.233389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edc5d-3db5-4e59-9f48-d50e54479b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:10.284676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:10.318530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e90edc5d-3db5-4e59-9f48-d50e54479b78 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:10.320518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e90edc5d-3db5-4e59-9f48-d50e54479b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:10.440090 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 561/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:26:10.726548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:10.728089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:10.841478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4bc14-503e-42e3-a96a-afa2e685a1c0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:10.879776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:10.922953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:10.923592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:10.923869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:10.924141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:10.925802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:11.043844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:11.045353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca7fa9d-e9d1-4770-a198-568d54af9c37 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:11.065060 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 559/1120] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:13.442928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:13.443672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:13.443672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:13.444872 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 562/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:13.451755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad98e8-76b5-45ba-842c-61cfe82be0e6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:13.452314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad98e8-76b5-45ba-842c-61cfe82be0e6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:13.452314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad98e8-76b5-45ba-842c-61cfe82be0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:13.533270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d6ad98e8-76b5-45ba-842c-61cfe82be0e6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:13.534774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6ad98e8-76b5-45ba-842c-61cfe82be0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:13.549056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:13.638900 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 560/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:26:13.924582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:13.926128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:14.039543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076775ae-ad95-49ef-bf14-7afa237666c0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:14.053518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:14.118529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:14.119134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:14.119403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:14.119670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:14.121311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:14.238390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:14.239741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b3a8a-de4a-4447-a481-fcad02329376 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:14.259031 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 563/1123] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:16.828421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907151e8-23cf-4435-a478-863af9c67071 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:16.829140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907151e8-23cf-4435-a478-863af9c67071 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:16.829140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907151e8-23cf-4435-a478-863af9c67071 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:16.830277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 561/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:16.836098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed9bb-89e0-40dd-a862-5753792225b8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:16.836800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed9bb-89e0-40dd-a862-5753792225b8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:16.836800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bed9bb-89e0-40dd-a862-5753792225b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:16.889481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:16.910648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a1bed9bb-89e0-40dd-a862-5753792225b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:16.912374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1bed9bb-89e0-40dd-a862-5753792225b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:17.018930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 564/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:17.318426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907151e8-23cf-4435-a478-863af9c67071 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:17.320232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-907151e8-23cf-4435-a478-863af9c67071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:17.433507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907151e8-23cf-4435-a478-863af9c67071 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:17.477743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:17.513180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:17.513783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:17.514053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:17.514320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:17.516052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:17.636788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:17.638193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d2a03-c71a-447b-91a4-5ff33f007605 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:17.661306 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 562/1126] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:20.037930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:20.038492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:20.038492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:20.039823 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 565/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:20.045801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83ee5-460c-4fb9-bdbe-4e8467a81822 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:20.046310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83ee5-460c-4fb9-bdbe-4e8467a81822 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:20.046409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd83ee5-460c-4fb9-bdbe-4e8467a81822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:20.124790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4fd83ee5-460c-4fb9-bdbe-4e8467a81822 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:20.126048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4fd83ee5-460c-4fb9-bdbe-4e8467a81822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:20.149503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:20.233095 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 563/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:20.525800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:20.527332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:20.644852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cf3e9-46c5-40a0-9f80-4f9bc5757bd2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:20.668168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:20.733871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:20.734486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:20.734761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:20.735038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:20.737351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:20.857616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:20.859057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76bfb5-a090-438d-a1d3-87c13b0855dc service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:20.879190 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 566/1129] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:23.141019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:23.141647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:23.141647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:23.143260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 564/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:23.149920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebadfa-5eef-41a3-a7d9-c4941cc1d7cb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:23.150470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebadfa-5eef-41a3-a7d9-c4941cc1d7cb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:23.150470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebadfa-5eef-41a3-a7d9-c4941cc1d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:23.225220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:23.228097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-efebadfa-5eef-41a3-a7d9-c4941cc1d7cb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:23.229373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efebadfa-5eef-41a3-a7d9-c4941cc1d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:23.334946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 567/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:23.625071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:23.627333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:23.742059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de9b4-c23c-4eca-9a03-ba885b29a50c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:23.792474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:23.817816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:23.818425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:23.818694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:23.818962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:23.820597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:23.935576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:23.937079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723693a9-b02a-4521-890b-f60a0c676b4b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:23.955303 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 565/1132] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:26.260404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:26.260404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:26.260404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:26.261373 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 568/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:26.266131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b3438-65c3-438a-9bd0-5a191e9748a4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:26.267088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b3438-65c3-438a-9bd0-5a191e9748a4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:26.267197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b3438-65c3-438a-9bd0-5a191e9748a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:26.335291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f75b3438-65c3-438a-9bd0-5a191e9748a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:26.336571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f75b3438-65c3-438a-9bd0-5a191e9748a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:26.366596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:26.445362 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 566/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:26.744636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:26.746157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:26.852326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8c58a-eaf5-48de-8437-9cee70189d2e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:26.881491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:26.929331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:26.929925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:26.930199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:26.930465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:26.932066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:27.045843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:27.047284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592c99-18f9-4b96-a688-0d55b4f3fa4b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:27.065767 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 569/1135] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:29.325783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:29.326307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:29.326307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:29.327807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 567/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:29.333884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35df-050d-4769-9490-d1b5ba427f30 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:29.334378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35df-050d-4769-9490-d1b5ba427f30 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:29.334497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a35df-050d-4769-9490-d1b5ba427f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:29.404261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-664a35df-050d-4769-9490-d1b5ba427f30 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:29.405510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-664a35df-050d-4769-9490-d1b5ba427f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:29.414799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:29.510894 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 570/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:29.800778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:29.802540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:29.910878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9508ee-6233-4dcb-a28f-a610747f3b55 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:29.968259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:29.987025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:29.987649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:29.987927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:29.988301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:29.989884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:30.103904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:30.105375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114ed44-af31-4118-84c4-df9567e48152 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:30.124588 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 568/1138] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:32.391571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:32.392143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:32.392143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:32.393591 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 571/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:32.399053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13e17-c269-48a8-b6ec-c270fe3ee4fd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:32.399486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13e17-c269-48a8-b6ec-c270fe3ee4fd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:32.399617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d13e17-c269-48a8-b6ec-c270fe3ee4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:32.468880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-62d13e17-c269-48a8-b6ec-c270fe3ee4fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:32.470125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-62d13e17-c269-48a8-b6ec-c270fe3ee4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:32.517816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:32.579064 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 569/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:32.866577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:32.868173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:32.976756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77bb27-41be-44d3-bc44-46a7750bc80f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:33.019958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:33.057973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:33.058579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:33.058859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:33.059127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:33.060813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:33.182731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:33.184095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43673bf-aa56-4134-82d7-6aa1e0676a4c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:33.206614 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 572/1141] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:26:35.426979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:35.426979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:35.426979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:35.428266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 570/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:35.434072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc888ee-7396-431a-a83b-d983b1a02b8f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:35.434573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc888ee-7396-431a-a83b-d983b1a02b8f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:35.434660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc888ee-7396-431a-a83b-d983b1a02b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:35.508935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8fc888ee-7396-431a-a83b-d983b1a02b8f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:35.510213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8fc888ee-7396-431a-a83b-d983b1a02b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:35.533174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:35.622784 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 573/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:35.914439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:35.915990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:36.033506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d4f62-6d27-4513-860b-b14836ecac5f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:36.104548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:36.111409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:36.112021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:36.112289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:36.112580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:36.122564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:36.239322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:36.240721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58295d0-a094-4ce0-bfe0-05fb83cd458e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:36.262122 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 571/1144] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:38.490930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:38.491473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:38.491473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:38.492851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 574/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:38.498230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939360c3-7052-439e-9d1f-dc8d40ea79c2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:38.498641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939360c3-7052-439e-9d1f-dc8d40ea79c2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:38.498777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939360c3-7052-439e-9d1f-dc8d40ea79c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:38.570342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-939360c3-7052-439e-9d1f-dc8d40ea79c2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:38.571597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-939360c3-7052-439e-9d1f-dc8d40ea79c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:38.624875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:38.674031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 572/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:26:38.959338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:26:38.960895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:39.069406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc548b47-049a-4c63-9b9d-f3998f12ef24 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:26:39.119858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:39.146480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:26:39.147083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:39.147361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:39.147626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:39.149279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:39.261101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:26:39.262451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b23b0-892d-42b1-90b7-bd5b71c69093 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:26:39.281365 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 575/1147] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:26:48.674309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=22 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:49.278890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=66 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:59.772830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86cc5-bc46-4879-9349-05dec534fbf4 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:59.773364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86cc5-bc46-4879-9349-05dec534fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:59.773364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e86cc5-bc46-4879-9349-05dec534fbf4 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:59.774642 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 573/1148] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:26:59.780874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84454-6626-416e-acfa-1ae20053e2fd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:26:59.781370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84454-6626-416e-acfa-1ae20053e2fd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:26:59.781477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84454-6626-416e-acfa-1ae20053e2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:26:59.852881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-47b84454-6626-416e-acfa-1ae20053e2fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:26:59.854102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-47b84454-6626-416e-acfa-1ae20053e2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:26:59.956382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 576/1149] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:00.254076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:00.256706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:00.256706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:00.256706 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 574/1150] 10.222.0.64 () {54 vars in 962 bytes} [Wed Nov 2 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:00.261091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f391-6c88-40f7-aaa8-33c630fa960b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:00.261379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f391-6c88-40f7-aaa8-33c630fa960b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:00.261690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6f391-6c88-40f7-aaa8-33c630fa960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:00.340421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-71f6f391-6c88-40f7-aaa8-33c630fa960b None None] MFA Rules not processed for user `7bca0e59f8374e88bc91ef8145bb7f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:00.341705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-71f6f391-6c88-40f7-aaa8-33c630fa960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:00.363381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:00.423582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 577/1151] 10.222.0.64 () {58 vars in 1059 bytes} [Wed Nov 2 12:27:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:00.431718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:00.433309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:00.542631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f2345-0db5-4d9c-9ad8-6a686a37bcd8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:00.619211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:00.619818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:00.620102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:00.620400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:00.622171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:00.678191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:00.736461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:00.737882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf4b78-307f-460d-a315-f6c1f1d5ba1f service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:00.757278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 575/1152] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:03.054125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:03.054702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:03.054702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:03.056029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 578/1153] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:03.062262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7bf-437b-410d-a1f3-fcf9b0d20a6f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:03.062799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7bf-437b-410d-a1f3-fcf9b0d20a6f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:03.062799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7bf-437b-410d-a1f3-fcf9b0d20a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:03.130116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-45e6a7bf-437b-410d-a1f3-fcf9b0d20a6f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:03.131353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-45e6a7bf-437b-410d-a1f3-fcf9b0d20a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:03.236327 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 576/1154] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:03.509254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:03.510987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:03.642947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66448cbd-25ba-4f8e-998c-3dbc03a7b50d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:03.702558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:03.755360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:03.755959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:03.756237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:03.756523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:03.757163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:03.758270 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:27:03.758270 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:27:03.758270 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:27:03.759470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec5e8e-33b1-435c-b26b-a1c10331950b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:03.779825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 579/1155] 10.222.0.64 () {56 vars in 1108 bytes} [Wed Nov 2 12:27:03 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:27:06.030092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:06.030948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:06.030948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:06.032238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 577/1156] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:06.037811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b1bd-b75f-4339-beef-1428449dce95 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:06.038273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b1bd-b75f-4339-beef-1428449dce95 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:06.038371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b1bd-b75f-4339-beef-1428449dce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:06.105580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0040b1bd-b75f-4339-beef-1428449dce95 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:06.106909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0040b1bd-b75f-4339-beef-1428449dce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:06.209698 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 580/1157] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:06.506694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:06.508222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:06.518721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:06.657233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e608ed-16f3-4cff-bb9f-554723d0f7fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:06.737049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:06.769702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:06.770218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:06.770489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:06.770749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:06.773096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:06.865775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:06.867382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba8d5-c307-4dbe-8b57-b4e07320a4ac service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:06.892037 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 578/1158] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:09.255047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:09.255596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:09.255596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:09.257007 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 581/1159] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:09.262523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e271-229b-4df0-aa1d-b1635b25befa None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:09.263014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e271-229b-4df0-aa1d-b1635b25befa None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:09.263124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79e271-229b-4df0-aa1d-b1635b25befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:09.333320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ee79e271-229b-4df0-aa1d-b1635b25befa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:09.334570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee79e271-229b-4df0-aa1d-b1635b25befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:09.383795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:09.435887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 579/1160] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:09.722314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:09.723862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:09.747459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:09.828599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6071f-b1a8-49f3-9531-98bf213e385d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:09.906174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:09.906786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:09.907068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:09.907337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:09.909650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:09.987405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:10.023182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:10.024721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f893f22-7cb9-42f4-9e80-63a19361fef0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:10.052700 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 582/1161] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:12.297721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:12.298301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:12.298301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:12.299603 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 580/1162] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:12.305254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6402-bac5-4eed-9572-1cb7c568ec7e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:12.305873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6402-bac5-4eed-9572-1cb7c568ec7e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:12.305873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6402-bac5-4eed-9572-1cb7c568ec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:12.374886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1c3c6402-bac5-4eed-9572-1cb7c568ec7e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:12.376145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c3c6402-bac5-4eed-9572-1cb7c568ec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:12.480349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 583/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:12.767853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:12.774061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:12.884841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08a14f-b08a-4464-8b70-aac7ed22db84 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:12.964397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:12.966021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:12.966700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:12.966975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:12.967242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:12.968902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:13.081264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:13.082623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2fca4-1383-4e1c-8341-7652e13bf124 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:13.101299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 581/1164] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:15.463776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:15.464413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:15.464413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:15.465925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 584/1165] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:15.472519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7b81-d775-4b54-bf42-376961b2cff4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:15.473194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7b81-d775-4b54-bf42-376961b2cff4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:15.473194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f7b81-d775-4b54-bf42-376961b2cff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:15.548893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-862f7b81-d775-4b54-bf42-376961b2cff4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:15.550186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-862f7b81-d775-4b54-bf42-376961b2cff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:15.612014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:15.660032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 582/1166] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:27:16.006280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:16.007837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:16.045480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:16.114659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed01f8-af92-4371-bb37-f395ffb21d3b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:16.189368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:16.189975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:16.190245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:16.190509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:16.192110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:16.275568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:16.305386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:16.306327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4233764-dbc3-4707-8fce-45dab9bc119e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:16.325893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 585/1167] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:19.012513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:19.013059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:19.013191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:19.015003 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 583/1168] 10.222.0.64 () {54 vars in 927 bytes} [Wed Nov 2 12:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:27:19.021512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386df96-cfe6-4dfb-8ecc-0f47aa44aa2b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:19.022018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386df96-cfe6-4dfb-8ecc-0f47aa44aa2b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:19.022400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386df96-cfe6-4dfb-8ecc-0f47aa44aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:19.103525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f386df96-cfe6-4dfb-8ecc-0f47aa44aa2b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:27:19.104822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f386df96-cfe6-4dfb-8ecc-0f47aa44aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:19.208103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 586/1169] 10.222.0.64 () {58 vars in 1024 bytes} [Wed Nov 2 12:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:27:19.512972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:27:19.515125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:19.625753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e96ff-bd3c-428a-934e-d49fce239711 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:27:19.701775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:27:19.702372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:27:19.702645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:27:19.702911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:27:19.704531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:27:19.713424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:19.818256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:27:19.819597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e03e8-d46e-470d-bc89-962b02dc85ec service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:27:19.838508 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 584/1170] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:27:29.206537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=82 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:29.836019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=50 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:50.715882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:50.716566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:50.716566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:50.799086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:28:50.800297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:50.912371 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 587/1171] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:28:50.920680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:50.921197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:50.921304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:50.942699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:28:50.943904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:50.952978 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 585/1172] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:28:50.957694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:50.967427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93bc8a1-17ad-447d-809d-835150a1a505 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:50.971983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:50.972625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:50.972904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:50.973173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:50.973810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:28:50.974111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:50.975106 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:28:50.975106 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:28:50.975106 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:28:50.976016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:50.987593 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 588/1173] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:28:50.997569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.007126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb33644-c654-47f2-b9d5-122b38aae4c1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.012541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.013143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.013415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.013680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.014317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.015580 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:28:51.015580 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:28:51.015580 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:28:51.016840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.112961 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 586/1174] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:28:50 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:28:51.117149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.128103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8960f-513e-4040-8ab5-8a40d19605d8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.180867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:51.187741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:28:51.192881 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:28:51.193584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.328392 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 589/1175] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:28:51 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:28:51.332464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.343267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d514d81-7185-4c7a-bd1f-d09626406ca3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.347720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.348395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.348705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.348978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.349619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.351213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.367326 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 587/1176] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:28:51.384807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.395485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0037d-fcf4-4731-864b-2f5b6d0973a7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.400072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.400710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.400988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.401263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.402145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.403757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ad8f8-6924-41f8-9a6d-31d4788387fc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.418101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 590/1177] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:28:51.422633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.433090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa05b4-ce41-4004-964e-3225edd7177f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.437634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.438272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.438544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.438811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] PATH_INFO: `/v3/projects/d9189dc012d54c82bcbb0ff029a69c2e/users/ae4499a7695145cfbae36dc404c1ccb7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.457285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9189dc012d54c82bcbb0ff029a69c2e, user_id=ae4499a7695145cfbae36dc404c1ccb7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.459981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031efd3-e752-4b61-85be-18a6b0ee568e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.648221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 588/1178] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:28:51 2022] PUT /identity/v3/projects/d9189dc012d54c82bcbb0ff029a69c2e/users/ae4499a7695145cfbae36dc404c1ccb7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:28:51.659753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61e51-c269-4ae3-ae0b-a484b0b6b0ea None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.660043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61e51-c269-4ae3-ae0b-a484b0b6b0ea None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.660345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61e51-c269-4ae3-ae0b-a484b0b6b0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.689303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-53f61e51-c269-4ae3-ae0b-a484b0b6b0ea None None] MFA Rules not processed for user `ae4499a7695145cfbae36dc404c1ccb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:28:51.700878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-53f61e51-c269-4ae3-ae0b-a484b0b6b0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:51.755096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 591/1179] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:28:51.769018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd286f-b9e3-4f81-a45d-e41d1e7d20d8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.769827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd286f-b9e3-4f81-a45d-e41d1e7d20d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.769827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd286f-b9e3-4f81-a45d-e41d1e7d20d8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.770923 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 589/1180] 10.222.0.64 () {54 vars in 963 bytes} [Wed Nov 2 12:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:28:51.775839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856afe1b-412f-4574-ad73-17e7dae41a0a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.776127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856afe1b-412f-4574-ad73-17e7dae41a0a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.776408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856afe1b-412f-4574-ad73-17e7dae41a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.838166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-856afe1b-412f-4574-ad73-17e7dae41a0a None None] MFA Rules not processed for user `6b073a335e944427a8560a4864364434`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:28:51.839412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-856afe1b-412f-4574-ad73-17e7dae41a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:51.915208 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 592/1181] 10.222.0.64 () {58 vars in 1060 bytes} [Wed Nov 2 12:28:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:28:51.923560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd286f-b9e3-4f81-a45d-e41d1e7d20d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:51.935000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd286f-b9e3-4f81-a45d-e41d1e7d20d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:51.938540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:51.939135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:51.939410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:51.939683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:51.947784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:51.949222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:51.957933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 590/1182] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:28:52.004533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011db1-5c70-4b76-b32c-f6cd39b12ccc None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:52.004825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011db1-5c70-4b76-b32c-f6cd39b12ccc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:52.005102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011db1-5c70-4b76-b32c-f6cd39b12ccc None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:52.006360 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 593/1183] 10.222.0.64 () {52 vars in 830 bytes} [Wed Nov 2 12:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:28:52.010614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:52.074977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0048a9-d9a4-48a4-8343-0eecf5417906 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:52.079637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:52.080264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:52.080571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:52.080847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] PATH_INFO: `/v3/users/ae4499a7695145cfbae36dc404c1ccb7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:52.082009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4499a7695145cfbae36dc404c1ccb7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:52.083009 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:28:52.083009 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:28:52.083009 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:28:52.084213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:52.387707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4499a7695145cfbae36dc404c1ccb7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:52.512516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4499a7695145cfbae36dc404c1ccb7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:52.538688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4499a7695145cfbae36dc404c1ccb7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:52.549580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:52.554380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4499a7695145cfbae36dc404c1ccb7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:52.555143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4499a7695145cfbae36dc404c1ccb7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:52.561333 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 591/1184] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:28:52 2022] DELETE /identity/v3/users/ae4499a7695145cfbae36dc404c1ccb7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:28:52.565857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:52.566141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:52.566415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:52.586956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:28:52.587275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:52.597283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:52.649273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 594/1185] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:28:52.660782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:52.661261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:52.739017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f25564-5be5-4d29-86af-bc21183fa71a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:52.742699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:52.743289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:52.743567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:52.743839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:52.753174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:52.754794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e274fb-e825-4f8b-9f18-f6e7ebd9cd2a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:52.765061 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 592/1186] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:28:53.290669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:28:53.292136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:28:53.313065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae61ffe-7936-4e11-867e-2642bfd8e6fb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:28:53.313065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:28:53.313065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:28:53.313065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:28:53.313533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] PATH_INFO: `/v3/projects/d9189dc012d54c82bcbb0ff029a69c2e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:28:53.314308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9189dc012d54c82bcbb0ff029a69c2e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:28:53.315616 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:28:53.315616 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:28:53.315616 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:28:53.317425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:28:53.488688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9189dc012d54c82bcbb0ff029a69c2e', 'request_id': 'req-4d40934b-0fc0-444d-9795-c7b2c71b1093'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:53.502230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9189dc012d54c82bcbb0ff029a69c2e', 'request_id': 'req-4d40934b-0fc0-444d-9795-c7b2c71b1093'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:53.614266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9189dc012d54c82bcbb0ff029a69c2e', 'request_id': 'req-4d40934b-0fc0-444d-9795-c7b2c71b1093'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:53.628018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] The token cache is being invalidate because project d9189dc012d54c82bcbb0ff029a69c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:28:53.628318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:53.629000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d40934b-0fc0-444d-9795-c7b2c71b1093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:28:53.630752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 595/1187] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:28:53 2022] DELETE /identity/v3/projects/d9189dc012d54c82bcbb0ff029a69c2e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:29:03.201768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=38 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:03.624528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:16.831798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6fa9-ddf7-4a79-ab78-853afde35ea7 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:16.832378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6fa9-ddf7-4a79-ab78-853afde35ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:16.832378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6fa9-ddf7-4a79-ab78-853afde35ea7 None None] PATH_INFO: `/v3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:16.833572 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 593/1188] 10.222.0.75 () {54 vars in 925 bytes} [Wed Nov 2 12:32:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:32:16.840458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217e2a-0993-43e4-8387-95bd06aa74cd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:16.840943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217e2a-0993-43e4-8387-95bd06aa74cd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:16.841048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20217e2a-0993-43e4-8387-95bd06aa74cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:16.895115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-20217e2a-0993-43e4-8387-95bd06aa74cd None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:32:16.896325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20217e2a-0993-43e4-8387-95bd06aa74cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:32:16.970333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 596/1189] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Nov 2 12:32:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:32:21.064184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f98e-18e9-4fa1-b024-245266b5c68b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:21.064872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f98e-18e9-4fa1-b024-245266b5c68b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:21.065019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98f98e-18e9-4fa1-b024-245266b5c68b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:21.066489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 594/1190] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:32:21.072892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d439a-2d6d-4626-a474-4222f685febf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:21.073447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d439a-2d6d-4626-a474-4222f685febf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:21.073447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d439a-2d6d-4626-a474-4222f685febf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:21.093708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee9d439a-2d6d-4626-a474-4222f685febf None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:32:21.095230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee9d439a-2d6d-4626-a474-4222f685febf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:32:21.105515 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 597/1191] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:32:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:32:21.114293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f98e-18e9-4fa1-b024-245266b5c68b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:32:21.129654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98f98e-18e9-4fa1-b024-245266b5c68b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:32:21.134802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:32:21.135435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:21.135699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:21.135951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:21.145286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:32:21.146893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8019817-8598-40af-812a-8ffa7f5bf24b service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:32:21.158961 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 595/1192] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:32:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:32:25.707298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8f23-f43f-457a-ad0c-5ade161f30fd None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:25.708104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8f23-f43f-457a-ad0c-5ade161f30fd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:25.708104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d8f23-f43f-457a-ad0c-5ade161f30fd None None] PATH_INFO: `/v3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:25.709575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 598/1193] 10.222.0.57 () {54 vars in 925 bytes} [Wed Nov 2 12:32:25 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:32:25.715664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0774c-1b78-4a11-8de0-a2c04265c925 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:25.716237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0774c-1b78-4a11-8de0-a2c04265c925 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:25.716237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0774c-1b78-4a11-8de0-a2c04265c925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:25.736254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-47b0774c-1b78-4a11-8de0-a2c04265c925 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:32:25.738005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47b0774c-1b78-4a11-8de0-a2c04265c925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:32:25.746810 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 596/1194] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Nov 2 12:32:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:32:31.087684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=47 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:35.001064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5961-6004-4c2d-a661-735c9d8f2d3f None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:35.001607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5961-6004-4c2d-a661-735c9d8f2d3f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:35.001607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c5961-6004-4c2d-a661-735c9d8f2d3f None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:35.002979 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 599/1195] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:32:35.008195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa280c-1707-4033-ae1c-6c74f0c923f2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:35.008680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa280c-1707-4033-ae1c-6c74f0c923f2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:35.008779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa280c-1707-4033-ae1c-6c74f0c923f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:35.029280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bfaa280c-1707-4033-ae1c-6c74f0c923f2 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:32:35.030491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bfaa280c-1707-4033-ae1c-6c74f0c923f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:32:35.039724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 597/1196] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:32:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:32:35.047381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5961-6004-4c2d-a661-735c9d8f2d3f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:32:35.062196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c5961-6004-4c2d-a661-735c9d8f2d3f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:32:35.067786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:32:35.068388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:32:35.068701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:32:35.068972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:32:35.077480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:32:35.079074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd547e-5afa-40a3-9679-e6b6edbf00a3 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:32:35.089581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 600/1197] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:32:45.023862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=12 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:45.085562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:01.904067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:01.904655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:01.904655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:01.905992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 598/1198] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:33:01.911684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833be0-5aa6-4728-b5f7-3eefbe92bc37 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:01.912201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833be0-5aa6-4728-b5f7-3eefbe92bc37 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:01.912316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833be0-5aa6-4728-b5f7-3eefbe92bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:01.931328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ca833be0-5aa6-4728-b5f7-3eefbe92bc37 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:33:01.932559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca833be0-5aa6-4728-b5f7-3eefbe92bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:01.992596 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 601/1199] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:33:02.149115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:33:02.151076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:02.258651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e172ff4-145b-47e8-8bd2-434e925e633a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:33:02.264391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:33:02.265030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:02.265307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:02.265612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:02.274335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:33:02.276203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f5c8f-197f-48ea-b2aa-ae9919c81196 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:33:02.285902 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 599/1200] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:33:03.382034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006cf6-9683-4e8b-bb81-3ef94b948c7a None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:03.382681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006cf6-9683-4e8b-bb81-3ef94b948c7a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:03.382681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c006cf6-9683-4e8b-bb81-3ef94b948c7a None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:03.384109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 602/1201] 127.0.0.1 () {54 vars in 901 bytes} [Wed Nov 2 12:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:33:03.390480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69570-b452-40ff-add9-28f7edc0d492 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:03.390999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69570-b452-40ff-add9-28f7edc0d492 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:03.391367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69570-b452-40ff-add9-28f7edc0d492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:03.422970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e8c69570-b452-40ff-add9-28f7edc0d492 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:33:03.424941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e8c69570-b452-40ff-add9-28f7edc0d492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:03.437766 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 600/1202] 127.0.0.1 () {58 vars in 998 bytes} [Wed Nov 2 12:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:33:03.592872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c006cf6-9683-4e8b-bb81-3ef94b948c7a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:33:03.607525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c006cf6-9683-4e8b-bb81-3ef94b948c7a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:33:03.613041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:33:03.613706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:03.613983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:03.614254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:03.622873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:33:03.624478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782e9ef-486a-475f-8b95-951684a91956 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:33:03.634985 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 603/1203] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:33:07.601994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:07.602548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:07.602548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:07.603922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 601/1204] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:33:07.609482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866ea9-1a9b-41a9-add2-c8a2ffdea61a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:07.609971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866ea9-1a9b-41a9-add2-c8a2ffdea61a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:07.610088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866ea9-1a9b-41a9-add2-c8a2ffdea61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:07.630341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6e866ea9-1a9b-41a9-add2-c8a2ffdea61a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:33:07.631662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6e866ea9-1a9b-41a9-add2-c8a2ffdea61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:07.639549 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 604/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:33:07.926528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:33:07.928348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:07.987521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed23dd-492e-49c0-8f0c-db717f5840e8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:33:07.991042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:33:07.991724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:07.992002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:07.992273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:08.001869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:33:08.003293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39173a79-6dc6-4e17-a71f-07b1821c607b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:33:08.012901 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 602/1206] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:33:10.203163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc8d-1e26-4faa-9b50-c69c22242c5d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:10.203699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc8d-1e26-4faa-9b50-c69c22242c5d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:10.203699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005dc8d-1e26-4faa-9b50-c69c22242c5d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:10.205942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 605/1207] 127.0.0.1 () {54 vars in 917 bytes} [Wed Nov 2 12:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:33:10.211551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0364-5a43-421d-908a-73c86dddfd1e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:10.212007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0364-5a43-421d-908a-73c86dddfd1e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:10.212109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff0364-5a43-421d-908a-73c86dddfd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:10.232397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7aff0364-5a43-421d-908a-73c86dddfd1e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:33:10.233640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7aff0364-5a43-421d-908a-73c86dddfd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:33:10.241972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 603/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Nov 2 12:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:33:10.530876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005dc8d-1e26-4faa-9b50-c69c22242c5d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:33:10.542834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005dc8d-1e26-4faa-9b50-c69c22242c5d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:33:10.546852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:33:10.547461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:33:10.547773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:33:10.548012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:33:10.558417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:33:10.561942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe959d62-4856-4f8c-b413-05930c5636b5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:33:10.570135 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 606/1209] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:33:20.227779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=78 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:20.565863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=42 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:08.118221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53848a9f-6714-4808-aa7c-82677acbb61e None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:08.118831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53848a9f-6714-4808-aa7c-82677acbb61e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:08.118831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53848a9f-6714-4808-aa7c-82677acbb61e None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:08.120393 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 604/1210] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:08.126003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cb40-db2e-49a2-a2b9-0865b2350eab None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:08.126554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cb40-db2e-49a2-a2b9-0865b2350eab None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:08.126658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8cb40-db2e-49a2-a2b9-0865b2350eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:08.154080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a6d8cb40-db2e-49a2-a2b9-0865b2350eab None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:08.157566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6d8cb40-db2e-49a2-a2b9-0865b2350eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:08.169793 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 607/1211] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:18.143527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:41.288581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836725b-a4b1-4d5a-9736-d3d01be5dd74 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.289669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836725b-a4b1-4d5a-9736-d3d01be5dd74 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.290177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836725b-a4b1-4d5a-9736-d3d01be5dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.322292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8836725b-a4b1-4d5a-9736-d3d01be5dd74 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.323919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8836725b-a4b1-4d5a-9736-d3d01be5dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.336243 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 605/1212] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:34:41.359182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.360118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.360593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.397934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.399575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.405938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fd97-e724-4143-b65c-6c199b15e985 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.406209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fd97-e724-4143-b65c-6c199b15e985 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.406663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fd97-e724-4143-b65c-6c199b15e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.412198 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 608/1213] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.416378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:41.432918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25134ce9-a552-46a8-b9b3-fd6219df8077 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:41.435996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b209fd97-e724-4143-b65c-6c199b15e985 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.437346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b209fd97-e724-4143-b65c-6c199b15e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.441533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:41.442400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.442834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.443268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.444067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:41.444556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:41.446338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:41.457515 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 606/1214] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 02 12:34:41.466959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 609/1215] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:41.469250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92e92-d8d1-41df-897a-7bde6a85acba None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.469727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92e92-d8d1-41df-897a-7bde6a85acba None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.470179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92e92-d8d1-41df-897a-7bde6a85acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.474739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:41.491174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1b82a-71de-4e21-8fef-e3ebb45d1a29 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:41.503041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:41.504068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.504571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.505003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.505798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:41.506217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-83b92e92-d8d1-41df-897a-7bde6a85acba None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.507239 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:34:41.507239 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:34:41.507239 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:34:41.507532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-83b92e92-d8d1-41df-897a-7bde6a85acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.509018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40090f6a-9f91-4a03-a46a-683c9ee64aa5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:41.538509 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 607/1216] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.542044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.542044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.542044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.574468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.575713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.586881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 608/1217] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.587752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:41.601610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf1390-ac83-4baa-86c5-f802a2ddccc6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:41.606672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:41.607301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.607580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.607850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.608537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:41.608845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:41.609884 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:34:41.609884 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:34:41.609884 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:34:41.610907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555599-4364-4777-ad6c-8041bfcd07c7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:41.626127 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 609/1218] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:41.627777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb760-b961-43b8-8cee-cccbcf955d3f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.628063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb760-b961-43b8-8cee-cccbcf955d3f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.628332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107cb760-b961-43b8-8cee-cccbcf955d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.650639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-107cb760-b961-43b8-8cee-cccbcf955d3f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.652153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-107cb760-b961-43b8-8cee-cccbcf955d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.661438 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 610/1219] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.662961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19added2-b6ca-411e-88a4-ddcffdfbba76 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.663248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19added2-b6ca-411e-88a4-ddcffdfbba76 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.663518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19added2-b6ca-411e-88a4-ddcffdfbba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.685476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-19added2-b6ca-411e-88a4-ddcffdfbba76 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.686696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-19added2-b6ca-411e-88a4-ddcffdfbba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.696195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 611/1220] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.697484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.697816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.698116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.710926 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 610/1221] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:41.712693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3554057-04d7-4a82-9591-f9ba1733464d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.720297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3554057-04d7-4a82-9591-f9ba1733464d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.720297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3554057-04d7-4a82-9591-f9ba1733464d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.722726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.724822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.737297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b3554057-04d7-4a82-9591-f9ba1733464d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.738950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3554057-04d7-4a82-9591-f9ba1733464d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.806018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 612/1222] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.806799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:41.818014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d1b35-b2f8-41bd-bef0-7a8007742cca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:41.822075 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 611/1223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.823395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3b17-87ec-4ccc-8ae5-3cbae7f0f096 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.823681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3b17-87ec-4ccc-8ae5-3cbae7f0f096 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.824031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb3b17-87ec-4ccc-8ae5-3cbae7f0f096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.830238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:41.830862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.831355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.831611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.832249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:41.834510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b750b-4c08-43c9-a50f-643721eb8b00 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:41.845575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-64fb3b17-87ec-4ccc-8ae5-3cbae7f0f096 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.846782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-64fb3b17-87ec-4ccc-8ae5-3cbae7f0f096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.855751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 612/1224] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.857044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.857322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.857611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.878903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.880096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:41.888166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 613/1225] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:41.888808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:41.899753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5892be-b58c-40e2-b590-59e3703c0594 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:41.904380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:41.905006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.905276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.905541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.906167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:41.908124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078a2de-512e-4fd4-867e-9a835b8401a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:41.959386 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 613/1226] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:41.960707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:41.960997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:41.961259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:41.981269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:41.982559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:42.005110 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 614/1227] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.006363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.006648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.006925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.027248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:42.028457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:42.045045 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 614/1228] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:42.046012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.056932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3e6cb-50dc-4d1d-9719-f3e55ce368e4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.063081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.063554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.064633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.065038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.066276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.066578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.068324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b8bb8-a29d-4f94-9fe8-c3421f493a79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.080385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 615/1229] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.081667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.081947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.082214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.098643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 615/1230] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:42.099751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.106303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:42.108044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:42.109667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff2195a-2997-4738-832e-d5897cc98949 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.114840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.115462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.115753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.115998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.116662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.116763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 616/1231] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:42.116960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.117566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.118557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.127847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7565b-e6c1-460e-b56b-49dec1ca9b5c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.131805 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 616/1232] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.132630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.132844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.133469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.133739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.134001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.134637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.134934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.136587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.138222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:42.143940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4408df0-1d33-44ac-8865-a86526122f5f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.148742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.149594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.149719 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 617/1233] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.149869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.150134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.150562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.150811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.152758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0602b-7f33-4d28-8b51-05269aa8dd30 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.169754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5c98f-b496-4687-884b-9d21c65f863d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.175207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.175813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.176090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.176365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.177048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.178673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992a766-009e-49ec-8087-5e825e11c331 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.190595 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 618/1234] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:42.192022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.192306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.192622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.212250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:42.214097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:42.221969 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 619/1235] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:42.222719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.231936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c5085-eef2-41cc-b713-8d171accca17 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.237030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.237616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.237894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.238183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.238790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.240703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.272124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:42.287875 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 617/1236] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.290215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.290699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.291185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.312024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:42.313197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:42.321105 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 618/1237] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:42.322014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.331316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b5c49-ba68-43a5-8778-fc5b93f8f191 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.336036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.336659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.336942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.337213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.337847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.338148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.339801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.352176 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 619/1238] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.353160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.363553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714b459-c832-4b28-ba65-c537dc058515 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.368440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.372270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.372270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.372270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.372270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.372270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.400123 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 620/1239] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/projects => generated 369 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.401134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.467053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78459c7-0690-4fa6-8c3c-66be974edc84 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.472242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.473046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.473325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.473594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.474219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.476157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.530832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 620/1240] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.532541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.602025 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 621/1241] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.602025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.618419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fa4c9-fe06-4278-ad6f-556d16ac21ab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.680570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0aef77-5362-4949-8028-3361551c0cdd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.681122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.681738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.682012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.682301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.682909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.684526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.685537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.686048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.686325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.686595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.687234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.687643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.689221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.695326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 621/1242] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:42.696355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.708765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 622/1243] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.708765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.711218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acefa5e-347e-4abb-8496-55cc35859d16 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.715427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff7872-3bd3-44e5-80a4-c2f1a739c3b9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.716294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.717076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.717381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.717649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.718289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.719998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.720136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.721328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.721609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.721880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.722513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:42.722810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.724404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.731253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 622/1244] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:42.732095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.737247 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 623/1245] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:42.738125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.745096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196c357-8c82-40bb-acff-423d48a32c5d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.750825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.751620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.751900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.752164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.753027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.754738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.756211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c42ea8-59be-4183-b3b2-f7221d998280 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.761897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.762602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.762881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.763146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.763767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.764810 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:34:42.764810 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:34:42.764810 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:34:42.766012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.873129 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 624/1246] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.873728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.877420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 623/1247] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:42.878217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:42.880593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:42.884585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb1552-f3f7-403f-8166-5096ff535fa2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.910122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:42.943335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2dcd3-8d22-4c58-893a-e51ac5d691da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:42.946879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.947519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.947790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.948024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:42.948151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.948650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:42.948751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.949013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:42.949199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:42.949821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:42.950662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:42.951727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.054258 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 625/1248] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.055099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.066266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fd527-039e-4d37-affa-c61707e5e223 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.070949 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 624/1249] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:42 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.070949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.071159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.071682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.071956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.072350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] PATH_INFO: `/v3/projects/1dbe11c2ed6c436caf0eb7c8da9beed5/users/f441720944f34d6dad78783005fa6165/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.079217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82f04-750e-4785-8806-5890632bf1d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.084997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.085653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.086072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.086203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.086803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.088571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbe11c2ed6c436caf0eb7c8da9beed5, user_id=f441720944f34d6dad78783005fa6165, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.088806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.091280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.152975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 626/1250] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:43 2022] PUT /identity/v3/projects/1dbe11c2ed6c436caf0eb7c8da9beed5/users/f441720944f34d6dad78783005fa6165/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:43.153734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.182760 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 625/1251] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.183593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.219114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e909fc2-fdf3-494d-842f-5d2ad74ea359 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.249981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4be3c-433c-48b6-baf9-a2f3d5f6ca2a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.255250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.255813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.256092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.256362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.257025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.258971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.278188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.278831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.279079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.279348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.279985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.282083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.292571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 627/1252] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.293507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.303843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012f39-aad5-4ce5-aebd-4646b92dc20a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.308578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.314820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.314820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.314820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.314820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.314820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.317925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:43.322844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 628/1253] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.323652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.333189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc4aa2-f030-4510-b066-b2b0aa71bd13 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.338652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.347203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.347203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.347203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.347203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.347203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f7fe9-9504-4589-9f87-2b57e91c2919 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.347668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 626/1254] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.347668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.414455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0b61d-ded6-4c57-b1c5-297e67cb831d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.419343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.419944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.420215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.420482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.421151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.422743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.433563 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 627/1255] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.434399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.444804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748fe3-8d93-4702-b5b8-9a6e292513b3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.449920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.450521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.450791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.451058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.451696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.453313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.456089 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 629/1256] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.461008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348823b-281d-4ced-8238-17146b469b7c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.471871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348823b-281d-4ced-8238-17146b469b7c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.471871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348823b-281d-4ced-8238-17146b469b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.472102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 628/1257] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.472102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.472102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:43.476000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198365f-308f-4740-b4e3-fffcfc871dbd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.480711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.481304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.481582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.481849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.482465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.484378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.492675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6348823b-281d-4ced-8238-17146b469b7c None None] MFA Rules not processed for user `f441720944f34d6dad78783005fa6165`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:43.494283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6348823b-281d-4ced-8238-17146b469b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:43.560183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 630/1258] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:43.561066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348823b-281d-4ced-8238-17146b469b7c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.572430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348823b-281d-4ced-8238-17146b469b7c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.577477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.578138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.584401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.584401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] PATH_INFO: `/v3/projects/116c14805ca74d0b81b03f070c3083f3/users/820f7a63f6f241a7aba8f3df4903d7b3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.593678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=116c14805ca74d0b81b03f070c3083f3, user_id=820f7a63f6f241a7aba8f3df4903d7b3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.596393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.621382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 629/1259] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.624631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.632725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed3e5-e9fb-4945-88da-40b0e3d89f9c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.637398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.637998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.638275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.638616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.639243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.640935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.652150 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 630/1260] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.653420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.663044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1d913-224a-40fa-ab72-b004f328bf00 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.668034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.668597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.668887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.669136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.669752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.671660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.724316 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 631/1261] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:43 2022] PUT /identity/v3/projects/116c14805ca74d0b81b03f070c3083f3/users/820f7a63f6f241a7aba8f3df4903d7b3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:43.725425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.760754 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 631/1262] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.761582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.772227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71c664-288a-41be-a146-ff1418bce8ef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.795495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554fbfad-66e5-4b2f-bcbc-60179db81f1f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.800299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.807024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.807024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.807024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.807024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.807024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.814947 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 632/1263] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.815796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.825715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba16a45-b1c2-4d27-ae9d-40aa5f135e28 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.831203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.831807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.835538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.835538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.835538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.835538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.835901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.835901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.835901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.835901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.836335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.837975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.848845 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 633/1264] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.848845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.853569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 632/1265] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.854596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.857571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf0c71-1748-4480-bb2b-a18b73c250da admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.862542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.863159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.863436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.863706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.864343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.866054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd4af2-04e4-41ef-9a6e-9a701badf23a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.866373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d510747-98e8-44a9-9c3a-c130afab5930 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.871313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.872028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.872312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.872614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.873264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.874864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.887326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 633/1266] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:43.888163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:43.898964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec75c8-d3c6-4f9c-87b0-95499363a627 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:43.910351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:43.910351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.910351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.910351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] PATH_INFO: `/v3/projects/ec1f83e438e14c6ebc6fbc76eb088d3b/users/b58c89aba586474596f7c5e0640e8e96/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.920786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1f83e438e14c6ebc6fbc76eb088d3b, user_id=b58c89aba586474596f7c5e0640e8e96, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:43.923594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:43.977031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 634/1267] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:43.978370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:43.978653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:43.978921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:43.999364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:44.005012 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 634/1268] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:43 2022] PUT /identity/v3/projects/ec1f83e438e14c6ebc6fbc76eb088d3b/users/b58c89aba586474596f7c5e0640e8e96/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:44.010492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.010638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] MFA Rules not processed for user `820f7a63f6f241a7aba8f3df4903d7b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:44.010638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:44.073847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f0043-0cc0-40da-96fd-11f6ee26637c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.077332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 635/1269] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:44.078298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.078830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.079518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.079879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.080176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.081040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.082794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.090235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8ca9-74d1-41b9-8208-2bcd358c2484 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.093815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 635/1270] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:44.094633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.098108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.104582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.104582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.104582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] PATH_INFO: `/v3/projects/8af2442a3c354aaf9656274f1411489a/users/0e480db9b2d24e24aca55712f935edb9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.104861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb957545-6282-4978-afd9-c56a21c0fc5c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.109849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.110559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.111393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.111671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] PATH_INFO: `/v3/projects/29917aa964c94f018bdc7cc587f35032/users/f11725e56de34281bb4c5cf6fdd34217/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.116807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af2442a3c354aaf9656274f1411489a, user_id=0e480db9b2d24e24aca55712f935edb9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.119651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.125223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:44.129628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29917aa964c94f018bdc7cc587f35032, user_id=f11725e56de34281bb4c5cf6fdd34217, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.132382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.233565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 636/1271] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:44 2022] PUT /identity/v3/projects/8af2442a3c354aaf9656274f1411489a/users/0e480db9b2d24e24aca55712f935edb9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:44.234360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.267413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 636/1272] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:44 2022] PUT /identity/v3/projects/29917aa964c94f018bdc7cc587f35032/users/f11725e56de34281bb4c5cf6fdd34217/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:44.274854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.308350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41137-95bc-4ad3-baa6-ecb6dfd1bd8e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.341863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5897763-ba0b-4be5-b55f-e143c5f4b672 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.347239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.347799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.348095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.348363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.349036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.350661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.363267 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 637/1273] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:44.364234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.374329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a57c0b-5552-4277-a3e7-e8559b19fb6c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.375313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.376174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.377254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.377628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.378487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.379679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.380275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.380583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.380757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c536e4-c41f-4832-9e55-3c515c9bf936 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.380919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.381471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.383391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.392438 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 637/1274] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:44.397811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.397811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.397811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.422829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] MFA Rules not processed for user `b58c89aba586474596f7c5e0640e8e96`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:44.424592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:44.434085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:44.491417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 638/1275] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:44.492277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.502695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945caf2f-2cc0-4521-a73f-126f9ebe3d6b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.507326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.507922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.508202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.508471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.509140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.511101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8e23b-759f-4198-9593-cd6397f3ca3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.529651 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 638/1276] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:44.530574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.541113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3db6-0e51-4742-b2a4-a9f773d3f2b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.545814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.546417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.546696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.546967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.547609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.549889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05fa4-90d0-47fb-9d02-81f22fcf2eea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.560961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 639/1277] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:44.562353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.562639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.569301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.590570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] MFA Rules not processed for user `0e480db9b2d24e24aca55712f935edb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:44.596040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:44.676256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 639/1278] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:44.676516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 640/1279] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:44.676623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.676623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.676623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.676850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.688719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bf8eb-91f9-45f4-b5c6-14e59b7c483a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.703906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] MFA Rules not processed for user `f11725e56de34281bb4c5cf6fdd34217`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:44.705175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:44.737656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:44.750698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.750698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.750698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.750698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] PATH_INFO: `/v3/projects/1e2a6e2acadb47809775637d3fa84cae/users/be91377957ed4c9d831820481ff84651/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.767642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2a6e2acadb47809775637d3fa84cae, user_id=be91377957ed4c9d831820481ff84651, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.770480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.773556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 640/1280] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:44.774642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.785997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a6f2f-bf3e-4761-9b9d-a2e4513ab8d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.796692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.796692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.796692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.796692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] PATH_INFO: `/v3/projects/8ea3b8ac6b104721ba07c7b85bbb64aa/users/936480fc35244d79a3ec7157060a1dbc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.807477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea3b8ac6b104721ba07c7b85bbb64aa, user_id=936480fc35244d79a3ec7157060a1dbc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.810231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.878484 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 641/1281] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:44 2022] PUT /identity/v3/projects/1e2a6e2acadb47809775637d3fa84cae/users/be91377957ed4c9d831820481ff84651/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:44.878743 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 641/1282] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:44 2022] PUT /identity/v3/projects/8ea3b8ac6b104721ba07c7b85bbb64aa/users/936480fc35244d79a3ec7157060a1dbc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:44.885928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.887169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.945374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:44.956577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962dbb-dac3-4578-9126-7150e0fbbce9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.959436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd704-bce6-497c-a3b8-6512bf46199b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.961709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.961857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.962318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.962446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.962589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.962698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.962867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.963017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:44.963507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.963619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:44.965326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.965476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:44.976784 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 642/1283] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:44.977624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:44.989207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cc6ab-32e7-4d4b-b2c3-d64c1344a28a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:44.994163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:44.994822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:44.995094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:44.995360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] PATH_INFO: `/v3/projects/4b354427d3614810b91ec1065d1ef4b3/users/66d279ff5f984ea7b59c989656b949ee/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.014036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b354427d3614810b91ec1065d1ef4b3, user_id=66d279ff5f984ea7b59c989656b949ee, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.014036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.108058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 642/1284] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:44 2022] POST /identity/v3/projects => generated 371 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:45.108910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.141369 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 643/1285] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:44 2022] PUT /identity/v3/projects/4b354427d3614810b91ec1065d1ef4b3/users/66d279ff5f984ea7b59c989656b949ee/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:45.142712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.181088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c8b56-8e08-4c4e-8b55-8230319fb9f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.217972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6d7a-ed90-46af-9b82-eb77bcc63e14 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.223010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.223649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.223921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.224189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.224934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.226850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.242172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.242783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.243065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.243322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.243945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.245909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739164d-f5f5-4445-a86e-a7ae76bcbb6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.257601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:45.342287 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 644/1286] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/projects => generated 397 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:45.343332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.369977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 643/1287] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:45.371474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c50-bca4-4ecb-b548-5cb5f075a0f1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.371759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c50-bca4-4ecb-b548-5cb5f075a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.372029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707c50-bca4-4ecb-b548-5cb5f075a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.404000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9c707c50-bca4-4ecb-b548-5cb5f075a0f1 None None] MFA Rules not processed for user `be91377957ed4c9d831820481ff84651`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:45.405285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c707c50-bca4-4ecb-b548-5cb5f075a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:45.415435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6acd4a-b7d1-40ad-b535-d608d03af8ef admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.420212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.420861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.421121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.421392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.422024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.424009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.477915 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 644/1288] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:45.479325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.479612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.479891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.508845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] MFA Rules not processed for user `936480fc35244d79a3ec7157060a1dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:45.510058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:45.577854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 645/1289] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:45.578740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.583712 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 645/1290] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:45.587583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.598831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f408275-2ca7-4740-80f7-0b8a6e694faf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.628861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:45.651800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49f781-8b78-4b1e-99e5-2e7900ba4aae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.656830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.657641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.657994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.658186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.658882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.660852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b711889-9337-4929-bcf3-2b7f173a194c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.661939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.662906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.663203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.663476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] PATH_INFO: `/v3/projects/da4a89bac5d84ce9a561087ded7b5a28/users/9a4a4a42922f4f5fa91e71cc8030f318/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.679688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4a89bac5d84ce9a561087ded7b5a28, user_id=9a4a4a42922f4f5fa91e71cc8030f318, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.682657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.685893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:45.804234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 646/1291] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:45.805692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.805956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.806225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.832118 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 646/1292] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:45 2022] PUT /identity/v3/projects/da4a89bac5d84ce9a561087ded7b5a28/users/9a4a4a42922f4f5fa91e71cc8030f318/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:45.832992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.838035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] MFA Rules not processed for user `66d279ff5f984ea7b59c989656b949ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:45.839344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:45.896640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688030-3d4f-4814-beaf-c3bfe3afd517 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.901720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.902382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.902696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.903050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.903612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.905594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.905862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 647/1293] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:45.906712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.920131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e1c2e-ee93-4e20-b12b-ba6bf1333461 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.925291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.928956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.928956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.928956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.928956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.928956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:45.940320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 648/1294] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:45.941319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:45.951041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f3030-891e-4a35-92d4-35e567821cfa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:45.955674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:45.956409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:45.956725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:45.956997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:45.957622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:45.959546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.020748 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 647/1295] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.264988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.264988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a6384e-b10f-4c13-b829-f6e36565ea87 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.264988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.264988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.265567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.265567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.265567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.265567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.265881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 649/1296] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:45 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.265881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.265881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78368df5-1af1-4b31-91a8-a948e4bf4bc6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.265881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.266204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.266204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.266204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.266204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.266204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.266558 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 648/1297] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.266558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.266558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607908-56eb-4fe1-8240-328680b55838 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.266558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.267261 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 649/1298] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:46.268248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.271497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262d80-4447-4bf4-bf10-0c8bb88049da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.273623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 650/1299] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.274875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.278121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.278791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.279157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.279508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.280221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.282109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.287465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a282de5-415d-4566-b6e9-2a9337bf468c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.293055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.293803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.294081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.294350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.295149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.295976 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 650/1300] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:46.296875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.297521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.310461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:46.311451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8752eec-3244-465d-a7cc-7f2531b0178a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.317282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.318038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.318523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.318827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] PATH_INFO: `/v3/projects/c57c40979ba04bd3aff9de517fafd4be/users/93b8a0d6e1dc41fdbb298df3de075310/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.337067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57c40979ba04bd3aff9de517fafd4be, user_id=93b8a0d6e1dc41fdbb298df3de075310, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.339974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.541377 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 651/1301] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:46 2022] PUT /identity/v3/projects/c57c40979ba04bd3aff9de517fafd4be/users/93b8a0d6e1dc41fdbb298df3de075310/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:46.545607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.545737 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 651/1302] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/projects => generated 391 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.545737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.579425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:46.609783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08f1c6-1855-4f98-b8db-862b2807ef9b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.615128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.615750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.616026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.616300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.616967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.617773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c558a-10e9-46d8-944e-072b110e9c3b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.618911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.622722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.623325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.623601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.623869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.624836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.627155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.639852 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 652/1303] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:46.640907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.651076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359673d9-a126-4d39-9cfc-d0ab1075877f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.655791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.656402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.656715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.656989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.657647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.661733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.752330 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 653/1304] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.755877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 652/1305] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/users => generated 298 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:46.756035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.756119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.763961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ce7ab-19f1-4ae2-9763-fa362b018e9e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.764632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d3c7f-c34e-487b-91a7-086271082136 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.768946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.773589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.773690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.773783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.773783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] PATH_INFO: `/v3/projects/aeaa8197489f41228db96de700e66d5f/users/771b9af5720446e796ea335ba5ac2f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.774189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.774189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.774189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.774189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.774189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.784573 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 653/1306] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:46.785400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.790158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaa8197489f41228db96de700e66d5f, user_id=771b9af5720446e796ea335ba5ac2f37, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.793065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.795754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53eb94b-ec81-44ef-a0e9-d6c0dd2f13d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.801635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.802289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.802570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.802838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] PATH_INFO: `/v3/projects/da4a89bac5d84ce9a561087ded7b5a28/users/9a4a4a42922f4f5fa91e71cc8030f318/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.804755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4a89bac5d84ce9a561087ded7b5a28, user_id=9a4a4a42922f4f5fa91e71cc8030f318, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.807377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.819278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 654/1307] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:46 2022] PUT /identity/v3/projects/da4a89bac5d84ce9a561087ded7b5a28/users/9a4a4a42922f4f5fa91e71cc8030f318/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:46.820089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.881936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78440712-5234-4390-a95d-f0649c9ad05e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.901496 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 654/1308] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:46 2022] PUT /identity/v3/projects/aeaa8197489f41228db96de700e66d5f/users/771b9af5720446e796ea335ba5ac2f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:46.903523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.945470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.946085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.946358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.946632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.947272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.948916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.951719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:46.960187 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 655/1309] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:46.965105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:46.971160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637c67-f263-4009-a5c8-78c9da019403 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.976668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.977333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.977607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.977873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] PATH_INFO: `/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f/users/ebabe3e4fbdc48948f3d1b929cf175e4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.978155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c29536-05ad-4c1d-893e-cb88aa71acf8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:46.983301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:46.983929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:46.984236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:46.984550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:46.985190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.987886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:46.997236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153dd8a07bdd4e33a3f9b25bb6a4216f, user_id=ebabe3e4fbdc48948f3d1b929cf175e4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:46.999967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.095655 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 655/1310] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:46 2022] POST /identity/v3/users => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:47.096660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.107197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f00c7-e7a5-4271-bf6f-5030cb726be9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.111280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 656/1311] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:46 2022] PUT /identity/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f/users/ebabe3e4fbdc48948f3d1b929cf175e4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.112286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.171599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.172255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.172578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.172854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.173502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.175130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.178782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e9ca2-df7b-4b29-9d68-e8968e71bb51 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.183524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.184061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.184339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.184644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.185288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.185531 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 656/1312] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.186356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.186901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f938c369-b44b-470b-ad94-e000d3a0abe8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.194584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.198055 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 657/1313] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.198598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31368f-0ad7-481e-9aca-b59612c8c11b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.199321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.199605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.199878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.205724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.206466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.206741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.207715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] PATH_INFO: `/v3/projects/3b7b7091899e4e29bca40e58f64dd29b/users/16d2849a12cd40bbb563bfe5704e7d71/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.222977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7b7091899e4e29bca40e58f64dd29b, user_id=16d2849a12cd40bbb563bfe5704e7d71, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.225856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.231025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] MFA Rules not processed for user `9a4a4a42922f4f5fa91e71cc8030f318`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:47.232263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:47.300601 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 657/1314] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/3b7b7091899e4e29bca40e58f64dd29b/users/16d2849a12cd40bbb563bfe5704e7d71/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.301454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.311500 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 658/1315] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:47.311500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.318336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce385df-30f8-4fde-b76f-b917d6775546 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.378198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.382085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943072af-6af8-4fb9-9434-edb3cc7544bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.385158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.386091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.386476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.386851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] PATH_INFO: `/v3/projects/c57c40979ba04bd3aff9de517fafd4be/users/93b8a0d6e1dc41fdbb298df3de075310/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.388877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57c40979ba04bd3aff9de517fafd4be, user_id=93b8a0d6e1dc41fdbb298df3de075310, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.389111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.390112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.391093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.391093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.391093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.392812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.393748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.404866 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 659/1316] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/c57c40979ba04bd3aff9de517fafd4be/users/93b8a0d6e1dc41fdbb298df3de075310/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.409817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.409962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 658/1317] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.409962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.419736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc8d02-c9f8-43f4-bfc5-b079cc0a55a4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.475734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dede79-c1eb-42e1-9fb9-9a4e867eff8f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.480465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.481160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.481438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.481697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.482403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.485434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.489420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.490066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.490341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.490610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.491256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.493145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.494740 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 660/1318] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.495589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.508453 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 659/1319] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.508668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65494085-43d8-447c-8fc7-da63c0b7f5b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.508755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.511184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.511910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.512190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.512627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] PATH_INFO: `/v3/projects/ce520fe76a5a45d48a9e662aa39d5472/users/b7d62a0f07884920998ea025a2c6c968/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.524187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf82946-99e0-45fe-96a8-ddcc21700a2a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.529319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.530102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.530383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.530654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] PATH_INFO: `/v3/projects/da11f64e6f1b4cf09620b34136d0f57f/users/e423a70a8c7841a59e86b96cf3187e2d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.534045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce520fe76a5a45d48a9e662aa39d5472, user_id=b7d62a0f07884920998ea025a2c6c968, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.536722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.548738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da11f64e6f1b4cf09620b34136d0f57f, user_id=e423a70a8c7841a59e86b96cf3187e2d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.551826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f97807-e7b6-47fd-8589-05437f5cd643 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.608555 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 661/1320] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/ce520fe76a5a45d48a9e662aa39d5472/users/b7d62a0f07884920998ea025a2c6c968/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.609535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.637296 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 660/1321] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/da11f64e6f1b4cf09620b34136d0f57f/users/e423a70a8c7841a59e86b96cf3187e2d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.639207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158904-9c0d-4fba-9e68-d33de3f1c735 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.639494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158904-9c0d-4fba-9e68-d33de3f1c735 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.639802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96158904-9c0d-4fba-9e68-d33de3f1c735 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.641237 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 661/1322] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:47.642058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158904-9c0d-4fba-9e68-d33de3f1c735 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.675856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dddca-4ae0-4037-8821-9c5892078719 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.695004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.711975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96158904-9c0d-4fba-9e68-d33de3f1c735 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.716945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.717607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.717883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.718154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] PATH_INFO: `/v3/projects/aeaa8197489f41228db96de700e66d5f/users/771b9af5720446e796ea335ba5ac2f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.720152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeaa8197489f41228db96de700e66d5f, user_id=771b9af5720446e796ea335ba5ac2f37, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.722933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e232c6-0b5f-4b32-bf99-505a3668a39e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.734975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.745181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.745366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 662/1323] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/aeaa8197489f41228db96de700e66d5f/users/771b9af5720446e796ea335ba5ac2f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.745453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.745453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.745453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.745668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.745668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.745668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.745841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.750830 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 662/1324] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:47.752261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.758861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.764156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09958137-aaf1-4c53-8375-08a05177d449 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.769971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] MFA Rules not processed for user `93b8a0d6e1dc41fdbb298df3de075310`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:47.771279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:47.825955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.826626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.826902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.827522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] PATH_INFO: `/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e/users/749bc80ccf4d4591bac738bf6d3c02f0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.842250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b91a5c012a4f4fbbb9fb1b86ffa22e, user_id=749bc80ccf4d4591bac738bf6d3c02f0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.845072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.850466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 663/1325] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:47.850466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.857191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348d82f-8b59-4a92-82fb-7c80f50e095e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.863577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:47.864613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:47.864853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:47.865229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] PATH_INFO: `/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f/users/ebabe3e4fbdc48948f3d1b929cf175e4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:47.867408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=153dd8a07bdd4e33a3f9b25bb6a4216f, user_id=ebabe3e4fbdc48948f3d1b929cf175e4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:47.872216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:47.882542 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 664/1326] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f/users/ebabe3e4fbdc48948f3d1b929cf175e4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.883421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.924446 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 663/1327] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:47 2022] PUT /identity/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e/users/749bc80ccf4d4591bac738bf6d3c02f0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:47.925530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:47.955439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c283-fda7-4bcd-87fd-b2890acf5004 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:47.998371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88cc59-e1b5-44f4-b589-dd0a555f06a7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.003923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.004569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.004877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.005150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.005785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.007405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f5ece-0ab2-4d8a-95f0-a273ebc0c0e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.017854 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 664/1328] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:48.019196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.019480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.019754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.022001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.022621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.022918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.023144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.023782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.025654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f334256-526b-4a79-be3e-94dbcb70724a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.028414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.037411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 665/1329] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:48.038658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703940-e4de-4f84-8e34-9d25b178939e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.038926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703940-e4de-4f84-8e34-9d25b178939e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.039193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f703940-e4de-4f84-8e34-9d25b178939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.065446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.066691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.068856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1f703940-e4de-4f84-8e34-9d25b178939e None None] MFA Rules not processed for user `771b9af5720446e796ea335ba5ac2f37`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.070058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1f703940-e4de-4f84-8e34-9d25b178939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.138203 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 665/1330] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.139216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.144567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.146528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 666/1331] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.147826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae205a-c6a2-4174-b23b-5baef29dbdec None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.148109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae205a-c6a2-4174-b23b-5baef29dbdec None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.148370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae205a-c6a2-4174-b23b-5baef29dbdec None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.150216 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 667/1332] 10.222.0.64 () {54 vars in 961 bytes} [Wed Nov 2 12:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:48.151480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.151769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.152042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.156740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fe44b-2a06-4cc5-85cf-4da59f36f171 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.163154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.166868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.166868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.166868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] PATH_INFO: `/v3/projects/3b7b7091899e4e29bca40e58f64dd29b/users/16d2849a12cd40bbb563bfe5704e7d71/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.166868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7b7091899e4e29bca40e58f64dd29b, user_id=16d2849a12cd40bbb563bfe5704e7d71, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.169506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.181439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 666/1333] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:48 2022] PUT /identity/v3/projects/3b7b7091899e4e29bca40e58f64dd29b/users/16d2849a12cd40bbb563bfe5704e7d71/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:48.182275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.193397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] MFA Rules not processed for user `ebabe3e4fbdc48948f3d1b929cf175e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.194633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.249941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5565c1-e3ba-48e6-9870-1791452e6642 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.254840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.255477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.255747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.256015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.256715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.258441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.274333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 668/1334] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.274333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.275393 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 667/1335] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:48.276922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.286446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2ac55-d67f-4c6a-acd8-4bb6c8894bc6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.287557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678f9d8-8be6-409c-a4d5-c52202ceeb40 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.291058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.291721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.292000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.292141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.292254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] PATH_INFO: `/v3/projects/da11f64e6f1b4cf09620b34136d0f57f/users/e423a70a8c7841a59e86b96cf3187e2d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.292821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.293133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.293409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] PATH_INFO: `/v3/projects/ce520fe76a5a45d48a9e662aa39d5472/users/b7d62a0f07884920998ea025a2c6c968/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.294310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da11f64e6f1b4cf09620b34136d0f57f, user_id=e423a70a8c7841a59e86b96cf3187e2d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.295721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce520fe76a5a45d48a9e662aa39d5472, user_id=b7d62a0f07884920998ea025a2c6c968, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.297213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.321089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6060f2-cac3-4126-9e48-2caf7047da33 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.321236 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 669/1336] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:48 2022] PUT /identity/v3/projects/da11f64e6f1b4cf09620b34136d0f57f/users/e423a70a8c7841a59e86b96cf3187e2d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:48.321236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.321366 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 668/1337] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:48 2022] PUT /identity/v3/projects/ce520fe76a5a45d48a9e662aa39d5472/users/b7d62a0f07884920998ea025a2c6c968/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:48.321366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa15b-4538-40b5-b0be-6af9475a159e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.321366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa15b-4538-40b5-b0be-6af9475a159e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.321366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fa15b-4538-40b5-b0be-6af9475a159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.339946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f59fa15b-4538-40b5-b0be-6af9475a159e None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.341260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f59fa15b-4538-40b5-b0be-6af9475a159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.393722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.413239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3b7f-1143-4b63-b57a-25103d062ae0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.418985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.420126 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 669/1338] 10.222.0.64 () {58 vars in 1058 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.420348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.420682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.421211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.421422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c1a5-0b90-43c1-aedb-b338ea609208 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.421790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c1a5-0b90-43c1-aedb-b338ea609208 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.421968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820c1a5-0b90-43c1-aedb-b338ea609208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.455318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e820c1a5-0b90-43c1-aedb-b338ea609208 None None] MFA Rules not processed for user `16d2849a12cd40bbb563bfe5704e7d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.456465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e820c1a5-0b90-43c1-aedb-b338ea609208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.497409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.499289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.508104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.516739 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 670/1339] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:48.517946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.528277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 670/1340] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.529934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.530223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.530496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.564366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] MFA Rules not processed for user `e423a70a8c7841a59e86b96cf3187e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.565620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.589287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2ad4-1a4a-4043-bb88-dd9da2a70dc1 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.594471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.596077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.596458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.596857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] PATH_INFO: `/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e/users/749bc80ccf4d4591bac738bf6d3c02f0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.598977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b91a5c012a4f4fbbb9fb1b86ffa22e, user_id=749bc80ccf4d4591bac738bf6d3c02f0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.601919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76842ca-a160-4daf-a92b-711bcb41bd63 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.614898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 671/1341] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:48 2022] PUT /identity/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e/users/749bc80ccf4d4591bac738bf6d3c02f0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:48.616413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a917-f975-465e-8477-048c1c542def None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.616816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a917-f975-465e-8477-048c1c542def None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.617220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a917-f975-465e-8477-048c1c542def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.652431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1c24a917-f975-465e-8477-048c1c542def None None] MFA Rules not processed for user `b7d62a0f07884920998ea025a2c6c968`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.654001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c24a917-f975-465e-8477-048c1c542def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.658882 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 671/1342] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.659705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.674487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f2bc0-2d82-4186-96ab-03e3fcafd1d7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.746786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 672/1343] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.748147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.748387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.748674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.748991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.750028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.750417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.750759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.762813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.779083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] MFA Rules not processed for user `749bc80ccf4d4591bac738bf6d3c02f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.780475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.823537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.824886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909f0ba-13d1-4051-9575-79f7e7b564fb service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.835583 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 672/1344] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:48.836915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.837255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.837525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.851520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.858324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] MFA Rules not processed for user `936480fc35244d79a3ec7157060a1dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:48.864592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:48.871023 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 673/1345] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.871874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:48.886182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172813d-0de3-4e0c-8b4a-46f48540d826 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:48.893432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:48.894039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:48.894313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:48.894580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:48.926420 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 673/1346] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:48.961352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:48.962983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:48.972703 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 674/1347] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:49.029607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.043298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a061f-dbcb-4b0d-959e-40428ab098a8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.048977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.049590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.049861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.050130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.109715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.113447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.115049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.120835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b705f-da2a-420a-94c9-6905f79f86b4 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.125012 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 674/1348] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:49.127062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.134550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.134550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.134550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.169617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.180829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af969e-2fd6-4974-8fbf-773477cbe840 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.186641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.191958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.191958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.191958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.192183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.192183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.199571 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 675/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:34:49.218196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.248287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.258647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.261198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.272921 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 675/1350] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:34:49.298381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc91801-be69-4e1a-b6b8-eff3dc9c2495 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.304082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.304797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.305082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.305349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] PATH_INFO: `/v3/users/f11725e56de34281bb4c5cf6fdd34217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.306529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11725e56de34281bb4c5cf6fdd34217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.307614 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:34:49.307614 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:34:49.307614 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:34:49.308948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.336472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.347107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f071fb-ba0a-4f67-a6e8-f744340c9eda service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.352525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.353193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.353420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.353693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] PATH_INFO: `/v3/users/66d279ff5f984ea7b59c989656b949ee` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.354904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d279ff5f984ea7b59c989656b949ee)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.357068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.623033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11725e56de34281bb4c5cf6fdd34217'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.636301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.645968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d279ff5f984ea7b59c989656b949ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.706268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11725e56de34281bb4c5cf6fdd34217'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.727238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11725e56de34281bb4c5cf6fdd34217'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.727975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11725e56de34281bb4c5cf6fdd34217'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.728592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11725e56de34281bb4c5cf6fdd34217'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.745969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 676/1351] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:49 2022] DELETE /identity/v3/users/f11725e56de34281bb4c5cf6fdd34217 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:34:49.746903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.748328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:49.780063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d279ff5f984ea7b59c989656b949ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.794758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d279ff5f984ea7b59c989656b949ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.802625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d279ff5f984ea7b59c989656b949ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.803353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d279ff5f984ea7b59c989656b949ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:49.809382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 676/1352] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:49 2022] DELETE /identity/v3/users/66d279ff5f984ea7b59c989656b949ee => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:49.813189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:49.814554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:49.824981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc1ca-f365-49de-97b0-40a35400a916 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.869120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.881860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252adfd-6ae3-4c0e-9ccb-002bcc822b69 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:49.886530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.887194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.887471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.887747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] PATH_INFO: `/v3/users/b58c89aba586474596f7c5e0640e8e96` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.889112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58c89aba586474596f7c5e0640e8e96)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.890870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.894504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:49.895468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.895789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.897603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.899906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:49.960746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:49.962352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3667a-03d1-4279-9009-097867445b6d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:49.976903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 677/1353] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:49.978422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c7cf-ab2e-47f9-a3c1-e4c692059a94 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.978827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c7cf-ab2e-47f9-a3c1-e4c692059a94 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.979820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5c7cf-ab2e-47f9-a3c1-e4c692059a94 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:49.981140 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 678/1354] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:49.987050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64dc6a-c812-499c-83c2-f0655950f69a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:49.987327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64dc6a-c812-499c-83c2-f0655950f69a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:49.987604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64dc6a-c812-499c-83c2-f0655950f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.007424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7e64dc6a-c812-499c-83c2-f0655950f69a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.009038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e64dc6a-c812-499c-83c2-f0655950f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.018365 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 679/1355] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:50.020751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75ca3-8c76-4f5d-af08-2f9d9949fa16 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.021038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75ca3-8c76-4f5d-af08-2f9d9949fa16 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.021301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a75ca3-8c76-4f5d-af08-2f9d9949fa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.046545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-96a75ca3-8c76-4f5d-af08-2f9d9949fa16 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.047746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96a75ca3-8c76-4f5d-af08-2f9d9949fa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.056265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 680/1356] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:50.057566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.057846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.058116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.068399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58c89aba586474596f7c5e0640e8e96'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:50.077914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.079617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.142770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 681/1357] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:50.143617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.144935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.161827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58c89aba586474596f7c5e0640e8e96'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:50.175252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58c89aba586474596f7c5e0640e8e96'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:50.182570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58c89aba586474596f7c5e0640e8e96'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:50.183334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2e0843f-e9fc-42c7-9b9e-b824c95f5172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58c89aba586474596f7c5e0640e8e96'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:50.189877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 677/1358] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:49 2022] DELETE /identity/v3/users/b58c89aba586474596f7c5e0640e8e96 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:50.191130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.191411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.191680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.192940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 678/1359] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:50.193639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.195369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.209581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233f285-211f-42f5-831a-7fdc923231b6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.223742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:50.232288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:50.255799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a87a-13dd-475f-ae61-ffcaf7c556a3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.259508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.260120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.260258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.260445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.260759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.260858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.261043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.261361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.262647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.263166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.328381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.329855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.331210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.332687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47711aab-d85b-4fa9-b95f-34daab579709 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.340389 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 679/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.341125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.342335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.343019 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 682/1361] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.344150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba341-554d-4055-a96f-09df23971b15 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.344410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba341-554d-4055-a96f-09df23971b15 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.344713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ba341-554d-4055-a96f-09df23971b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.371305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-949ba341-554d-4055-a96f-09df23971b15 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.372618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-949ba341-554d-4055-a96f-09df23971b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.382378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 683/1362] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:50.383724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.384014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.384283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.406381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.407636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.442990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101f9e-d687-41c3-9530-0c45de22365c service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.449459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.450398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.450398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.450682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.453885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.467405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.470090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.483534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 680/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.486672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.488239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.492289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 684/1364] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:50.500689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.502949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.503250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f77fad-a500-4f6f-b6e0-bf866402f348 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.508332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.509231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.509390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.509731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.533384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.534997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea310e3-8a23-4fbc-bb2e-7d59f6196cc1 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.556290 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 681/1365] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.613699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:50.647003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96b88-2719-451b-8e82-98054ed9a339 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.652307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.653513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.653513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.653804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.667541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.669021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.683023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e107-7a7d-4f4a-b6a1-64450b188ab2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.683293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e107-7a7d-4f4a-b6a1-64450b188ab2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.683568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e107-7a7d-4f4a-b6a1-64450b188ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.683974 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 685/1366] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.707333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a795e107-7a7d-4f4a-b6a1-64450b188ab2 None None] MFA Rules not processed for user `f441720944f34d6dad78783005fa6165`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:50.708907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a795e107-7a7d-4f4a-b6a1-64450b188ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.803398 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 682/1367] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:34:50.815631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:50.817198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.833705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f3bfb-dec5-4253-a5dd-6cc6dc195e08 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:50.840854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:50.841484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.841724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.841996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.843867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:50.855977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:50.857824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff097a-0091-457e-9895-5b1c8949d841 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:50.868966 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 686/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:50.988604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:50.989281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:50.990503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:50.996366 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 683/1369] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:34:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:34:51.006232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.006770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.007185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.030810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:51.032168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.041400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:51.043731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.054298 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 687/1370] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:51.059973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:51.078231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:51.086599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0487fc-3c9b-474c-b0bd-59b3f25cf20c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:51.087538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.096693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:51.097454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.097735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.098063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] PATH_INFO: `/v3/projects/29917aa964c94f018bdc7cc587f35032` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.100959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb77c-accb-4317-89bf-a4d3009a0ce5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:51.107272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:51.107272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.107272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.107272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.110060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29917aa964c94f018bdc7cc587f35032)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:51.112036 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:34:51.112036 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:34:51.112036 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:34:51.114017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:51.125142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:51.127491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:51.143902 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 688/1371] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:51.144789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:51.146233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.185279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9898f-7aa6-4bf8-bf88-2584614d43ae service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:51.192370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:51.193072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.193349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.193623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] PATH_INFO: `/v3/projects/4b354427d3614810b91ec1065d1ef4b3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.194946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b354427d3614810b91ec1065d1ef4b3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:51.197023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:51.296105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29917aa964c94f018bdc7cc587f35032', 'request_id': 'req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.310622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29917aa964c94f018bdc7cc587f35032', 'request_id': 'req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.318302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29917aa964c94f018bdc7cc587f35032', 'request_id': 'req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.355189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b354427d3614810b91ec1065d1ef4b3', 'request_id': 'req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.364506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b354427d3614810b91ec1065d1ef4b3', 'request_id': 'req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.433312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] The token cache is being invalidate because project 29917aa964c94f018bdc7cc587f35032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:51.433739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.434475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.436537 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 684/1372] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:51 2022] DELETE /identity/v3/projects/29917aa964c94f018bdc7cc587f35032 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:51.437521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:51.441443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.489722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b354427d3614810b91ec1065d1ef4b3', 'request_id': 'req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.521336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] The token cache is being invalidate because project 4b354427d3614810b91ec1065d1ef4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:51.521609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.522304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.527735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 689/1373] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:51 2022] DELETE /identity/v3/projects/4b354427d3614810b91ec1065d1ef4b3 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:51.529180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:51.531664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:51.556360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c28d1-86a2-4f7b-9181-b74b69ff2a2b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:51.624159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad585b1-b7b6-4b49-af8e-1b3f5b24a421 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:51.630813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:51.631789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.632304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.632825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] PATH_INFO: `/v3/users/16d2849a12cd40bbb563bfe5704e7d71` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.634539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d2849a12cd40bbb563bfe5704e7d71)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:51.637740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:51.658416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:51.659075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:51.659340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:51.659606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] PATH_INFO: `/v3/projects/ec1f83e438e14c6ebc6fbc76eb088d3b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:51.660799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1f83e438e14c6ebc6fbc76eb088d3b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:51.662774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:51.766108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:51.911793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:51.924144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1f83e438e14c6ebc6fbc76eb088d3b', 'request_id': 'req-88f7ec75-84e1-452f-8040-3be85910f042'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.928305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d2849a12cd40bbb563bfe5704e7d71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.930873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1f83e438e14c6ebc6fbc76eb088d3b', 'request_id': 'req-88f7ec75-84e1-452f-8040-3be85910f042'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.936322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1f83e438e14c6ebc6fbc76eb088d3b', 'request_id': 'req-88f7ec75-84e1-452f-8040-3be85910f042'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:51.991874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d2849a12cd40bbb563bfe5704e7d71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.004844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d2849a12cd40bbb563bfe5704e7d71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.005536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d2849a12cd40bbb563bfe5704e7d71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.006151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d2849a12cd40bbb563bfe5704e7d71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.018844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 690/1374] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:51 2022] DELETE /identity/v3/users/16d2849a12cd40bbb563bfe5704e7d71 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:52.019799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:52.021233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.043941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] The token cache is being invalidate because project ec1f83e438e14c6ebc6fbc76eb088d3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:52.044302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.045127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.050532 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 685/1375] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:51 2022] DELETE /identity/v3/projects/ec1f83e438e14c6ebc6fbc76eb088d3b => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:52.050532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:52.050840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.099174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f2eeb-41a8-449c-b41a-e239e008890b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:52.104997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:52.105626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:52.105906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:52.106176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:52.108002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.120655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:52.122281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:52.127267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7ec75-84e1-452f-8040-3be85910f042 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:52.133614 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 691/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:52.134627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:52.136117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.152078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a7cf2-7115-49cc-8ea4-206d74c5dce4 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:52.167852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:52.168826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:52.169279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:52.169716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:52.185540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:52.187823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:52.196027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:52.196864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:52.197198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:52.197739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] PATH_INFO: `/v3/users/749bc80ccf4d4591bac738bf6d3c02f0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:52.199431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749bc80ccf4d4591bac738bf6d3c02f0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:52.200156 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 692/1377] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:52.201035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:52.202475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.217557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:52.217822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b3c2-5215-4410-8fc4-2d346680f72f service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:52.224920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:52.225805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:52.226224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:52.226507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] PATH_INFO: `/v3/users/771b9af5720446e796ea335ba5ac2f37` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:52.228010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771b9af5720446e796ea335ba5ac2f37)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:52.229941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:52.419020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771b9af5720446e796ea335ba5ac2f37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.471853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749bc80ccf4d4591bac738bf6d3c02f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.489142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771b9af5720446e796ea335ba5ac2f37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.503960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771b9af5720446e796ea335ba5ac2f37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.506729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771b9af5720446e796ea335ba5ac2f37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.506729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771b9af5720446e796ea335ba5ac2f37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.513518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:52.525050 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 693/1378] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:52 2022] DELETE /identity/v3/users/771b9af5720446e796ea335ba5ac2f37 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:52.545295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:52.547039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:52.557331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749bc80ccf4d4591bac738bf6d3c02f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.574948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749bc80ccf4d4591bac738bf6d3c02f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.576376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:52.589833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749bc80ccf4d4591bac738bf6d3c02f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.590635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adc67803-ac16-4ddc-b5b5-d5cebc9d6e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749bc80ccf4d4591bac738bf6d3c02f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.598354 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 686/1379] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:52 2022] DELETE /identity/v3/users/749bc80ccf4d4591bac738bf6d3c02f0 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:52.651336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92af16-de18-4e5a-b94b-6c3f204a7448 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:52.740530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:52.740530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:52.740530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:52.740530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] PATH_INFO: `/v3/projects/3b7b7091899e4e29bca40e58f64dd29b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:52.743489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7b7091899e4e29bca40e58f64dd29b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:52.743489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:52.862222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7b7091899e4e29bca40e58f64dd29b', 'request_id': 'req-9f41afd3-8da0-428f-b2ef-e8113c7616ce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.869041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7b7091899e4e29bca40e58f64dd29b', 'request_id': 'req-9f41afd3-8da0-428f-b2ef-e8113c7616ce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.973861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7b7091899e4e29bca40e58f64dd29b', 'request_id': 'req-9f41afd3-8da0-428f-b2ef-e8113c7616ce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.990705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] The token cache is being invalidate because project 3b7b7091899e4e29bca40e58f64dd29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:52.991003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.992845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:52.995263 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 694/1380] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:52 2022] DELETE /identity/v3/projects/3b7b7091899e4e29bca40e58f64dd29b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:34:53.002808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.003334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.003582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.144095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.145995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.191365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.192949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.202344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:53.250919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41afd3-8da0-428f-b2ef-e8113c7616ce admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.256792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.257495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.257776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.258051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] PATH_INFO: `/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.260239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b91a5c012a4f4fbbb9fb1b86ffa22e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.262394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.277890 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 687/1381] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:34:53.277890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.277890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.290382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1aa7e-0085-4e94-b1a7-c5e90d841b3f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.300325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.301031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.301302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.301567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] PATH_INFO: `/v3/projects/aeaa8197489f41228db96de700e66d5f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.303221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeaa8197489f41228db96de700e66d5f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.305702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.428951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b91a5c012a4f4fbbb9fb1b86ffa22e', 'request_id': 'req-c11045ae-5868-49f1-9ac1-31c985f7be68'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.443492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b91a5c012a4f4fbbb9fb1b86ffa22e', 'request_id': 'req-c11045ae-5868-49f1-9ac1-31c985f7be68'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.467397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeaa8197489f41228db96de700e66d5f', 'request_id': 'req-afd7b665-e0c4-43fc-b226-ba247d7374c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.476080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeaa8197489f41228db96de700e66d5f', 'request_id': 'req-afd7b665-e0c4-43fc-b226-ba247d7374c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.483827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeaa8197489f41228db96de700e66d5f', 'request_id': 'req-afd7b665-e0c4-43fc-b226-ba247d7374c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.518372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b91a5c012a4f4fbbb9fb1b86ffa22e', 'request_id': 'req-c11045ae-5868-49f1-9ac1-31c985f7be68'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.536530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] The token cache is being invalidate because project d4b91a5c012a4f4fbbb9fb1b86ffa22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:53.537042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.537759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c11045ae-5868-49f1-9ac1-31c985f7be68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.539678 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 695/1382] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:53 2022] DELETE /identity/v3/projects/d4b91a5c012a4f4fbbb9fb1b86ffa22e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:53.542441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee207-e640-48d6-8b85-f13626e8e29c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.542441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee207-e640-48d6-8b85-f13626e8e29c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.542441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ee207-e640-48d6-8b85-f13626e8e29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.567610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8a0ee207-e640-48d6-8b85-f13626e8e29c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.569415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8a0ee207-e640-48d6-8b85-f13626e8e29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.596808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] The token cache is being invalidate because project aeaa8197489f41228db96de700e66d5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:34:53.597137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.597990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-afd7b665-e0c4-43fc-b226-ba247d7374c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:53.599556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 688/1383] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:34:53 2022] DELETE /identity/v3/projects/aeaa8197489f41228db96de700e66d5f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:53.600775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31cfe4-03e1-47d7-9279-f82d7aec7be4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.601057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31cfe4-03e1-47d7-9279-f82d7aec7be4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.601391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31cfe4-03e1-47d7-9279-f82d7aec7be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.623292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ff31cfe4-03e1-47d7-9279-f82d7aec7be4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.624807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ff31cfe4-03e1-47d7-9279-f82d7aec7be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.649831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 696/1384] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:53.651184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.651568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.651943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.671524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.673103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.697999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 697/1385] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:53.697999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.698869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 689/1386] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:53.700154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff1da-d8ea-4123-bd86-b1ceabc4f81d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.700440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff1da-d8ea-4123-bd86-b1ceabc4f81d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.700749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfff1da-d8ea-4123-bd86-b1ceabc4f81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.702156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561713c-2b03-4981-89ed-016dddca1c18 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.707908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.708566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.708847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.709114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.709871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:53.710166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.711815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.722325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ddfff1da-d8ea-4123-bd86-b1ceabc4f81d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.723626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ddfff1da-d8ea-4123-bd86-b1ceabc4f81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.733851 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 690/1387] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:53.734918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.735225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.736119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.738220 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 698/1388] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:53.739397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.753833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345093ed-c15c-48a5-aaa3-feb12dd59ea3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.757699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:53.759837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.760455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.760765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.762703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.762703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:53.762703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.763575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.769822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:53.771228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:53.777649 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 699/1389] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:53.778484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.783508 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 691/1390] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:53.785422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.791561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000d928-b674-41d3-84c7-ccccf096073b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.794597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.795237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.799457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.799457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.799457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.799779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e83769-d50b-4f6e-8eba-5ab5afa4d00d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:53.799863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.803457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:53.804100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:53.804370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:53.804669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:53.805299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:53.814397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:53.931232 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 692/1391] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:53.931892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.938134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 700/1392] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/projects => generated 401 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:53.938134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:53.957261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:54.022001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872682de-3fce-44c8-97ca-d85d1f704951 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.023711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca43ab-6065-4db7-98ee-24ff6282121c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.028214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.028417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.028864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.028962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.029692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.031203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.031773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.031923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.032147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.032871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.033775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:34:54.034359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.036149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.051322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 693/1393] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:34:54.052411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.063163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da349c5f-2ae4-4aab-846f-1d427d22750d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.068814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.069484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.069716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.069989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.070628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.072594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.124141 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 701/1394] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:53 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.125247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.136440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bae96-06fd-4d19-b122-682795ed06a2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.141556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.142186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.142462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.142734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.143414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.146369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.157602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 694/1395] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.157602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.176743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354dc4c-c4f4-4609-829f-633695203fd5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.181976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.182478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.182780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.183052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.183728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.190050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.205821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 695/1396] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.205821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.218542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dbe28c-eeb2-4fa7-871b-36d47a0c0ccd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.224467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.225123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.227407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.227407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.227407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.228060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.241008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 696/1397] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.242061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.253367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93765ac1-a8f5-430a-9faa-5ad13abf427a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.258551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.259271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.259611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.259952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.260781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.262508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.274881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 697/1398] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.278977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.280853 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 702/1399] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/projects => generated 407 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.282787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.286173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed009-c444-4444-97f9-e11e6978356c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.348752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.349384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.349661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.349935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.350589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.351915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c352e05-263c-4236-b5bc-7484b25e38b8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.352208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.357865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.358568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.358865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.359886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] PATH_INFO: `/v3/projects/4ec84be6ef1d4850a4eb4627a53a05c6/users/832102ac300e41f696c8a0eb247148df/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.368677 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 698/1400] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.368677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.379489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec84be6ef1d4850a4eb4627a53a05c6, user_id=832102ac300e41f696c8a0eb247148df, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.380379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf48134-0881-4d5c-8858-fabca69c6a12 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.382648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.386466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.387186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.387465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.387737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.388375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.390578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ecc51-a692-46b0-bf9e-15358bf24c2b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.474820 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 703/1401] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:54 2022] PUT /identity/v3/projects/4ec84be6ef1d4850a4eb4627a53a05c6/users/832102ac300e41f696c8a0eb247148df/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:54.474820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.529553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:54.533719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c87b7a-7396-455d-b2f6-b9f708ec9c09 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.535275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:54.538713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.539451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.539731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.541958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] PATH_INFO: `/v3/projects/5656b56935ed484c89e4d47df05ee1f6/users/366b248ffa41498d82f096d21646afaf/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.542048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 699/1402] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/users => generated 304 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.542154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482bab6-ecdc-49da-8e8e-fe5f2ae5a043 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.542554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482bab6-ecdc-49da-8e8e-fe5f2ae5a043 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.542712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482bab6-ecdc-49da-8e8e-fe5f2ae5a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.556153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5656b56935ed484c89e4d47df05ee1f6, user_id=366b248ffa41498d82f096d21646afaf, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.558944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.584276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0482bab6-ecdc-49da-8e8e-fe5f2ae5a043 None None] MFA Rules not processed for user `832102ac300e41f696c8a0eb247148df`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:54.585551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0482bab6-ecdc-49da-8e8e-fe5f2ae5a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:54.660711 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 704/1403] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:54 2022] PUT /identity/v3/projects/5656b56935ed484c89e4d47df05ee1f6/users/366b248ffa41498d82f096d21646afaf/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:54.660711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.680019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 700/1404] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:54.681859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.682138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.682406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.718036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] MFA Rules not processed for user `366b248ffa41498d82f096d21646afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:54.720153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:54.754138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff2da-bb11-4876-b9cc-dd877c036da6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.759410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.760879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.760879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.760879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.761537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.763285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.775660 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 705/1405] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.776644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.792697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a670b31-d478-4fc4-94f3-9b98e22fe60e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.798651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.799382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.799834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.800170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.800975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.802909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.808461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 701/1406] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:54.810116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.823787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109948e0-d80e-4943-9101-d3f1e07a23cf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.834777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.835558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.835947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.839046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.839046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.839046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.849540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 702/1407] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:54.853620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.864376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d730c2-6a23-4241-81fd-18eb17dd62f1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.869335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.870039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.870414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.870784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.871509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:54.873553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:54.907997 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 706/1408] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.909534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:54.980215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885bccb5-c53f-4b8c-b0a7-befdc542510c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:54.985935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:54.986662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:54.986887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:54.987155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] PATH_INFO: `/v3/projects/c89092c4e6c448a598f74969c8d10549/users/3c5f8426ba7344469298957041768b61/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:54.987628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 703/1409] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:54.988455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.009217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89092c4e6c448a598f74969c8d10549, user_id=3c5f8426ba7344469298957041768b61, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.013301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.049308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:55.064657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d388-c1a3-4fc1-a1c0-6588c6a6c8cb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.069287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.069981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.070335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.070518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.071145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.073167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b56e2-52df-4139-942b-2ea2621e989c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.111910 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 707/1410] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:54 2022] PUT /identity/v3/projects/c89092c4e6c448a598f74969c8d10549/users/3c5f8426ba7344469298957041768b61/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:55.112794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.179792 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 704/1411] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:54 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:55.179939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:55.180013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.180013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.180013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.200903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80ccf0-fc1c-4578-88a2-2364df09a5fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.206389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.207010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.214407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.214407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.214407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.214407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.215352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] MFA Rules not processed for user `3c5f8426ba7344469298957041768b61`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:55.215352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:55.315328 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 705/1412] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:55.315785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.324870 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 708/1413] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:55 2022] POST /identity/v3/users => generated 307 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:55.324870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.327817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba83cc1-77ba-4ac4-a857-804ac2185e46 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.334565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.335181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.335464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.335745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.336397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.338035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.342251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86d6de-4ccb-4759-a6fc-4cfbe384da49 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.350448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.350894 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 706/1414] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:55.351076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.351337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.351607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.352237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.352527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.354198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.365213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b1e1c9-5f10-4766-8255-544024bb3e06 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.370503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.371857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.372176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.374906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.374906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.376276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.392536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 707/1415] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:55.392536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.401791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc107d2-a52c-4d19-9d41-2e09f4e3c1af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.407922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.408645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.408922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.409192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] PATH_INFO: `/v3/projects/d2562cc4e6064bf5b72ab6628817196a/users/f741fa54a8974024a900a62183f464dd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.429050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2562cc4e6064bf5b72ab6628817196a, user_id=f741fa54a8974024a900a62183f464dd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.433410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.457340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 709/1416] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:34:55 2022] POST /identity/v3/projects => generated 407 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:55.459047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.502007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 708/1417] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:55 2022] PUT /identity/v3/projects/d2562cc4e6064bf5b72ab6628817196a/users/f741fa54a8974024a900a62183f464dd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:55.502995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.545069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254933b-cc36-48eb-b572-f76816dc7d4d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.614169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4e7f-fd39-4b9d-a0a5-3bd2563a7ac8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.620211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.621415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.622083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.622643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.623396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.625646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.638692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.639596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.639981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.640253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] PATH_INFO: `/v3/projects/e17c7b90e8b34149875a504667221965/users/16ac6ff817504787bdf969ce40ed14c0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.656994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17c7b90e8b34149875a504667221965, user_id=16ac6ff817504787bdf969ce40ed14c0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.659652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.751850 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 710/1418] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:55 2022] PUT /identity/v3/projects/e17c7b90e8b34149875a504667221965/users/16ac6ff817504787bdf969ce40ed14c0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:55.752695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.755317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 709/1419] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:34:55 2022] POST /identity/v3/users => generated 310 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:34:55.756296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.766720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d26be-dc70-4fef-98bd-09d99af01fee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.772954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:55.802616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:55.828896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f0b5af-7376-44de-abf6-f3fa1f23bdd6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.833639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.834239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.834581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.834781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.835526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.836189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.836838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.837116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.837228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.837391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.838024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.839596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.848659 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 711/1420] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:55.849993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.855001 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 710/1421] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:55.855001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.861843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b734a26-251a-4f5a-b0ae-a9ce15aa005a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.863018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc789e85-fdf1-40ee-bc9b-2803d04f1727 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.867068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.867662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.867839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.868053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.868337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.868496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.868868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.869035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.869120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] PATH_INFO: `/v3/projects/d2562cc4e6064bf5b72ab6628817196a/users/f741fa54a8974024a900a62183f464dd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.870733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.870917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2562cc4e6064bf5b72ab6628817196a, user_id=f741fa54a8974024a900a62183f464dd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.873704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.886674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 712/1422] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:55.886674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.886926 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 711/1423] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:55 2022] PUT /identity/v3/projects/d2562cc4e6064bf5b72ab6628817196a/users/f741fa54a8974024a900a62183f464dd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:55.887668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:55.901180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe0479-fea0-4d69-8a96-951b2826de75 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.956001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525911e8-27a1-414b-a407-0af190520279 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:55.959452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.960088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.960366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.960672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] PATH_INFO: `/v3/projects/e17c7b90e8b34149875a504667221965/users/16ac6ff817504787bdf969ce40ed14c0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.961203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:55.961937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.962257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.962651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] PATH_INFO: `/v3/projects/cda588c0e56a42879ef38cde96538a62/users/faf696a1010f4a9d8ea15ca6929bc714/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.962800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17c7b90e8b34149875a504667221965, user_id=16ac6ff817504787bdf969ce40ed14c0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.965439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b00ff-f67b-4025-8593-7f985a3d41fe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:55.977363 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 713/1424] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:55 2022] PUT /identity/v3/projects/e17c7b90e8b34149875a504667221965/users/16ac6ff817504787bdf969ce40ed14c0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:55.978892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:55.979180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:55.979453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:55.982746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda588c0e56a42879ef38cde96538a62, user_id=faf696a1010f4a9d8ea15ca6929bc714, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:55.988303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50952d93-747d-4113-ad81-1a27a6d6841f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.010224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] MFA Rules not processed for user `f741fa54a8974024a900a62183f464dd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:56.011458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.061740 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 712/1425] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:55 2022] PUT /identity/v3/projects/cda588c0e56a42879ef38cde96538a62/users/faf696a1010f4a9d8ea15ca6929bc714/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:34:56.066034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.066319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.066779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.097964 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 714/1426] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:56.098856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.099409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] MFA Rules not processed for user `16ac6ff817504787bdf969ce40ed14c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:56.100752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.156205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:56.179986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61098f-cbc9-4199-b820-fa5406f3a940 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.187958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:56.194442 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 713/1427] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:56.195460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.197203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.264548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.265775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.266688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.266891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.268597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:56.296925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.299890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 715/1428] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:34:56 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:34:56.303251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.319155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41621-76ad-405e-86f4-f9b92bf1fdee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.330488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.330488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.330488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.330488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] PATH_INFO: `/v3/projects/cda588c0e56a42879ef38cde96538a62/users/faf696a1010f4a9d8ea15ca6929bc714/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.332478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda588c0e56a42879ef38cde96538a62, user_id=faf696a1010f4a9d8ea15ca6929bc714, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:56.335573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.352663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 716/1429] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:34:56 2022] PUT /identity/v3/projects/cda588c0e56a42879ef38cde96538a62/users/faf696a1010f4a9d8ea15ca6929bc714/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:56.352663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.352663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.362655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469b2a9-7939-481a-aaac-28691cf9083b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.455459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715954a-4f4d-4abb-8ef5-b44ab4a81da8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.458278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.458919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.460243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.460637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.464079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.464743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.465302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.465587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.535753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:56.537520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d06b-49c6-49a6-ac28-e74b4fccb833 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.548051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 714/1430] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:56.549108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:56.554187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.554187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.554187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.554430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3016-d09f-46af-bcec-072f99ea6b9b service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.566305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 717/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:56.568367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.568682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.569012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.588219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:56.620630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] MFA Rules not processed for user `faf696a1010f4a9d8ea15ca6929bc714`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:56.621884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:56.621982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.623149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:56.638215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:56.697162 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 715/1432] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:56.701385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 718/1433] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:56.833161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.846553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca175c75-1dbd-4b3c-aaa4-85ded81a6f33 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.853449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.854112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.857155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.857155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:56.864885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:56.868770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:56.880372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 716/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:56.900173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:56.914487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2fa22-dcfe-44a2-9622-2f39001642c8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:56.942170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:56.944027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:56.944027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:56.944027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:57.013238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:57.014984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:57.026516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 719/1435] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:56 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:34:57.058225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:57.074004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86339ed1-0676-46f9-9b2f-0a395ffa6690 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:57.088236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:57.089059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:57.089410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:57.089838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:57.143624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:57.146473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:57.164263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:57.168698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:57.180786 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 717/1436] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:57.265825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d6548-d810-4bfe-8590-15a4e66357a1 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:57.271361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:57.271965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:57.272244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:57.272546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:57.282392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:57.284396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:57.290762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:57.295362 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 720/1437] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:34:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.698774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:57.823784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcd34d-12e5-449e-8b32-8d7d0b6423d4 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:57.830616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:57.831466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:57.831752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:57.832115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] PATH_INFO: `/v3/users/3c5f8426ba7344469298957041768b61` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:57.833596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5f8426ba7344469298957041768b61)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:57.836552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:57.963584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:57.986872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a496f-55e5-4ee1-9119-e9ffb0bd15f6 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:58.009460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:58.010095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:58.010376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:58.010647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] PATH_INFO: `/v3/users/832102ac300e41f696c8a0eb247148df` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:58.015750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832102ac300e41f696c8a0eb247148df)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:58.019980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:58.039466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:58.079056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5f8426ba7344469298957041768b61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.237899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5f8426ba7344469298957041768b61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.261812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5f8426ba7344469298957041768b61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.282698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5f8426ba7344469298957041768b61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.287460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5f8426ba7344469298957041768b61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.306527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 718/1438] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:57 2022] DELETE /identity/v3/users/3c5f8426ba7344469298957041768b61 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:58.306527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:58.306527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:58.533972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832102ac300e41f696c8a0eb247148df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:58.536683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994f36-3456-4a9d-8cad-fb09e4730e77 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:58.536683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:58.536683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:58.536683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:58.537284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] PATH_INFO: `/v3/users/366b248ffa41498d82f096d21646afaf` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:58.537284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=366b248ffa41498d82f096d21646afaf)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:58.537284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:59.238513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832102ac300e41f696c8a0eb247148df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.256965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832102ac300e41f696c8a0eb247148df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.257573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832102ac300e41f696c8a0eb247148df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.258387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db907a35-5981-4d8b-867b-44ea77fee398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832102ac300e41f696c8a0eb247148df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.283802 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 721/1439] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:57 2022] DELETE /identity/v3/users/832102ac300e41f696c8a0eb247148df => generated 0 bytes in 1321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:59.286152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fbf66-0a2a-438d-8dad-9654b8af72f2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.287069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fbf66-0a2a-438d-8dad-9654b8af72f2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.287372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fbf66-0a2a-438d-8dad-9654b8af72f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.362627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-538fbf66-0a2a-438d-8dad-9654b8af72f2 None None] MFA Rules not processed for user `b46383fc54d5469884898c1b75ce41ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:59.363896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-538fbf66-0a2a-438d-8dad-9654b8af72f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.392810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366b248ffa41498d82f096d21646afaf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.488750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 722/1440] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Nov 2 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:59.497831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068191-5be8-452b-b030-55bd29d14f28 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.497831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068191-5be8-452b-b030-55bd29d14f28 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.497831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b068191-5be8-452b-b030-55bd29d14f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.526301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8b068191-5be8-452b-b030-55bd29d14f28 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:59.526301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b068191-5be8-452b-b030-55bd29d14f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.562247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366b248ffa41498d82f096d21646afaf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.593262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366b248ffa41498d82f096d21646afaf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.607660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366b248ffa41498d82f096d21646afaf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.608813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-075f75bb-e1f5-4113-8093-6b0c546c65b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366b248ffa41498d82f096d21646afaf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:34:59.634652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 719/1441] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:34:58 2022] DELETE /identity/v3/users/366b248ffa41498d82f096d21646afaf => generated 0 bytes in 1328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:34:59.634652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.634652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.634652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.658552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:59.660216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.695063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:59.765228 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 723/1442] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:59.768738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.768738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.768738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.776168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:59.784302 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 720/1443] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:59.784302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:59.791804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:34:59.793199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.793391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.802698 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 724/1444] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:34:59.808928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:59.808928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:34:59.884195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833945d8-8008-46a3-9556-f090c5232ebb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:59.891369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:59.891991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.892260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.893444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.895905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40685500-3f63-467c-80d4-9ceece6b0006 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:59.902280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:59.903006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.903452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.903696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.905999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:59.908194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:59.918005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:59.919928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:34:59.922310 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 725/1445] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:59.923472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:34:59.934738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcc1e3-f79a-4e92-8672-f4f1899a8f8b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:34:59.943920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:34:59.944561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:34:59.944927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:34:59.945280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:34:59.948841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 721/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:59.968798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:34:59.975184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:00.002722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 726/1447] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:00.739001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:00.746423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:00.783393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:00.785776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:00.804179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b47af-a68e-40be-a69b-18ac5fc01a18 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:00.821227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e24f5-f9e4-4d7e-8e36-601d8ab89dec service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:00.825564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:00.826236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:00.826512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:00.827134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] PATH_INFO: `/v3/projects/4ec84be6ef1d4850a4eb4627a53a05c6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:00.828978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec84be6ef1d4850a4eb4627a53a05c6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:00.832099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:00.849121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:00.854043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:00.855521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:00.855902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] PATH_INFO: `/v3/projects/c89092c4e6c448a598f74969c8d10549` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:00.858885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89092c4e6c448a598f74969c8d10549)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:00.869178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:01.029381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec84be6ef1d4850a4eb4627a53a05c6', 'request_id': 'req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.043406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec84be6ef1d4850a4eb4627a53a05c6', 'request_id': 'req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.049163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec84be6ef1d4850a4eb4627a53a05c6', 'request_id': 'req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.056563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89092c4e6c448a598f74969c8d10549', 'request_id': 'req-4dc5241d-fdde-49f0-90e0-43c3629c6383'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.066391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89092c4e6c448a598f74969c8d10549', 'request_id': 'req-4dc5241d-fdde-49f0-90e0-43c3629c6383'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.189571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] The token cache is being invalidate because project 4ec84be6ef1d4850a4eb4627a53a05c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:01.189908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.190521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.195392 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 722/1448] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:00 2022] DELETE /identity/v3/projects/4ec84be6ef1d4850a4eb4627a53a05c6 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:01.196386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:01.197841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:01.279073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:01.308658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb83b7-c2ad-4a68-b7a5-908d32f5a126 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:01.317015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89092c4e6c448a598f74969c8d10549', 'request_id': 'req-4dc5241d-fdde-49f0-90e0-43c3629c6383'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.332210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] The token cache is being invalidate because project c89092c4e6c448a598f74969c8d10549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:01.332848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.333725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.336845 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 727/1449] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:00 2022] DELETE /identity/v3/projects/c89092c4e6c448a598f74969c8d10549 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:01.338072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:01.342470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:01.408025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:01.408739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:01.409013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:01.409285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] PATH_INFO: `/v3/projects/5656b56935ed484c89e4d47df05ee1f6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:01.410438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5656b56935ed484c89e4d47df05ee1f6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:01.412720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:01.430012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5241d-fdde-49f0-90e0-43c3629c6383 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:01.436393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:01.437106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:01.437372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:01.437676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] PATH_INFO: `/v3/users/f741fa54a8974024a900a62183f464dd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:01.438843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f741fa54a8974024a900a62183f464dd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:01.441531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:01.459111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:01.576607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5656b56935ed484c89e4d47df05ee1f6', 'request_id': 'req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.588388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5656b56935ed484c89e4d47df05ee1f6', 'request_id': 'req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.600102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5656b56935ed484c89e4d47df05ee1f6', 'request_id': 'req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.711554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] The token cache is being invalidate because project 5656b56935ed484c89e4d47df05ee1f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:01.711882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.716207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.718920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 723/1450] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:01 2022] DELETE /identity/v3/projects/5656b56935ed484c89e4d47df05ee1f6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:01.720369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:01.726339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:01.727061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f741fa54a8974024a900a62183f464dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.813779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6cc2a2-1276-41ec-bb7f-43f2095b07d9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:01.818954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:01.819692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:01.820046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:01.820390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] PATH_INFO: `/v3/users/faf696a1010f4a9d8ea15ca6929bc714` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:01.821669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf696a1010f4a9d8ea15ca6929bc714)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:01.823697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:01.835480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f741fa54a8974024a900a62183f464dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.852152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f741fa54a8974024a900a62183f464dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.852913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f741fa54a8974024a900a62183f464dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.853533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f741fa54a8974024a900a62183f464dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:01.868609 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 728/1451] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:01 2022] DELETE /identity/v3/users/f741fa54a8974024a900a62183f464dd => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:01.869871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:01.871506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:01.987149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8a6f6-9305-4666-9c9b-32e107f41bbd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:01.994403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:01.995255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:01.995641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:01.996044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] PATH_INFO: `/v3/users/16ac6ff817504787bdf969ce40ed14c0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:01.997706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ac6ff817504787bdf969ce40ed14c0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:01.999826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:02.063302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:02.086066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf696a1010f4a9d8ea15ca6929bc714'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.221109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf696a1010f4a9d8ea15ca6929bc714'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.246252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf696a1010f4a9d8ea15ca6929bc714'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.255989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf696a1010f4a9d8ea15ca6929bc714'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.256783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf696a1010f4a9d8ea15ca6929bc714'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.265628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 724/1452] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:01 2022] DELETE /identity/v3/users/faf696a1010f4a9d8ea15ca6929bc714 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:02.526126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:02.527882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:02.593508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ac6ff817504787bdf969ce40ed14c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.682065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ac6ff817504787bdf969ce40ed14c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.688592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfbbc2c-9a98-4334-b7f7-2984b8a83bfd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:02.694715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:02.695385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:02.695655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:02.696113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] PATH_INFO: `/v3/projects/d2562cc4e6064bf5b72ab6628817196a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:02.697801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2562cc4e6064bf5b72ab6628817196a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:02.700101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:02.701012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ac6ff817504787bdf969ce40ed14c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.702001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ac6ff817504787bdf969ce40ed14c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.702829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff0ea3ff-5703-4eb3-bc67-0f12cdb8aedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ac6ff817504787bdf969ce40ed14c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.723487 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 729/1453] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:01 2022] DELETE /identity/v3/users/16ac6ff817504787bdf969ce40ed14c0 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:02.902297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2562cc4e6064bf5b72ab6628817196a', 'request_id': 'req-baa4e44c-28dc-4618-b032-b8758947d839'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.923552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2562cc4e6064bf5b72ab6628817196a', 'request_id': 'req-baa4e44c-28dc-4618-b032-b8758947d839'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:02.935006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2562cc4e6064bf5b72ab6628817196a', 'request_id': 'req-baa4e44c-28dc-4618-b032-b8758947d839'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.083904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] The token cache is being invalidate because project d2562cc4e6064bf5b72ab6628817196a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:03.083904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.086791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.089232 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 725/1454] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:02 2022] DELETE /identity/v3/projects/d2562cc4e6064bf5b72ab6628817196a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:03.095698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f397c0-69d0-4c27-8abc-f0bba900dbe3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.097203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f397c0-69d0-4c27-8abc-f0bba900dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.097889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f397c0-69d0-4c27-8abc-f0bba900dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.131759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:03.131759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.168922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-55f397c0-69d0-4c27-8abc-f0bba900dbe3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:03.170440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-55f397c0-69d0-4c27-8abc-f0bba900dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.217509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:03.289596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:03.327829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4e44c-28dc-4618-b032-b8758947d839 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:03.335106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:03.336030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.336449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.337206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] PATH_INFO: `/v3/projects/cda588c0e56a42879ef38cde96538a62` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.338935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda588c0e56a42879ef38cde96538a62)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:03.341662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:03.357643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 730/1455] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:03.360327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.360648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.361514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.399712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:03.401879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.418623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 731/1456] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:03.418623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:03.430819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed789f66-dc0d-45cc-83ba-f613699adf0f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:03.438084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:03.438813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.439535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.439535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.440032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:03.440389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:03.443144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:03.499215 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 732/1457] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:03.500865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:03.503490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.516673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda588c0e56a42879ef38cde96538a62', 'request_id': 'req-7b121009-624a-429c-9169-2e39b115c93f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.522599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4da17-2738-45c1-a792-619711b41eff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:03.529300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda588c0e56a42879ef38cde96538a62', 'request_id': 'req-7b121009-624a-429c-9169-2e39b115c93f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.540269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda588c0e56a42879ef38cde96538a62', 'request_id': 'req-7b121009-624a-429c-9169-2e39b115c93f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.608928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:03.609651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.609924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.610193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] PATH_INFO: `/v3/projects/e17c7b90e8b34149875a504667221965` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.611341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17c7b90e8b34149875a504667221965)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:03.613875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:03.649267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] The token cache is being invalidate because project cda588c0e56a42879ef38cde96538a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:03.649538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.650492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.656255 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 726/1458] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:03 2022] DELETE /identity/v3/projects/cda588c0e56a42879ef38cde96538a62 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:03.657795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:03.659388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.679188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121009-624a-429c-9169-2e39b115c93f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:03.684465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:03.685275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.685684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.686175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.686971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:03.689238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b9983-5959-439b-94ed-ae689c05e8d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:03.788522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17c7b90e8b34149875a504667221965', 'request_id': 'req-5efdc2a7-760c-4d44-afe4-0957820548d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.801647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17c7b90e8b34149875a504667221965', 'request_id': 'req-5efdc2a7-760c-4d44-afe4-0957820548d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.887972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 727/1459] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:03 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:03.890340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a0b2-dad0-4a07-b5d9-9b2adcbb5497 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:03.892185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a0b2-dad0-4a07-b5d9-9b2adcbb5497 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:03.892185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86a0b2-dad0-4a07-b5d9-9b2adcbb5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:03.910917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17c7b90e8b34149875a504667221965', 'request_id': 'req-5efdc2a7-760c-4d44-afe4-0957820548d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.930073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5f86a0b2-dad0-4a07-b5d9-9b2adcbb5497 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:03.934117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] The token cache is being invalidate because project e17c7b90e8b34149875a504667221965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:03.934498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.935448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:03.936878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f86a0b2-dad0-4a07-b5d9-9b2adcbb5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.940421 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 733/1460] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:03 2022] DELETE /identity/v3/projects/e17c7b90e8b34149875a504667221965 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:03.941857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:03.950609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:03.978884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:04.040746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc2a7-760c-4d44-afe4-0957820548d6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.051897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 728/1461] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:04.053216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5d6a-95d8-474f-ac4e-789e1ab6e340 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.053504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5d6a-95d8-474f-ac4e-789e1ab6e340 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.053778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5d6a-95d8-474f-ac4e-789e1ab6e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.078922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-450d5d6a-95d8-474f-ac4e-789e1ab6e340 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:04.080200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-450d5d6a-95d8-474f-ac4e-789e1ab6e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:04.089124 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 729/1462] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:04.091684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fb17-7747-4227-bb1f-60fbce428a19 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.091684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fb17-7747-4227-bb1f-60fbce428a19 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.091684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259fb17-7747-4227-bb1f-60fbce428a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.122675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7259fb17-7747-4227-bb1f-60fbce428a19 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:04.124427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7259fb17-7747-4227-bb1f-60fbce428a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:04.133990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 730/1463] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:04.135330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.135608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.136040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.153445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.154847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.155205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.155574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.156855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.159185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.161915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:04.163434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:04.173691 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 731/1464] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:04.174863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.197867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5834a-d3bb-45d8-85ce-f43dcb33c718 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.206537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.206537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.206537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.206537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.206925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:04.206925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.211162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.227413 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 732/1465] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:04.228382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.240847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09721919-853a-4c56-ae9b-3532381d2a4c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.247265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.247902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.248179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.248453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.249124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:04.249425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.251574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.264943 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 733/1466] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:04.286680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.286680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b97b-7ecf-44ac-b201-f3ab86118749 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.286680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.286680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.287101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.287101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.287101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.287101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.481092 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 734/1467] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/projects => generated 411 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:04.481092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.481408 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 734/1468] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:03 2022] POST /identity/v3/users => generated 292 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:04.483288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.495210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42e603-132f-41f6-8fda-d1bccfc6f56b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.587183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.588144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.588510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.588862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.589583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.592081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.615415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:04.637562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b35f0-b87c-453d-93ec-e6eeb7aa8d90 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.642528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.643307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.643682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.644048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.644819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.647510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.689307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 735/1469] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/users => generated 306 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:04.693639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.719980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dcebb3-7b72-47f5-8897-18b70845efe9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.725574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.728302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.728302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.728302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.728302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.729307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.748174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 736/1470] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:04.748986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.759386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351006bd-4f66-4a6c-b9c5-7e22390cadd6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.765503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.766176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.766457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.766773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.767431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.769110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.782723 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 735/1471] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:04.783537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.785366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 737/1472] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:04.786327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.798198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370f868-c1e8-43d8-bb7c-5da2bdb5ce91 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.887498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2597af-7a82-4efb-ad69-65750acfd8b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.901404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.902164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.902531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.903037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.903780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.907139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.916893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.920937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 736/1473] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:04.921123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.921634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.923036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.923141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.924182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.935411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.936340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe718b9-b80f-40c6-8238-b9c0024906ad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.942733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.943659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.944026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.944454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:04.945352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:04.947483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:04.951469 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 738/1474] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:04 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:04.952516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:04.976199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a39428-a655-41f1-b4ba-b79612e22af9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:04.981755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:04.982602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:04.982994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:04.983427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7/users/24b22ee41c3d4fdeb0152828002c6b04/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.005209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633337daf8c944329d1a7d85446af8c7, user_id=24b22ee41c3d4fdeb0152828002c6b04, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.007859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:05.066213 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 737/1475] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:04 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:05.067442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:05.084698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c864871-3e0d-47f0-971d-37ed00ed230b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:05.095558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:05.102413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.102413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.102413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] PATH_INFO: `/v3/projects/e3560f0215ea4522a9e696b9c895cce2/users/45e6263042c94e4f9e917ecd8621ed1b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.125123 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 739/1476] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:04 2022] PUT /identity/v3/projects/633337daf8c944329d1a7d85446af8c7/users/24b22ee41c3d4fdeb0152828002c6b04/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:05.126379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:05.131989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3560f0215ea4522a9e696b9c895cce2, user_id=45e6263042c94e4f9e917ecd8621ed1b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.139977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b5000-24c8-41fb-a17b-564471734492 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:05.206487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6fcfe-f1dd-4bbb-abfb-3eee0f1349b1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:05.210853 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 738/1477] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:05 2022] PUT /identity/v3/projects/e3560f0215ea4522a9e696b9c895cce2/users/45e6263042c94e4f9e917ecd8621ed1b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:05.212599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.212599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.212919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.263442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] MFA Rules not processed for user `24b22ee41c3d4fdeb0152828002c6b04`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:05.264947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:05.284832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:05.285716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.288704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.288704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.288704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.288704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55322fda-a273-4c2b-a0d9-a7aa59f5181e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:05.300517 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 740/1478] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:05.302120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.302438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.302710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.336939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] MFA Rules not processed for user `45e6263042c94e4f9e917ecd8621ed1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:05.338581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:05.375287 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 739/1479] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:05.376188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:05.386924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f06f8-8fb0-4c63-93ec-e02071bc6a82 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:05.392863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:05.393483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.393779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.394113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.395594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.397597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:05.414936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 740/1480] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:05.414936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:05.425168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cbb00-e2d5-40f3-91e9-36c6b9cf5337 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:05.438275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:05.438949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.439202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.439447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.440089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.442080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:05.449153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 741/1481] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:05 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:05.459419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:05.473133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43471825-1d40-408e-a973-a1a6e9666690 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:05.477950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:05.478630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:05.478911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:05.479194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] PATH_INFO: `/v3/projects/6805f253401d4b77a87bf418520e0ae7/users/4e1356237e5d4d9bb8eb5af230c0bf61/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:05.495319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:05.501234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6805f253401d4b77a87bf418520e0ae7, user_id=4e1356237e5d4d9bb8eb5af230c0bf61, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:05.504335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.072475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 742/1482] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:05 2022] PUT /identity/v3/projects/6805f253401d4b77a87bf418520e0ae7/users/4e1356237e5d4d9bb8eb5af230c0bf61/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:06.073304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.082492 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 741/1483] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:05 2022] POST /identity/v3/projects => generated 381 bytes in 670 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.083253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.087389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:06.161498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d3cc-f1df-4425-88e6-e52539ad9e09 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.170504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be3cba-eb7f-4c29-9775-0856127f0d2f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.174827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.175443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.175718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.176113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.178125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:06.188700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.190193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.198735 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 742/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:06.199583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.208598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95b9bc-3fda-49ee-9aa5-d558405654b7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.213074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.213912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.214193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.214464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.224519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.226048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c044e9-f112-46ce-8978-01794e552510 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.236253 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 743/1485] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:06.237619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.237904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.238155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.238636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.238993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.239341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.239815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.240855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.244835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.277056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] MFA Rules not processed for user `4e1356237e5d4d9bb8eb5af230c0bf61`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:06.277056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:06.343081 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 744/1486] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:06.344503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.355046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24595039-de6c-42b3-aca0-07fafcf2f228 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.360413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.361109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.361527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.361801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.362847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.364384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.389315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 743/1487] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/projects => generated 411 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.390333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.465128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602057ff-423d-4f89-b90b-fde63e126a04 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.471881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.472527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.472815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.473092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.473781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.475718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.488920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 745/1488] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.489716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.500516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762aa894-110a-4830-a9c3-3f007d42173d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.505684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.506341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.506622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.506894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.507521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.509648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.593531 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 744/1489] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.595164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.623028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 746/1490] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/users => generated 312 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.623028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.632432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca112c1a-dd45-4943-850b-7cfd7308c5f9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.677794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afee85-4f45-44a4-85c7-70019bed8ded admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.683165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.683783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.684054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.684321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.685135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.686821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.699937 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 745/1491] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:06.701815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.710188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.716416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.716416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.716416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.716416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.716896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.721469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089f718-617a-4f5b-86af-91637ae9c1d4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.728801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.729864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.730440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.731292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.732335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.735192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.746416 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 746/1492] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:06.750830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.757997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cb4fa-da5e-41d9-ae4a-d508465c2c84 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.762958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.763742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.764019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.764320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] PATH_INFO: `/v3/projects/61db76a3934e4e5182a00a9706c7c637/users/58b5b0dac88b438b84aa8e86b11782d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.782826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61db76a3934e4e5182a00a9706c7c637, user_id=58b5b0dac88b438b84aa8e86b11782d3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.785841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.798379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:06.831114 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 747/1493] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:06 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:06.832064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.842407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd01a2-e984-419d-92ad-b05376e9028a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.848613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.849290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.849560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.849826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] PATH_INFO: `/v3/projects/1f15c4db967845f387ede6b5345add8a/users/889406eab1d94fdc9f42d7556f0b9c8c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.867383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15c4db967845f387ede6b5345add8a, user_id=889406eab1d94fdc9f42d7556f0b9c8c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.870254 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 747/1494] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:06 2022] PUT /identity/v3/projects/61db76a3934e4e5182a00a9706c7c637/users/58b5b0dac88b438b84aa8e86b11782d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:06.870393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.874250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.944623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1f16b-35af-47ac-b036-ec764c54ae15 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:06.950001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:06.950815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:06.951190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:06.951788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:06.952298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:06.954077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:06.956742 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 748/1495] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:06 2022] PUT /identity/v3/projects/1f15c4db967845f387ede6b5345add8a/users/889406eab1d94fdc9f42d7556f0b9c8c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:06.957473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.970308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 748/1496] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:06.970308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:06.980404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1040f-f1e6-468b-97e8-cec3c28aed2d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.038010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997e385-4fd9-4591-b43a-f83810a766aa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.042734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.043344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.043619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.043935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.044553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.044685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.045203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.045481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.045752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.046202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.046393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.048695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.061212 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 749/1497] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:07.062684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.068382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 749/1498] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:07.069573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.078410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee61fd2-f060-4ee7-850b-71d4c5240f64 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.084969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da46273-f20b-489f-9dae-4e476257728a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.085607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.086764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.087248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.087731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] PATH_INFO: `/v3/projects/b1abfec53159448bb1fa4fa39de8147c/users/27627294e8d84e9180b2c7fd4b2d9e47/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.090768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.091712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.091992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.092265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] PATH_INFO: `/v3/projects/61db76a3934e4e5182a00a9706c7c637/users/58b5b0dac88b438b84aa8e86b11782d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.095799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=61db76a3934e4e5182a00a9706c7c637, user_id=58b5b0dac88b438b84aa8e86b11782d3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.099342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.124879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 750/1499] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:07 2022] PUT /identity/v3/projects/61db76a3934e4e5182a00a9706c7c637/users/58b5b0dac88b438b84aa8e86b11782d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:07.124879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.125224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1abfec53159448bb1fa4fa39de8147c, user_id=27627294e8d84e9180b2c7fd4b2d9e47, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.125224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fcdb9-e112-442b-a365-a95db6fdfbeb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.200200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31681f-3fae-48ba-aec2-76ac2631e7eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.205184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.205847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.206127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.206397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] PATH_INFO: `/v3/projects/1f15c4db967845f387ede6b5345add8a/users/889406eab1d94fdc9f42d7556f0b9c8c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.208371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f15c4db967845f387ede6b5345add8a, user_id=889406eab1d94fdc9f42d7556f0b9c8c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.211078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb989b-7f42-4762-85e8-576c3c8cae56 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.222899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 751/1500] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:07 2022] PUT /identity/v3/projects/1f15c4db967845f387ede6b5345add8a/users/889406eab1d94fdc9f42d7556f0b9c8c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:07.224219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.224530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.224888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.256282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] MFA Rules not processed for user `58b5b0dac88b438b84aa8e86b11782d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:07.257998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.266499 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 750/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:07 2022] PUT /identity/v3/projects/b1abfec53159448bb1fa4fa39de8147c/users/27627294e8d84e9180b2c7fd4b2d9e47/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:07.267914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.268746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.269444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.299249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:07.303709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] MFA Rules not processed for user `889406eab1d94fdc9f42d7556f0b9c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:07.305029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.416715 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 751/1502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:07.417947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.440789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 752/1503] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:07.440789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.444027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.541167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71ff57-ae26-4a1a-9a10-3571db86437b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.547069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.547694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.547971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.548241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.548916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.550524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.561487 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 752/1504] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:07.562885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.565276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.566409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b992ac-70bd-4034-a585-e315a2112968 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.573264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.573957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.574349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.574624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.584096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.585078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198ba34-acac-4239-9eec-e97da72a35fd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.586186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.591272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.595115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.595115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.595115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.598643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 753/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:07.599334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.602728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.604414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c8902-f051-49c9-9530-68b0ccfde829 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.612700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0f24-b1db-4548-8e00-31be81504675 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.617861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 753/1506] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:07.621004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.621605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.622120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.622379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] PATH_INFO: `/v3/projects/b1abfec53159448bb1fa4fa39de8147c/users/27627294e8d84e9180b2c7fd4b2d9e47/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.625517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1abfec53159448bb1fa4fa39de8147c, user_id=27627294e8d84e9180b2c7fd4b2d9e47, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.628363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56f0b-be73-4a2a-89be-e17ad27c07c7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.634813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.635136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.635416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.637162 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 754/1507] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:35:07.643623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:07.645580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 754/1508] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:07 2022] PUT /identity/v3/projects/b1abfec53159448bb1fa4fa39de8147c/users/27627294e8d84e9180b2c7fd4b2d9e47/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:07.657733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.658040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.658277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.701482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] MFA Rules not processed for user `27627294e8d84e9180b2c7fd4b2d9e47`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:07.703541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.744222 n-d-857339-6 devstack@keystone.service[82131]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 02 12:35:07.744645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.795879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 755/1509] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:07.797546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.812025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5e573-67b4-4d2f-b0b6-38c94e7d06d4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.818082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.818713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.818995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.819267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.829466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3da16-0818-442a-8337-a776c02fd3e3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.835804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.836643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.837015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.837569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.839088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.841399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.844107 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 755/1510] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:07.868292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:07.885097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb8840-b8b7-4ed5-9257-f7b58e6fb536 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:07.891907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:07.892556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.892836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.893399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.896896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.899208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad1c36-12c9-40d1-8524-f47aa1545939 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.909560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:07.911170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c42de-efec-4b09-a0f4-7de59befca00 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:07.921017 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 756/1511] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:07.923010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9795c-e928-4289-8e4f-c029c7732173 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.923373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9795c-e928-4289-8e4f-c029c7732173 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.923739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 756/1512] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:07.923864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e9795c-e928-4289-8e4f-c029c7732173 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.925487 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 757/1513] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:07.952332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.952754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.953552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.967907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:07.968283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:07.968701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:07.971185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 758/1514] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:35:07.976813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:07.978488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:07.982769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:07.993205 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 757/1515] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:35:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:07.994994 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 02 12:35:07.995368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.006865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85579575-dbd9-40c7-af76-cc4053fc0281 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.011809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.014758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.014758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.014758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.014758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.016972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.018808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 759/1516] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:07 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:08.076535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.082246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.096737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5db6f4-10d1-44d2-89ae-3c339c9b98ca tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.102577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.103182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.103537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.103719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.113936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.115747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.133143 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 760/1517] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:08.151124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d16e10-7788-4bfd-a7ee-bba7325d9dd9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.158205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.158336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.158635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.158909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] PATH_INFO: `/v3/users/45e6263042c94e4f9e917ecd8621ed1b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.160918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45e6263042c94e4f9e917ecd8621ed1b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.164159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.230649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.241893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a76cf2-f6f0-4d6b-9c82-21cb795ce80c service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.248102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.248797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.249210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.249483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.317316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.318981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534a7aa-69ec-4f90-b4ee-b4bf0f8d9645 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.329259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 761/1518] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:08.331263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.331551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.331875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.354034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] MFA Rules not processed for user `24b22ee41c3d4fdeb0152828002c6b04`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:08.355463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:08.440249 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 762/1519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:08.545862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.559808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde022ca-84df-45aa-8d8c-f93006ef3e60 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.566516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.567253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.567583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.567932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.576900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.578749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62f5b-265d-4db6-a949-7cd44f7de174 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.595643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45e6263042c94e4f9e917ecd8621ed1b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:08.595930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 763/1520] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:08.739102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45e6263042c94e4f9e917ecd8621ed1b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:08.754078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45e6263042c94e4f9e917ecd8621ed1b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:08.761835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45e6263042c94e4f9e917ecd8621ed1b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:08.762554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45e6263042c94e4f9e917ecd8621ed1b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:08.769525 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 758/1521] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:08 2022] DELETE /identity/v3/users/45e6263042c94e4f9e917ecd8621ed1b => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:08.774873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c73f2-efe2-4836-b74a-138777f92158 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.775154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c73f2-efe2-4836-b74a-138777f92158 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.775429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c73f2-efe2-4836-b74a-138777f92158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.797396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-249c73f2-efe2-4836-b74a-138777f92158 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:08.799010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-249c73f2-efe2-4836-b74a-138777f92158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:08.819723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:08.882413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 764/1522] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:08.883878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:08.885417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:08.951914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee925308-f11e-4367-9550-72801eb1ab3f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:08.958356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:08.959295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:08.959583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:08.959857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:08.989611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:08.989611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:08.990278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 759/1523] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:09.027492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:09.055895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.056756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.056756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.058054 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 765/1524] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:09.063390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:09.065419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.146801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.148380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.220913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.222948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.223667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01726-9f78-4349-803a-3c10cbb0acba service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.228943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.250346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.250346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.250346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.250346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:09.250975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71e1a9-b058-4af6-85d1-516cde1288d8 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:09.250975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 760/1525] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:09 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:09.251267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f01d23-8923-4f9f-8455-f73d1fb80380 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.251267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.251267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.251267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.251525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] PATH_INFO: `/v3/users/4e1356237e5d4d9bb8eb5af230c0bf61` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.251525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1356237e5d4d9bb8eb5af230c0bf61)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:09.251649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:09.523550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.523820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.524081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.525532 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 761/1526] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:35:09.530351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:09.532480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.553931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.563538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1356237e5d4d9bb8eb5af230c0bf61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.566459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa02e5c-8135-4984-bccd-8a125750155b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.573922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.576392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.576392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.576392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.576706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:09.579173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:09.584775 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 762/1527] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:09 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:09.586362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.588353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.612180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0c200-63fd-4dc0-87af-37f39322d944 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.617921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.618584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.618858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.619125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] PATH_INFO: `/v3/projects/e3560f0215ea4522a9e696b9c895cce2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.620248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3560f0215ea4522a9e696b9c895cce2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:09.622585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:09.641646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1356237e5d4d9bb8eb5af230c0bf61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.655323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1356237e5d4d9bb8eb5af230c0bf61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.661752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1356237e5d4d9bb8eb5af230c0bf61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.661752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79e38a8d-3fdb-4035-bdd7-a65714ded7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1356237e5d4d9bb8eb5af230c0bf61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.670827 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 766/1528] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:09 2022] DELETE /identity/v3/users/4e1356237e5d4d9bb8eb5af230c0bf61 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:09.672346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e9260-d64e-4435-82a6-009538c2bd75 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.672669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e9260-d64e-4435-82a6-009538c2bd75 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.672942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e9260-d64e-4435-82a6-009538c2bd75 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.674324 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 767/1529] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:09.675443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.675756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.675993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.697148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:09.701930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.759533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 768/1530] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:09.760340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:09.761643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.781562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3560f0215ea4522a9e696b9c895cce2', 'request_id': 'req-35bd4168-0d27-4be4-a016-2377697dec5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.788442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3560f0215ea4522a9e696b9c895cce2', 'request_id': 'req-35bd4168-0d27-4be4-a016-2377697dec5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.794207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3560f0215ea4522a9e696b9c895cce2', 'request_id': 'req-35bd4168-0d27-4be4-a016-2377697dec5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.841701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.843005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.870891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] The token cache is being invalidate because project e3560f0215ea4522a9e696b9c895cce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:09.871297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.871851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:09.873431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 763/1531] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:09 2022] DELETE /identity/v3/projects/e3560f0215ea4522a9e696b9c895cce2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:09.874201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.875534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.920712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f425-cb19-4642-93ea-26c498febe79 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.938946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd4168-0d27-4be4-a016-2377697dec5b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:09.942787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.943443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.943716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.943988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.945929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:09.982963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:09.984209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:09.984209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:09.984209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:09.985784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:09.989473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:09.990651 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 769/1532] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:09 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:09.991658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:09.993416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:10.022930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:10.025254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c573d-d4ae-4504-9d4b-31e7a7631a65 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:10.041750 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 764/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:10.092043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391302b6-265e-4adb-aaf2-02d3da69f42e tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:10.100931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:10.102000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:10.102483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:10.102980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] PATH_INFO: `/v3/users/889406eab1d94fdc9f42d7556f0b9c8c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:10.104893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889406eab1d94fdc9f42d7556f0b9c8c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:10.108191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:10.225787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6872e2-984b-4d90-bddb-744dc7580907 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:10.226327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6872e2-984b-4d90-bddb-744dc7580907 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:10.226867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6872e2-984b-4d90-bddb-744dc7580907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:10.255783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0d6872e2-984b-4d90-bddb-744dc7580907 None None] MFA Rules not processed for user `24b22ee41c3d4fdeb0152828002c6b04`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:10.257647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d6872e2-984b-4d90-bddb-744dc7580907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:10.323498 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 765/1534] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:10.350972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.486908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889406eab1d94fdc9f42d7556f0b9c8c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:10.562736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.637573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889406eab1d94fdc9f42d7556f0b9c8c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:10.662059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889406eab1d94fdc9f42d7556f0b9c8c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:10.663258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889406eab1d94fdc9f42d7556f0b9c8c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:10.664281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889406eab1d94fdc9f42d7556f0b9c8c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:10.681463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 770/1535] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:09 2022] DELETE /identity/v3/users/889406eab1d94fdc9f42d7556f0b9c8c => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:10.857333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:10.857833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:10.858323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:10.861487 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 766/1536] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:10.872951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:10.872951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:10.991977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:10.993318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:11.072271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80a28a-f5e6-4839-adac-60574817d102 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:11.077229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:11.078601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:11.079036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:11.079306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:11.080533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:11.082659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d5ba-be45-4579-b1da-ddd610bcb822 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:11.084368 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 771/1537] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:10 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:11.699168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:11.701283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:11.800249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323363-fa0a-46cc-95ac-ead82cfc263b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:11.804745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:11.805381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:11.805648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:11.805914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] PATH_INFO: `/v3/projects/6805f253401d4b77a87bf418520e0ae7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:11.807023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6805f253401d4b77a87bf418520e0ae7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:11.808978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:11.848906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:11.849387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:11.849501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:11.850771 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 772/1538] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:35:11.855794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:11.857594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:11.876428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:11.886172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda2d6-e71e-4363-9992-9b1cd46bc94e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:11.890967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:11.891664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:11.891944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:11.892215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:11.893378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:11.895427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0d2333-68ea-4372-8788-456f45575821 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:11.897180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 773/1539] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:11 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:11.936641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:11.937458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:11.938266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:11.939754 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 774/1540] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:35:11.945420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:11.962183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6805f253401d4b77a87bf418520e0ae7', 'request_id': 'req-b1e4bc9f-f97b-4e83-849e-81915179351d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:11.986640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6805f253401d4b77a87bf418520e0ae7', 'request_id': 'req-b1e4bc9f-f97b-4e83-849e-81915179351d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:11.998578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6805f253401d4b77a87bf418520e0ae7', 'request_id': 'req-b1e4bc9f-f97b-4e83-849e-81915179351d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.031661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:12.043347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:12.117332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a77cb-6dc1-4f3e-9214-aa9b83e73ab9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:12.121703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] The token cache is being invalidate because project 6805f253401d4b77a87bf418520e0ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:12.127973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.128138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:12.128291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.128382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.128382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.128382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.128621 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 767/1541] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:11 2022] DELETE /identity/v3/projects/6805f253401d4b77a87bf418520e0ae7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:12.128888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:12.128989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:12.130519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:12.131605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:12.134418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 775/1542] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:11 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:12.223895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4bc9f-f97b-4e83-849e-81915179351d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:12.229195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:12.229824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.230096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.230381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] PATH_INFO: `/v3/users/27627294e8d84e9180b2c7fd4b2d9e47` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.231474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27627294e8d84e9180b2c7fd4b2d9e47)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:12.233414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:12.346944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:12.348919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:12.366308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5031-82c6-4b10-8654-b4482c296d6b tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:12.371530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:12.372171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.372623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.372812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] PATH_INFO: `/v3/projects/1f15c4db967845f387ede6b5345add8a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.374881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f15c4db967845f387ede6b5345add8a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:12.380685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:12.463949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27627294e8d84e9180b2c7fd4b2d9e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.506800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f15c4db967845f387ede6b5345add8a', 'request_id': 'req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.516806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f15c4db967845f387ede6b5345add8a', 'request_id': 'req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.555695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27627294e8d84e9180b2c7fd4b2d9e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.570519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27627294e8d84e9180b2c7fd4b2d9e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.580063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27627294e8d84e9180b2c7fd4b2d9e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.580837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d71e078-7de9-4b8d-b4db-1dfeae313375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27627294e8d84e9180b2c7fd4b2d9e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.587217 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 768/1543] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:12 2022] DELETE /identity/v3/users/27627294e8d84e9180b2c7fd4b2d9e47 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:12.588468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce25f3-1be5-45b6-b0af-3e776c337a7e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.588848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce25f3-1be5-45b6-b0af-3e776c337a7e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.589121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce25f3-1be5-45b6-b0af-3e776c337a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.611033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-82ce25f3-1be5-45b6-b0af-3e776c337a7e None None] MFA Rules not processed for user `24b22ee41c3d4fdeb0152828002c6b04`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:12.612259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82ce25f3-1be5-45b6-b0af-3e776c337a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:12.636322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f15c4db967845f387ede6b5345add8a', 'request_id': 'req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.649791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] The token cache is being invalidate because project 1f15c4db967845f387ede6b5345add8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:12.650546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.650873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3a9dbd2-4f8a-4003-aed9-a859c4fffdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:12.652603 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 776/1544] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:12 2022] DELETE /identity/v3/projects/1f15c4db967845f387ede6b5345add8a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:12.657748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.658080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.658828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.684238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:12.685735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:12.697225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 769/1545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:12.761646 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 777/1546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:12.769760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.770249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.770534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.791543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:12.792966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:12.797087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:12.803549 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 770/1547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:12.809201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:12.820968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d967a9-8617-4ed7-8db0-f541d30c2a90 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:12.827039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:12.827662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.828006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.829634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.829634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:12.829634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:12.831396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:12.847264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 778/1548] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:12.850686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:12.862487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e893256-d771-428c-9daa-ebb150b20d63 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:12.867562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:12.876228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:12.877584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:12.877973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:12.878489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:12.879259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:12.881465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:12.993082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 771/1549] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:12 2022] POST /identity/v3/projects => generated 397 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:12.998062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.009977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06e8f5-2b21-45fd-ac57-2c8b6bee0f91 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.112140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.112856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.113135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.113404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.114052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.115984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.219338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 779/1550] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:12 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:13.220989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.239051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11289275-6cfb-45a0-91cd-0744c716e1f0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.251548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.254154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.256962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.259878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.267436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.271988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db970bef-9c10-4e4a-81c5-b56af17c6c41 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.301820 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 772/1551] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:13.306705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.319496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07c10-9744-42f3-95ba-044910f6d66d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.328165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.328789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.331824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.331824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 773/1552] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:13.332625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.333561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.334020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.334611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.335887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.337667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:35:13.339654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.346888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.371830 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 780/1553] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:13.376727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.388810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1400aed-dad5-4fa8-b0d3-7c69191afe2c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.396600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.397815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.398184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.398697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] PATH_INFO: `/v3/projects/9774a0fd28c545c490450ef89610c63d/users/ff76a6cbd0154558a0617fd081412831/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.429048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9774a0fd28c545c490450ef89610c63d, user_id=ff76a6cbd0154558a0617fd081412831, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.429696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.474955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.476789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.528831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 781/1554] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:13 2022] PUT /identity/v3/projects/9774a0fd28c545c490450ef89610c63d/users/ff76a6cbd0154558a0617fd081412831/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:13.528831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.528831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.556191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851f47b-70bb-48a4-a2a1-7009de37e978 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.604358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957d69-c2e7-465b-b4e9-0c76ce83e172 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.609759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.610417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.610693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.610971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] PATH_INFO: `/v3/projects/b1abfec53159448bb1fa4fa39de8147c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.612144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1abfec53159448bb1fa4fa39de8147c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.614408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.646956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58b5b0dac88b438b84aa8e86b11782d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61db76a3934e4e5182a00a9706c7c637', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.648244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.648558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.649301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.650752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorizing `identity:get_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.653153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad177ac6-36cf-489f-ba57-102b59f71c45 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.655082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 774/1555] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:35:13 2022] GET /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 383 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:13.656908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.657508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.657886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.680305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:13.683075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.693857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 775/1556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:13.705376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.707056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.741606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1abfec53159448bb1fa4fa39de8147c', 'request_id': 'req-144634dc-7ef8-47fe-8fe3-29d22c64ef37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:13.748296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1abfec53159448bb1fa4fa39de8147c', 'request_id': 'req-144634dc-7ef8-47fe-8fe3-29d22c64ef37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:13.777215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727dd3d2-2ed7-49b9-87a3-f13c4a39fdd9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.829464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.830077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.830356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.830673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.835470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1abfec53159448bb1fa4fa39de8147c', 'request_id': 'req-144634dc-7ef8-47fe-8fe3-29d22c64ef37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:13.851045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] The token cache is being invalidate because project b1abfec53159448bb1fa4fa39de8147c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:13.851368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:13.852198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-144634dc-7ef8-47fe-8fe3-29d22c64ef37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:13.854007 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 782/1557] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:13 2022] DELETE /identity/v3/projects/b1abfec53159448bb1fa4fa39de8147c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:13.859237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a617-c452-4ba7-a3e6-a18acc272f6f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.860293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a617-c452-4ba7-a3e6-a18acc272f6f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.861361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712a617-c452-4ba7-a3e6-a18acc272f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.885428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b712a617-c452-4ba7-a3e6-a18acc272f6f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:13.886639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b712a617-c452-4ba7-a3e6-a18acc272f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.905681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.907256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.917929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 776/1558] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:13.919221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:13.920752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:13.924854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.940814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94229b-e5be-47ee-81fd-1b1e4f8f19c2 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:13.945750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:13.946408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.946683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.946953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] PATH_INFO: `/v3/users/24b22ee41c3d4fdeb0152828002c6b04` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.948116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b22ee41c3d4fdeb0152828002c6b04)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:13.950097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:13.968677 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 783/1559] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:13.970159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:13.970454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:13.970731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:13.993070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:13.994355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:14.003584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 784/1560] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:14.007899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.018529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790e9b-0fde-48b0-9696-c18f0bb7bc7a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.024420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.025202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.025650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.026223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.027114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:14.027650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.029485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.043317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 785/1561] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:14.048641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.060895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b487b2c-975e-4208-84db-ffcee49f97ba admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.067295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.068680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.068898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.069251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.069963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.071978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.309803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 786/1562] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:14 2022] POST /identity/v3/projects => generated 389 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:14.313174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b22ee41c3d4fdeb0152828002c6b04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:14.313789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.399948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a928e3-4850-4d2f-916d-2b5f92586098 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.405013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.406038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.406347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.406761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.407263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.409426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.470449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b22ee41c3d4fdeb0152828002c6b04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:14.483275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b22ee41c3d4fdeb0152828002c6b04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:14.491235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b22ee41c3d4fdeb0152828002c6b04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:14.491937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f57fad7-5be1-488d-8b12-10b47330d1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b22ee41c3d4fdeb0152828002c6b04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:14.505062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 777/1563] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:13 2022] DELETE /identity/v3/users/24b22ee41c3d4fdeb0152828002c6b04 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:14.510689 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 787/1564] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:14 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:14.512639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.513274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.513711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.518677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.520573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:14.541231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:14.544467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:14.568697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b6497-fb14-4643-855c-823f1e7f7653 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.631031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 778/1565] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:14.651851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.653053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.653825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:14.653948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.655032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.655430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.656180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.658363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.679861 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 788/1566] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:14.684332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.700032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9abe-2d0a-4d20-8266-e1032d92a4ca admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.712657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.714607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.715431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.716052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.718482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.721011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.733073 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 789/1567] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:14.738228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:14.742561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:14.748353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ec1c4-0151-487c-ad5c-f560ea43034b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.750779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395c7c1-68be-4be1-b5de-14e7de8ce8bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:14.752937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.753559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.753833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.755357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.757240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:14.758065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.758617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.759098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] PATH_INFO: `/v3/projects/68abab7b1d134580af56b6adc152c586/users/ee18e670130e4d02a77af204c5440d6f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.764167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.766234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d1be4-a816-45fc-9505-4d8192e131a5 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.777785 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 779/1568] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:14.778439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68abab7b1d134580af56b6adc152c586, user_id=ee18e670130e4d02a77af204c5440d6f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:14.781152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:14.867646 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 790/1569] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:14 2022] PUT /identity/v3/projects/68abab7b1d134580af56b6adc152c586/users/ee18e670130e4d02a77af204c5440d6f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:14.879165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:14.879454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:14.881654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:14.913417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] MFA Rules not processed for user `ee18e670130e4d02a77af204c5440d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:14.914740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:14.992647 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 780/1570] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:14.995055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.058600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:15.082452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b43435-5118-497f-9d94-6edb37a151c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:15.088827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:15.089537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.089811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.090087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.090756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:15.092726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:15.356773 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 791/1571] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:14 2022] POST /identity/v3/projects => generated 391 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:15.360887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.369876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e60773-bb7b-4441-b0ed-7955085349b0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:15.441391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:15.441998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.442272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.442538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.443162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:15.446858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:15.578709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.582348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:15.602426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81e08b-cb69-48e0-a83f-18a607c92311 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:15.607428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:15.608156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.608531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.608843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] PATH_INFO: `/v3/projects/633337daf8c944329d1a7d85446af8c7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.610529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633337daf8c944329d1a7d85446af8c7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:15.612667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:15.693515 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 781/1572] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:15 2022] POST /identity/v3/users => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:15.697791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.708603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbb70-f76a-481a-bb29-73c8c6bb9fa6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:15.713407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:15.714016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.714286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.715974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.715974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:15.716927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:15.729673 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 782/1573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:15.746697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.759094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f06026-f149-4934-9275-1c467341a9cd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:15.766503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:15.767666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.767666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.767822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] PATH_INFO: `/v3/projects/63e013796ad4483e91c02ce7d80dc28a/users/4ef7a4794d9742e5bb1037b31a8e9385/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.791007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e013796ad4483e91c02ce7d80dc28a, user_id=4ef7a4794d9742e5bb1037b31a8e9385, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:15.794904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b5517-8937-4439-ace4-d63863c10147 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:15.918189 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 783/1574] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:15 2022] PUT /identity/v3/projects/63e013796ad4483e91c02ce7d80dc28a/users/4ef7a4794d9742e5bb1037b31a8e9385/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:15.924937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f33b0-0ddb-4051-abf1-99a040d891de None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:15.924937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f33b0-0ddb-4051-abf1-99a040d891de None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:15.924937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f33b0-0ddb-4051-abf1-99a040d891de None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:15.924937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 784/1575] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:15.928250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f33b0-0ddb-4051-abf1-99a040d891de None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:15.937371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633337daf8c944329d1a7d85446af8c7', 'request_id': 'req-c9fa1023-ccd2-4c49-97e9-903cdfe86936'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:15.951625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633337daf8c944329d1a7d85446af8c7', 'request_id': 'req-c9fa1023-ccd2-4c49-97e9-903cdfe86936'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.020541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f33b0-0ddb-4051-abf1-99a040d891de None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:16.025753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:16.031149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.031149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.031149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.031149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:16.031149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8925d-7264-4839-a226-d8944815ff04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:16.039777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 785/1576] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:16.041480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.041480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.041883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.052466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633337daf8c944329d1a7d85446af8c7', 'request_id': 'req-c9fa1023-ccd2-4c49-97e9-903cdfe86936'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.071631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] The token cache is being invalidate because project 633337daf8c944329d1a7d85446af8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:16.072285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.072624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.073830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:16.074315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 792/1577] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:15 2022] DELETE /identity/v3/projects/633337daf8c944329d1a7d85446af8c7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:16.075452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:16.078291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:16.080739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:16.181241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1023-ccd2-4c49-97e9-903cdfe86936 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:16.193185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:16.193976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.195187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.195517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] PATH_INFO: `/v3/projects/63e013796ad4483e91c02ce7d80dc28a/users/4ef7a4794d9742e5bb1037b31a8e9385/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.197882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e013796ad4483e91c02ce7d80dc28a, user_id=4ef7a4794d9742e5bb1037b31a8e9385, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:16.200725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:16.206119 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 786/1578] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:16.206980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:16.208328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:16.213575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 793/1579] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:16 2022] PUT /identity/v3/projects/63e013796ad4483e91c02ce7d80dc28a/users/4ef7a4794d9742e5bb1037b31a8e9385/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:16.220810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:16.222233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4390d6-d853-422f-8f00-c64a569f7ed6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:16.222699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:16.291498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:16.292312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.292900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.293272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] PATH_INFO: `/v3/users/58b5b0dac88b438b84aa8e86b11782d3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.294542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b5b0dac88b438b84aa8e86b11782d3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:16.298465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:16.315519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:16.337622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296eff7-4353-4131-bd76-4480570ad72d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:16.346922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:16.347553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.347831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.348098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.358259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:16.361498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104650d-25fc-4ba9-83d0-98b755ce1f5f service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:16.381783 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 794/1580] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:16.384847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.385454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.386056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.430570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] MFA Rules not processed for user `4ef7a4794d9742e5bb1037b31a8e9385`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:16.432857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:16.534534 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 795/1581] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:16 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:16.546937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:16.571822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890ee75-7b71-45a5-8092-7a89ab962873 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:16.575456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b5b0dac88b438b84aa8e86b11782d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.580722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:16.581625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:16.581940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:16.582447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:16.592198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:16.593931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:16.604229 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 796/1582] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:16.755553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b5b0dac88b438b84aa8e86b11782d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.775429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b5b0dac88b438b84aa8e86b11782d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.785027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b5b0dac88b438b84aa8e86b11782d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.785865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fb507d08-e3c6-41bb-81ca-eaf56522dccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b5b0dac88b438b84aa8e86b11782d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:16.793494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 787/1583] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:16 2022] DELETE /identity/v3/users/58b5b0dac88b438b84aa8e86b11782d3 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:16.878035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:16.941304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:16.953093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5385b-affc-4ee2-b799-79c5c5e8df9c service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:17.057804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:17.058090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:17.058394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:17.059746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] PATH_INFO: `/v3/users/ee18e670130e4d02a77af204c5440d6f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:17.060595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee18e670130e4d02a77af204c5440d6f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:17.062724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:17.364000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee18e670130e4d02a77af204c5440d6f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.447452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee18e670130e4d02a77af204c5440d6f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.463661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee18e670130e4d02a77af204c5440d6f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.464393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee18e670130e4d02a77af204c5440d6f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.465044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee18e670130e4d02a77af204c5440d6f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.481741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 797/1584] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:16 2022] DELETE /identity/v3/users/ee18e670130e4d02a77af204c5440d6f => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:17.488276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:17.489025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:17.489728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:17.531579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:17.533292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:17.606440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:17.608803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:17.656724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 788/1585] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:17.676143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:17.683140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:17.775307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbbef-f80e-4328-8e55-882d2e4f16eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:17.782953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:17.783729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:17.784213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:17.784592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] PATH_INFO: `/v3/projects/61db76a3934e4e5182a00a9706c7c637` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:17.788030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61db76a3934e4e5182a00a9706c7c637)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:17.789365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:17.818538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e05d0-09de-41f9-a1db-78d8270c815a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:17.824899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:17.825651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:17.825997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:17.826337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:17.843454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:17.845323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b227f-47c9-435e-a7bb-4e16040e108b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:17.857842 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 789/1586] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:17.937397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61db76a3934e4e5182a00a9706c7c637', 'request_id': 'req-eded46e6-7513-4cbb-8e48-f7671809f910'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:17.944286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61db76a3934e4e5182a00a9706c7c637', 'request_id': 'req-eded46e6-7513-4cbb-8e48-f7671809f910'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:18.115755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61db76a3934e4e5182a00a9706c7c637', 'request_id': 'req-eded46e6-7513-4cbb-8e48-f7671809f910'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:18.130586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] The token cache is being invalidate because project 61db76a3934e4e5182a00a9706c7c637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:18.131238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:18.132161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eded46e6-7513-4cbb-8e48-f7671809f910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:18.134226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 798/1587] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:17 2022] DELETE /identity/v3/projects/61db76a3934e4e5182a00a9706c7c637 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:18.141380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.141786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.142157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.177441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:18.179868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:18.261904 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 790/1588] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:18.270268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.270552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.270828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.295052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:18.296168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:18.310691 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 799/1589] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:18.315927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.330697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f9f5a-1ad7-40a5-832c-d385198b4847 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.337015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:18.338017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.338523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.339039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.339914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:18.340657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:18.342743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:18.371694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 791/1590] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:18.376568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.392445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f63881-35a4-4f32-a8b4-2f5edff8bf44 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.399558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:18.401923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.402605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.403028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.403943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:18.406510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:18.569507 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 800/1591] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:18 2022] POST /identity/v3/projects => generated 409 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:18.574096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.604531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa82cf-9ed0-4b70-9040-ff1f074f5a56 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.636931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:18.717259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:18.718984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.719635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.720062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.720876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:18.723430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:18.763903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.766933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:18.800329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01111b-51fe-4f3b-a0e1-b64e6c02cba1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.809992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:18.811228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.811896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.812859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] PATH_INFO: `/v3/projects/68abab7b1d134580af56b6adc152c586` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.816372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68abab7b1d134580af56b6adc152c586)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:18.821463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:18.892534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 792/1592] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:18 2022] POST /identity/v3/users => generated 305 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:18.893818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.906150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55ef5e-435e-4826-b52e-f4d1a28d2b9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.911761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:18.912644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:18.913017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:18.913616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:18.914333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:18.922225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:18.938499 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 793/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:18.940533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:18.969126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b99ea1-cbec-457d-8810-7dab5a80ba31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:18.984911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68abab7b1d134580af56b6adc152c586', 'request_id': 'req-f31b239a-1983-4516-bebf-2edeca0baa03'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.001930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68abab7b1d134580af56b6adc152c586', 'request_id': 'req-f31b239a-1983-4516-bebf-2edeca0baa03'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.081997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:19.083016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:19.083476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:19.083740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:19.084460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:19.086451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:19.102466 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 794/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:19.104756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68abab7b1d134580af56b6adc152c586', 'request_id': 'req-f31b239a-1983-4516-bebf-2edeca0baa03'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.115896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:19.128606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] The token cache is being invalidate because project 68abab7b1d134580af56b6adc152c586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:19.129677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.131382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:19.132239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.138398 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 801/1595] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:18 2022] DELETE /identity/v3/projects/68abab7b1d134580af56b6adc152c586 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:19.138582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca6098-596f-40f6-ab97-9d8e274deda3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:19.142519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:19.145600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:19.146498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:19.147504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:19.147784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:19.148188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] PATH_INFO: `/v3/projects/6082c50158ed4341a4aa503bf291fa85/users/058d176a3bc04b83a84896409c6b54a9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:19.166672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b239a-1983-4516-bebf-2edeca0baa03 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:19.167079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082c50158ed4341a4aa503bf291fa85, user_id=058d176a3bc04b83a84896409c6b54a9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:19.170169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9372df-0319-4880-95fa-26725cac8d43 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:19.173733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:19.174628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:19.174909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:19.180424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] PATH_INFO: `/v3/users/4ef7a4794d9742e5bb1037b31a8e9385` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:19.180424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef7a4794d9742e5bb1037b31a8e9385)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:19.180424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:19.329992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 795/1596] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:19 2022] PUT /identity/v3/projects/6082c50158ed4341a4aa503bf291fa85/users/058d176a3bc04b83a84896409c6b54a9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:19.341398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55286772-8e3a-499c-901c-264a595530e4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:19.354894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55286772-8e3a-499c-901c-264a595530e4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:19.356064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55286772-8e3a-499c-901c-264a595530e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:19.395284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-55286772-8e3a-499c-901c-264a595530e4 None None] MFA Rules not processed for user `058d176a3bc04b83a84896409c6b54a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:19.399217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55286772-8e3a-499c-901c-264a595530e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:19.496036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef7a4794d9742e5bb1037b31a8e9385'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.540383 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 796/1597] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:19 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:19.545007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55286772-8e3a-499c-901c-264a595530e4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:19.547973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55286772-8e3a-499c-901c-264a595530e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:19.550904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef7a4794d9742e5bb1037b31a8e9385'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.580277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef7a4794d9742e5bb1037b31a8e9385'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.581379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef7a4794d9742e5bb1037b31a8e9385'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.582260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef7a4794d9742e5bb1037b31a8e9385'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:19.617882 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 802/1598] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:19 2022] DELETE /identity/v3/users/4ef7a4794d9742e5bb1037b31a8e9385 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:19.633416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55286772-8e3a-499c-901c-264a595530e4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:19.708473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:19.709520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:19.710048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:19.710530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:19.711271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:19.713554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:19.881861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 797/1599] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:19 2022] POST /identity/v3/projects => generated 409 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:19.883204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:19.885629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:19.914597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a06fd-4e92-4299-b7af-88bf4ca3c04b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:20.109468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:20.110368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.112384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.112889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.113710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:20.122564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:20.293801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 803/1600] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:19 2022] POST /identity/v3/users => generated 311 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:20.298911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:20.314320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155ef1-0d3a-42a7-a99e-705d77c2b77a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:20.322292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:20.322292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.322292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.322292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.322882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:20.326003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:20.341323 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 798/1601] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:20.345720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:20.360564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d0d10-2558-4880-a65a-f533c4811179 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:20.366095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:20.366672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.366952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.367231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] PATH_INFO: `/v3/projects/216ab535ab5e4b6088cf73a781ed6f45/users/29fced1a7f4e4e128324d00c0e471f99/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.389826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216ab535ab5e4b6088cf73a781ed6f45, user_id=29fced1a7f4e4e128324d00c0e471f99, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:20.392920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:20.533956 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 804/1602] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:20 2022] PUT /identity/v3/projects/216ab535ab5e4b6088cf73a781ed6f45/users/29fced1a7f4e4e128324d00c0e471f99/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:20.539005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:20.557168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1d86e-0410-4455-8456-2f1d3aecd17c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:20.693140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:20.693867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.694265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.694460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.696132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:20.698845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4cc9bf-6d47-4caa-93f4-41b044d3b04b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:20.717780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 799/1603] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:20.741003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:20.746657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20528a-c4a2-43bc-8bda-d9bdb508dda9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:20.754197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:20.755420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.755420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.755420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] PATH_INFO: `/v3/projects/216ab535ab5e4b6088cf73a781ed6f45/users/29fced1a7f4e4e128324d00c0e471f99/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.759414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=216ab535ab5e4b6088cf73a781ed6f45, user_id=29fced1a7f4e4e128324d00c0e471f99, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:20.762620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:20.779613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 805/1604] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:20 2022] PUT /identity/v3/projects/216ab535ab5e4b6088cf73a781ed6f45/users/29fced1a7f4e4e128324d00c0e471f99/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:20.797552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:20.799283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:20.799283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:20.851430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] MFA Rules not processed for user `29fced1a7f4e4e128324d00c0e471f99`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:20.852750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:20.938342 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 800/1605] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:20 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:20.946403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.012552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.014225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:21.037164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de9ffe-df06-40d2-bdac-18ca30da9920 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:21.038263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80366-2f0b-407e-9c5c-f8e087e7adb3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:21.042879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:21.043473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:21.052303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.052303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.052744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.052842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] PATH_INFO: `/v3/projects/63e013796ad4483e91c02ce7d80dc28a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.052920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.052920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] PATH_INFO: `/v3/users/058d176a3bc04b83a84896409c6b54a9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.053044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e013796ad4483e91c02ce7d80dc28a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:21.053120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=058d176a3bc04b83a84896409c6b54a9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:21.053186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:21.053250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:21.157614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e013796ad4483e91c02ce7d80dc28a', 'request_id': 'req-f4304d89-9900-4a18-914b-528d253b1a4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.183064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e013796ad4483e91c02ce7d80dc28a', 'request_id': 'req-f4304d89-9900-4a18-914b-528d253b1a4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.196382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e013796ad4483e91c02ce7d80dc28a', 'request_id': 'req-f4304d89-9900-4a18-914b-528d253b1a4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.242918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:21.244727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058d176a3bc04b83a84896409c6b54a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.295472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] The token cache is being invalidate because project 63e013796ad4483e91c02ce7d80dc28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:21.298705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.298705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f4304d89-9900-4a18-914b-528d253b1a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.299726 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 801/1606] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:21 2022] DELETE /identity/v3/projects/63e013796ad4483e91c02ce7d80dc28a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:21.304447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16774950-590d-40ed-8517-b7ae2ffe3174 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.322506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16774950-590d-40ed-8517-b7ae2ffe3174 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.322506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16774950-590d-40ed-8517-b7ae2ffe3174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.366768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058d176a3bc04b83a84896409c6b54a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.367401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-16774950-590d-40ed-8517-b7ae2ffe3174 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:21.368652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16774950-590d-40ed-8517-b7ae2ffe3174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:21.388681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058d176a3bc04b83a84896409c6b54a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.390228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058d176a3bc04b83a84896409c6b54a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.390994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6983c21b-727f-4197-9f8e-ef0c038c98ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058d176a3bc04b83a84896409c6b54a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:21.412999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 806/1607] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:20 2022] DELETE /identity/v3/users/058d176a3bc04b83a84896409c6b54a9 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:21.418156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.419077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.419233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.464207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:21.466308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:21.471914 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 802/1608] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:21.479175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.479449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.479716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.507693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:21.509361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:21.570562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 807/1609] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:21.581267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.583083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:21.676300 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 803/1610] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:21.680572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.696706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef0b9c-0d11-469b-83d2-0216a44a8358 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:21.704031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:21.705149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.705430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.705701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.706366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:21.706661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:21.708392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:21.716897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815955fc-95b7-4226-a1aa-79a0876683ea None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:21.729334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 804/1611] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:21.732555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:21.733435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.733762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.734020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.734129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.749765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa69ae0-5cfe-4a98-a986-d8c397462610 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:21.755268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:21.756036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:21.756926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:21.757312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:21.757886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:21.758682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:21.759015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:21.761770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:21.773405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:21.782630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 808/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:21.911289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 805/1613] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:21 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:21.915611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:21.932676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57520f5a-8d56-485e-84c7-51439fab8d4f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.040216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.040879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.041961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.042245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.042919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.045216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.112413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 809/1614] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:21 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:22.116276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.137967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c70d5-1bf7-4bd4-8c32-6fcb8bffb2b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.150698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.151486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.151864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.152231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.153067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.157431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.160284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.162601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.180955 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 806/1615] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:22.186272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.201312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff48c82-0c36-492d-9cb0-8fd21174995a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.206978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.207581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.207858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.208144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.208846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.210502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.225324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 807/1616] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:22.226324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.237401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe85cfc-e328-4c03-8c8a-a0bdc7cb94c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.242618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.243473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.243751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.244027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] PATH_INFO: `/v3/projects/9929679b00cb4db39002b1ae432a2539/users/976993a09f2342c68dab07da6a7dd236/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.261759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c94e-1afb-45b0-9bf6-e4a505787ef6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.264243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9929679b00cb4db39002b1ae432a2539, user_id=976993a09f2342c68dab07da6a7dd236, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.267204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515a2bc-22d6-4e61-8045-0c8f811f4d9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.268852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.269388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.269630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.270001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.272064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.343949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.345748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.356974 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 810/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:22.367875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 808/1618] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:22 2022] PUT /identity/v3/projects/9929679b00cb4db39002b1ae432a2539/users/976993a09f2342c68dab07da6a7dd236/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:22.374141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.375799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.380433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.380676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.381072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.412511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32cf54-3551-4305-aa2c-9976addd16f2 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.423089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] MFA Rules not processed for user `976993a09f2342c68dab07da6a7dd236`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:22.424544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.467102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:22.562142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.563282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.564905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.566787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] PATH_INFO: `/v3/projects/6082c50158ed4341a4aa503bf291fa85` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.570036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6082c50158ed4341a4aa503bf291fa85)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.574118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.597523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 809/1619] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:22.605488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.621822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43f45a-c1c0-4940-82f8-68da381289d0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:22.631822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:22.632466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.641430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.641430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.641430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:22.641430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad07656-c88e-4bf2-8361-21068139bb2e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:22.796521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6082c50158ed4341a4aa503bf291fa85', 'request_id': 'req-b827e45d-8ca0-4918-be83-d10d90cad9b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:22.812148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6082c50158ed4341a4aa503bf291fa85', 'request_id': 'req-b827e45d-8ca0-4918-be83-d10d90cad9b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:22.818660 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 810/1620] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:22 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:22.821377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:22.821900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:22.822387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:22.862983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] MFA Rules not processed for user `ff76a6cbd0154558a0617fd081412831`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:22.864275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.916076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6082c50158ed4341a4aa503bf291fa85', 'request_id': 'req-b827e45d-8ca0-4918-be83-d10d90cad9b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:22.931693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] The token cache is being invalidate because project 6082c50158ed4341a4aa503bf291fa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:22.932265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:22.934050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:22.937944 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 811/1621] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:22 2022] DELETE /identity/v3/projects/6082c50158ed4341a4aa503bf291fa85 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:22.938809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.942676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:22.969737 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 811/1622] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:22.970893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:22.972369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:23.058054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827e45d-8ca0-4918-be83-d10d90cad9b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.084932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680c19e-2581-4030-97b7-619948cf9ca1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.093593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.094439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.094808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.095211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] PATH_INFO: `/v3/users/29fced1a7f4e4e128324d00c0e471f99` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.096477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fced1a7f4e4e128324d00c0e471f99)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.098520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.164404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.165604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.166216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.166563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.167300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.170034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.293286 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 812/1623] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:22 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:23.294132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.299548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:23.300706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:23.309348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fced1a7f4e4e128324d00c0e471f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:23.312331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91931f5-53b9-4766-8f67-4c78724f14b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.317346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.318181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.318278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.318669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.319460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.321442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.395457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fced1a7f4e4e128324d00c0e471f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:23.409932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fced1a7f4e4e128324d00c0e471f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:23.417271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fced1a7f4e4e128324d00c0e471f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:23.418089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fced1a7f4e4e128324d00c0e471f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:23.424467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 812/1624] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:22 2022] DELETE /identity/v3/users/29fced1a7f4e4e128324d00c0e471f99 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:23.425304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.426661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:23.460064 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 813/1625] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:23 2022] POST /identity/v3/projects => generated 395 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:23.463042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.469918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:23.558724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a95e2-82de-4d91-b7e2-c3d8b2917b4c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.599223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16044d4-a1ac-4e12-85c0-263e3959b637 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.606799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.607699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.608148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.608436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.609206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.611237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.636691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.637308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.637585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.637852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.638496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.640696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.651188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 813/1626] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:23.655472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.666100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e491dd-501c-42d6-b72c-efbdb1d1662c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.671479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.672140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.672549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.672834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] PATH_INFO: `/v3/projects/2046c3ec9ae24830ac6194791d986f0d/users/1f30f86e527d484fa6f592b13e4c081d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.691707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2046c3ec9ae24830ac6194791d986f0d, user_id=1f30f86e527d484fa6f592b13e4c081d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.694869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.718009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 814/1627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:23 2022] POST /identity/v3/users => generated 304 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:23.721877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.735069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ade89-8ca8-4a46-9488-3e175bdd188b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.739990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.743037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.743037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.743037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.743037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.744150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.756011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 815/1628] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:23.761709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.773868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e2d69-7055-4197-9a94-d1bcfa405694 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.776172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 814/1629] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:23 2022] PUT /identity/v3/projects/2046c3ec9ae24830ac6194791d986f0d/users/1f30f86e527d484fa6f592b13e4c081d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:23.786331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.852414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.853273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.853558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.853942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] PATH_INFO: `/v3/projects/6f2c8035f0584149a43ffcc4c36d85db/users/c6a478a25bdc454fbe3337bd8525ae41/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.874342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2c8035f0584149a43ffcc4c36d85db, user_id=c6a478a25bdc454fbe3337bd8525ae41, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.877345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.884590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d01b4-febb-4966-ae57-a5b86419d7f1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.893626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.894338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.894687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.895024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.895926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.897809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.908783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 815/1630] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:23.913023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:23.926816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267a7d-b077-44eb-83d7-7a35f1240a00 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:23.935412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:23.935412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.935412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.935412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] PATH_INFO: `/v3/projects/2046c3ec9ae24830ac6194791d986f0d/users/1f30f86e527d484fa6f592b13e4c081d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.935806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2046c3ec9ae24830ac6194791d986f0d, user_id=1f30f86e527d484fa6f592b13e4c081d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:23.937934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702153-731a-40b2-a566-d40cea687f39 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:23.949351 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 816/1631] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:23 2022] PUT /identity/v3/projects/2046c3ec9ae24830ac6194791d986f0d/users/1f30f86e527d484fa6f592b13e4c081d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:23.961310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:23.961593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:23.964035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:23.991642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] MFA Rules not processed for user `1f30f86e527d484fa6f592b13e4c081d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:23.992911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.001691 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 816/1632] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:23 2022] PUT /identity/v3/projects/6f2c8035f0584149a43ffcc4c36d85db/users/c6a478a25bdc454fbe3337bd8525ae41/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:24.006212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.080813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 817/1633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:24.081817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.088444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.110145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b318474-249b-4f60-b314-ae815a6e00e3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.116259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.116434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.116736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.117067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.118057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.119782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face7adc-4043-4e00-8acd-8a5f236c9963 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.132167 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 817/1634] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:24.133750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.135231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.135231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.155666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] MFA Rules not processed for user `976993a09f2342c68dab07da6a7dd236`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:24.157175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.159092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:24.179869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624ce45-f397-4d23-87bc-e3ef07d3c680 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.185683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.185683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.186084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.186968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] PATH_INFO: `/v3/projects/216ab535ab5e4b6088cf73a781ed6f45` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.188197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=216ab535ab5e4b6088cf73a781ed6f45)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.190682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.233836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 818/1635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:24.235309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.247523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e7e3c-54d4-469b-afff-3eff1d2c3699 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.256127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.258302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.258754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.259036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] PATH_INFO: `/v3/projects/6f2c8035f0584149a43ffcc4c36d85db/users/c6a478a25bdc454fbe3337bd8525ae41/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.261214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2c8035f0584149a43ffcc4c36d85db, user_id=c6a478a25bdc454fbe3337bd8525ae41, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.264082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.282564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 819/1636] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:24 2022] PUT /identity/v3/projects/6f2c8035f0584149a43ffcc4c36d85db/users/c6a478a25bdc454fbe3337bd8525ae41/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:24.282564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.284415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.312929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216ab535ab5e4b6088cf73a781ed6f45', 'request_id': 'req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:24.326055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216ab535ab5e4b6088cf73a781ed6f45', 'request_id': 'req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:24.341672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216ab535ab5e4b6088cf73a781ed6f45', 'request_id': 'req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:24.380262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:24.419101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de9573-6c83-40c6-af2a-479017147ac4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.464131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] The token cache is being invalidate because project 216ab535ab5e4b6088cf73a781ed6f45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:24.470929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:24.470929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aae77628-bfe1-4a0c-94db-6984ddfe5c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:24.470929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 818/1637] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:24 2022] DELETE /identity/v3/projects/216ab535ab5e4b6088cf73a781ed6f45 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:24.476864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfbe1-eb34-4ad2-b416-ad6997ca5830 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.477148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfbe1-eb34-4ad2-b416-ad6997ca5830 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.477422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95cfbe1-eb34-4ad2-b416-ad6997ca5830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.516534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e95cfbe1-eb34-4ad2-b416-ad6997ca5830 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:24.517426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e95cfbe1-eb34-4ad2-b416-ad6997ca5830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.572965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.573598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.574240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.574240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.580425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.614147 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 819/1638] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:24.622240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.622537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.624520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.666461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:24.668016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:24.691982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 820/1639] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:24.696660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.708926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244fd9d-d290-498f-8dce-2e707d532c9e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.718720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.719423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.719706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.719976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.721731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:24.722041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.724766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.726329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.729385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.753752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 820/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:24.754888 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 821/1641] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:24.759392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.778339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb226864-636f-4e2e-b83a-9a680df91577 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:24.785388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:24.785581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:24.785824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:24.786059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:24.786763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:24.788845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:24.910927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 821/1642] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:24 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:24.914937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:24.929595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65382cc7-9243-4dd9-8d4d-4e9e1e34304c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.015419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.016131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.016789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.017330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.018292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:25.020947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:25.115641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 822/1643] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:24 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:25.116931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:25.129882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8297d5-f299-41b1-96d5-e32b3fc370b5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.135776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.136440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.136859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.137226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.137953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:25.140420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:25.170103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 822/1644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:25.174262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:25.188699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857640fd-2e6b-47c5-957e-297ef19443d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.193643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.194484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.194902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.195354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.196139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:25.198178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf593cfd-aa68-4772-9e4b-ec7d1b4186f9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:25.216312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:25.222277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 823/1645] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:25.229064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe89fc-4cdf-4ba4-833a-8e17fcbe0721 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.236873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.239152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.240464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.240928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] PATH_INFO: `/v3/projects/6e09079e89384417879f678c0a4df5c2/users/a0475d03f0e14972a733ba9db2d32947/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.277474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e09079e89384417879f678c0a4df5c2, user_id=a0475d03f0e14972a733ba9db2d32947, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:25.282724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:25.401832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 823/1646] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:25 2022] PUT /identity/v3/projects/6e09079e89384417879f678c0a4df5c2/users/a0475d03f0e14972a733ba9db2d32947/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:25.403379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.403684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.403967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.491205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] MFA Rules not processed for user `a0475d03f0e14972a733ba9db2d32947`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:25.493286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:25.605965 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 824/1647] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:25.606392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:25.678440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ceaa2-9184-48f9-8e83-0953a6b170b7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.682875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.683481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.683754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.684020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.685090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:25.694024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:25.829759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:25.840507 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 824/1648] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:25 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:25.847331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:25.872385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c0d2e-fb21-4048-8ada-b35e24707e9a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:25.991748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:25.997166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:25.997526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:25.997882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:25.998767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.001744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.121949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 825/1649] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:25 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:26.122456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:26.140154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc7ca7-b234-4aca-b6bc-0f28b1b86bec admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:26.149969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:26.150588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.150922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.151196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.151853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.157960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e5a4f-85a0-4498-8f53-8fe6abbc6793 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.180808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:26.180808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 825/1650] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:26.183269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:26.200238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889f28-cdb0-4be0-9931-f64a1a041378 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:26.215459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:26.217193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.218163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.219258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] PATH_INFO: `/v3/projects/6d61f8d464244db0af7240cab16d8363/users/a2e39bbd0dc6473d9f912564957b5476/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.247207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d61f8d464244db0af7240cab16d8363, user_id=a2e39bbd0dc6473d9f912564957b5476, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.252082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.330260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d621-efe5-495c-86cf-cc119b03368e None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.330653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d621-efe5-495c-86cf-cc119b03368e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.330991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025d621-efe5-495c-86cf-cc119b03368e None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.333808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 826/1651] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:35:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:26.341754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.343679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.344131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.375950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] MFA Rules not processed for user `c48d278dd82d4be0b5a79b225c962d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:26.377721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:26.389698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 826/1652] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:26 2022] PUT /identity/v3/projects/6d61f8d464244db0af7240cab16d8363/users/a2e39bbd0dc6473d9f912564957b5476/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:26.395941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:26.528051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 827/1653] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:26.548250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:26.550807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:26.554562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67096-4839-45d5-b5c3-3404444f03f3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:26.556385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:26.557067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.557454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.557815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.558533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.560626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.572875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 827/1654] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:26.577707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:26.597111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578a58-aa65-41e6-96f1-b3cdcf524721 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:26.600196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687513d7-15c5-4f75-b0e4-cf2dc78b1104 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:26.604708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:26.605547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.605890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.606091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:26.606266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.607222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.607720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.608067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] PATH_INFO: `/v3/projects/6d61f8d464244db0af7240cab16d8363/users/a2e39bbd0dc6473d9f912564957b5476/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.610483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d61f8d464244db0af7240cab16d8363, user_id=a2e39bbd0dc6473d9f912564957b5476, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.613910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79263641-1d63-49ac-9f45-dd9210944c9b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.616682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:26.618473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e8e35-d825-4532-baf2-80eae0873b74 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:26.627971 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 828/1655] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:26 2022] PUT /identity/v3/projects/6d61f8d464244db0af7240cab16d8363/users/a2e39bbd0dc6473d9f912564957b5476/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:26.638819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.639689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.639948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.643882 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 828/1656] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:26.712200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] MFA Rules not processed for user `a2e39bbd0dc6473d9f912564957b5476`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:26.716085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:26.847878 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 829/1657] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:26.862338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55f08-6c65-4c75-95c3-94748c49c81e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:26.864723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55f08-6c65-4c75-95c3-94748c49c81e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:26.865400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b55f08-6c65-4c75-95c3-94748c49c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:26.894932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-80b55f08-6c65-4c75-95c3-94748c49c81e None None] MFA Rules not processed for user `a0475d03f0e14972a733ba9db2d32947`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:26.896825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80b55f08-6c65-4c75-95c3-94748c49c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:26.976537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 829/1658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:26.988371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:27.095882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332828a4-f8c9-4fd3-baa5-73ff85db38f9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:27.105480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:27.107296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:27.107729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:27.108123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:27.120328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:27.122154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:27.123684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076cd9fb-a54c-46f9-b223-aa7cd8549869 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:27.134394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 830/1659] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:27.363281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:28.040704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373321-20ed-495e-bea0-6ab092ec30a2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:28.041689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373321-20ed-495e-bea0-6ab092ec30a2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:28.042328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0373321-20ed-495e-bea0-6ab092ec30a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:28.071216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b0373321-20ed-495e-bea0-6ab092ec30a2 None None] MFA Rules not processed for user `a0475d03f0e14972a733ba9db2d32947`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:28.075320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0373321-20ed-495e-bea0-6ab092ec30a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:28.095443 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 830/1660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:28.141754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c553128-8af9-4b43-b2fd-de4f3758a1c1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:28.142304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c553128-8af9-4b43-b2fd-de4f3758a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:28.142304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c553128-8af9-4b43-b2fd-de4f3758a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:28.209249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2c553128-8af9-4b43-b2fd-de4f3758a1c1 None None] MFA Rules not processed for user `936480fc35244d79a3ec7157060a1dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:28.213286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c553128-8af9-4b43-b2fd-de4f3758a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:28.384968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 831/1661] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:28.639674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:28.886631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.927919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:30.743635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:30.931008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:30.931931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:30.932222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:30.934446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 831/1662] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:30.942114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:30.943023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:30.943343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:30.973119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:30.975614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:31.069990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 832/1663] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:31.099677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:31.101717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:31.121902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7335f70-81b6-4c09-8fd9-4eb1dd767842 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:31.129346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:31.130708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:31.131156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:31.131712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:31.148409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:31.150541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30054351-ee0c-4e68-977d-63147198c48a service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:31.162786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 832/1664] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:32.572532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:34.167575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=76,keystone:INSERT=4,keystone:DELETE=20 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:34.503176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:35.421532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:35.423342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:35.588894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:35.589921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:35.590354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:35.647365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba979bc-cadc-4c7f-9a69-7ca0a4e209af None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:35.661695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] MFA Rules not processed for user `b46383fc54d5469884898c1b75ce41ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:35.667228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:35.688115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:35.690354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:35.690834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:35.691752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] PATH_INFO: `/v3/users/820f7a63f6f241a7aba8f3df4903d7b3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:35.696302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820f7a63f6f241a7aba8f3df4903d7b3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:35.703155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:35.780338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 833/1665] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Nov 2 12:35:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:35.871941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:35.874086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:35.892108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1d1a4-3c46-42ea-9573-9df2399308bf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:35.901351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:35.901992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:35.902277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:35.902551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:35.925600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:35.927732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89340f3b-de48-4263-ac89-9ef7a21d43e3 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:35.949641 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 834/1666] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:36.107684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820f7a63f6f241a7aba8f3df4903d7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:36.219267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820f7a63f6f241a7aba8f3df4903d7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:36.262600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820f7a63f6f241a7aba8f3df4903d7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:36.288451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820f7a63f6f241a7aba8f3df4903d7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:36.288451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8588470-1b00-4357-ac38-d3ff44f34771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820f7a63f6f241a7aba8f3df4903d7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:36.322584 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 833/1667] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:35 2022] DELETE /identity/v3/users/820f7a63f6f241a7aba8f3df4903d7b3 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:36.328890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:36.329421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:36.329860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:36.356889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206feb95-f246-4bc3-acdc-80e8dff80074 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:36.356889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206feb95-f246-4bc3-acdc-80e8dff80074 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:36.356889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206feb95-f246-4bc3-acdc-80e8dff80074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:36.361924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:36.377738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:36.389808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:36.400664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-206feb95-f246-4bc3-acdc-80e8dff80074 None None] MFA Rules not processed for user `c6a478a25bdc454fbe3337bd8525ae41`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:36.403300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-206feb95-f246-4bc3-acdc-80e8dff80074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:36.563394 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 835/1668] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:36.574546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:36.581146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:36.633428 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 834/1669] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:36.645606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6195597-8b8a-40d5-877f-7416c5025413 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:36.646678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6195597-8b8a-40d5-877f-7416c5025413 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:36.647000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6195597-8b8a-40d5-877f-7416c5025413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:36.713428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:36.717986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f6195597-8b8a-40d5-877f-7416c5025413 None None] MFA Rules not processed for user `ff76a6cbd0154558a0617fd081412831`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:36.722994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6195597-8b8a-40d5-877f-7416c5025413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:36.762422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fc9db-f651-4ac4-b74e-751aa6afcea1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:36.776205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:36.778258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:36.778657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:36.779606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:36.810096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:36.811349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:36.847907 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 836/1670] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:36.890897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 835/1671] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:37.092690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:37.092690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:37.184874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3f61-d6d0-4b02-a1c3-1f82c770d632 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:37.192173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:37.193088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:37.193545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:37.194135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:37.196320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:37.213648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:37.222891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b2735b-6704-4a1d-bb8c-65a51d639f45 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:37.255898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 837/1672] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:37 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:38.086220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e7-2806-4a3d-bf79-2ec216def22a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:38.087261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e7-2806-4a3d-bf79-2ec216def22a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:38.087694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ec0e7-2806-4a3d-bf79-2ec216def22a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:38.090519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 836/1673] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:35:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:35:38.097571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:38.098087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:38.098254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:35:38.134026 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:38.137080 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:35:38.139834 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 838/1674] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:35:38 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:35:38.231527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:38.231809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:38.232820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:38.263414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] MFA Rules not processed for user `ff76a6cbd0154558a0617fd081412831`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:38.264237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:38.273796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 837/1675] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:38.499141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:38.501185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:38.557145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:38.577850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:38.579912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:38.580552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:38.581685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] PATH_INFO: `/v3/users/be91377957ed4c9d831820481ff84651` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:38.585022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=be91377957ed4c9d831820481ff84651)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:38.587263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:38.671942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:38.671942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:38.698321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea22ffa-f1cb-4f32-8cb2-e0588d0b0922 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:38.708998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:38.712442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:38.713182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:38.713568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] PATH_INFO: `/v3/projects/116c14805ca74d0b81b03f070c3083f3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:38.715508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] RBAC: Authorizing `identity:delete_project(project_id=116c14805ca74d0b81b03f070c3083f3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:38.728077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:38.903825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be91377957ed4c9d831820481ff84651'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:38.994144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be91377957ed4c9d831820481ff84651'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.016103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116c14805ca74d0b81b03f070c3083f3', 'request_id': 'req-31e0d29d-628a-4d94-8f17-ac59e2a0769f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.024173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be91377957ed4c9d831820481ff84651'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.024985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be91377957ed4c9d831820481ff84651'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.025613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4c28f737-1e24-4f1a-b4d7-905700fa86eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be91377957ed4c9d831820481ff84651'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.027551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116c14805ca74d0b81b03f070c3083f3', 'request_id': 'req-31e0d29d-628a-4d94-8f17-ac59e2a0769f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.047605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116c14805ca74d0b81b03f070c3083f3', 'request_id': 'req-31e0d29d-628a-4d94-8f17-ac59e2a0769f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.057385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 839/1676] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:38 2022] DELETE /identity/v3/users/be91377957ed4c9d831820481ff84651 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:39.062577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5bb5-30ca-4b54-97cd-3b0a262a9aa3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:39.063163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5bb5-30ca-4b54-97cd-3b0a262a9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:39.063626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5bb5-30ca-4b54-97cd-3b0a262a9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:39.094529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-641b5bb5-30ca-4b54-97cd-3b0a262a9aa3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:39.097015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-641b5bb5-30ca-4b54-97cd-3b0a262a9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:39.145147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] The token cache is being invalidate because project 116c14805ca74d0b81b03f070c3083f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:39.153270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.174079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.179235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 838/1677] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:38 2022] DELETE /identity/v3/projects/116c14805ca74d0b81b03f070c3083f3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:39.188935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:39.192269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:39.308975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 840/1678] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:39.313045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:39.313045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:39.313045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:35:39.348779 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:39.350441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:35:39.352289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 841/1679] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:35:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:35:39.361176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0d29d-628a-4d94-8f17-ac59e2a0769f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:39.375378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:39.375378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:39.375378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:39.375378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] PATH_INFO: `/v3/users/93b8a0d6e1dc41fdbb298df3de075310` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:39.380743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=93b8a0d6e1dc41fdbb298df3de075310)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:39.380743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:39.427704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:39.431000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:39.512430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:39.570043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:39.577281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:39.578623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:39.579087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:39.579510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:39.598429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:39.600208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:39.630144 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 842/1680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:39.640366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93b8a0d6e1dc41fdbb298df3de075310'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.703314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93b8a0d6e1dc41fdbb298df3de075310'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.739362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93b8a0d6e1dc41fdbb298df3de075310'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.749534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:39.759370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93b8a0d6e1dc41fdbb298df3de075310'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.761273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93b8a0d6e1dc41fdbb298df3de075310'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:39.779823 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 839/1681] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:39 2022] DELETE /identity/v3/users/93b8a0d6e1dc41fdbb298df3de075310 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:41.723237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:41.725534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:41.763645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:41.771760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:41.772460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d628c9-41e7-4251-a975-a4a2676fda9c service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:41.920919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:41.923388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:41.924067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:41.924553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] PATH_INFO: `/v3/projects/1e2a6e2acadb47809775637d3fa84cae` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:41.926636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2a6e2acadb47809775637d3fa84cae)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:41.935824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:41.970997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68024246-b7cd-4f9e-b99c-6ea7287205ba admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:41.976586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:41.977426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:41.978918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:41.979508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] PATH_INFO: `/v3/projects/c57c40979ba04bd3aff9de517fafd4be` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:41.980987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57c40979ba04bd3aff9de517fafd4be)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:41.983523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:42.123100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2a6e2acadb47809775637d3fa84cae', 'request_id': 'req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.129731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2a6e2acadb47809775637d3fa84cae', 'request_id': 'req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.168448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57c40979ba04bd3aff9de517fafd4be', 'request_id': 'req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.175946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57c40979ba04bd3aff9de517fafd4be', 'request_id': 'req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.182340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57c40979ba04bd3aff9de517fafd4be', 'request_id': 'req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.291524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2a6e2acadb47809775637d3fa84cae', 'request_id': 'req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.304172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] The token cache is being invalidate because project 1e2a6e2acadb47809775637d3fa84cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:42.304576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.305494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.308092 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 843/1682] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:41 2022] DELETE /identity/v3/projects/1e2a6e2acadb47809775637d3fa84cae => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:42.312938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:42.314474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.418058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3ba35-f6c5-4c84-a13c-fd0ed07885d1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:42.421167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] The token cache is being invalidate because project c57c40979ba04bd3aff9de517fafd4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:42.423788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.425856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.437210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 840/1683] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:41 2022] DELETE /identity/v3/projects/c57c40979ba04bd3aff9de517fafd4be => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:42.441797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:42.445189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.498749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:42.504516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.504516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.504516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] PATH_INFO: `/v3/users/e423a70a8c7841a59e86b96cf3187e2d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.508332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e423a70a8c7841a59e86b96cf3187e2d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:42.508909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:42.594315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0340e8-c0df-4a9b-9d18-6561501e8aa9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:42.600973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:42.601714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.602095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.602517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.605143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.706678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:42.708705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4babdd-854e-4962-b83a-0e4aa6a56124 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:42.732586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 841/1684] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:42.735051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79fae-5f76-4e82-8d37-de951041cb53 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.735324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79fae-5f76-4e82-8d37-de951041cb53 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.735743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce79fae-5f76-4e82-8d37-de951041cb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.776729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fce79fae-5f76-4e82-8d37-de951041cb53 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:42.779445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fce79fae-5f76-4e82-8d37-de951041cb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.786078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e423a70a8c7841a59e86b96cf3187e2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.797012 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 842/1685] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:42.805771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.806026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.806570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.849416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:42.851032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.862240 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 843/1686] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:42.866662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:42.876657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1667c-95fe-43f4-888a-2d3196729de0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:42.881700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:42.882388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.882738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.883073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.883844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:42.884205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:42.885957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:42.891222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e423a70a8c7841a59e86b96cf3187e2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.922244 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 844/1687] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:42.932403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e423a70a8c7841a59e86b96cf3187e2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.932403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e423a70a8c7841a59e86b96cf3187e2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.932403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e423a70a8c7841a59e86b96cf3187e2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:42.933217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:42.934745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:42.956379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a75223-2138-4fb5-8486-f52dcb79d965 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:42.961341 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 844/1688] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:42 2022] DELETE /identity/v3/users/e423a70a8c7841a59e86b96cf3187e2d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:42.963556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:42.964184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:42.964464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:42.964796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:42.965485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:42.967535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.053788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:43.064676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 845/1689] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:42 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:43.069000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.168881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb17c88-8711-463b-96b2-3b2b29792ab8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:43.245698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:43.246382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.246754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.247099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.248326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:43.253679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.371278 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 845/1690] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:43 2022] POST /identity/v3/users => generated 297 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:43.373336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.386466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ab96-3723-458b-80be-b922817dd357 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:43.404054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:43.404054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.404054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.404054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.404356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:43.410242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.444249 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 846/1691] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:43.444333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.461983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179b853-4f0d-4bd8-b17e-5b0a7e928d70 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:43.473343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:43.474705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.474705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.475082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.475831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:43.487325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.507634 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 846/1692] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:43.508967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.535684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c46c-ed56-476b-aa35-f658a7d10a33 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:43.546423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:43.547139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.547365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.547632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] PATH_INFO: `/v3/projects/0d02e0867b0f4d90aafc6c469bbdbcdf/users/23ca0e5748bc44249d90b41f18381108/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.570964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.574230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:43.575444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:43.581826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d02e0867b0f4d90aafc6c469bbdbcdf, user_id=23ca0e5748bc44249d90b41f18381108, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:43.595875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fcd15-f4d8-45b5-a92b-b7383f5c5678 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.616676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb786f9-cd6f-45a1-a9f3-28695ca7ba06 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:43.621254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:43.621922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.622901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.623223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] PATH_INFO: `/v3/users/f441720944f34d6dad78783005fa6165` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.624617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f441720944f34d6dad78783005fa6165)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:43.635926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:43.761270 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 847/1693] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:43 2022] PUT /identity/v3/projects/0d02e0867b0f4d90aafc6c469bbdbcdf/users/23ca0e5748bc44249d90b41f18381108/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:43.772939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:43.773232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:43.773508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:43.842065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] MFA Rules not processed for user `23ca0e5748bc44249d90b41f18381108`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:43.844987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:43.855601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f441720944f34d6dad78783005fa6165'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:43.948404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f441720944f34d6dad78783005fa6165'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:43.989922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 848/1694] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:43.989922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:43.991004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.001828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f441720944f34d6dad78783005fa6165'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.002389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f441720944f34d6dad78783005fa6165'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.003018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f441720944f34d6dad78783005fa6165'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.041102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 847/1695] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:43 2022] DELETE /identity/v3/users/f441720944f34d6dad78783005fa6165 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:44.042316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.045150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.133656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96e611-d7a6-4f58-8dc3-253390816aa2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.138649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.139612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.139954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.140297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] PATH_INFO: `/v3/projects/da11f64e6f1b4cf09620b34136d0f57f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.142369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da11f64e6f1b4cf09620b34136d0f57f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.148424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.154022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d60d-c9f0-4ceb-820e-0734771f7712 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.165272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.165272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.167253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.167253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.168480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.173011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee4845-2629-45cf-9cc1-cdfa9bffed01 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.274112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da11f64e6f1b4cf09620b34136d0f57f', 'request_id': 'req-71dcb248-dc19-408d-8c2c-3f6e72449c22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.282352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da11f64e6f1b4cf09620b34136d0f57f', 'request_id': 'req-71dcb248-dc19-408d-8c2c-3f6e72449c22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.307047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da11f64e6f1b4cf09620b34136d0f57f', 'request_id': 'req-71dcb248-dc19-408d-8c2c-3f6e72449c22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.317261 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 848/1696] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/projects => generated 391 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:44.325767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c9aa-d175-4043-b566-3aa8ae135479 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.327021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c9aa-d175-4043-b566-3aa8ae135479 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.327505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78c9aa-d175-4043-b566-3aa8ae135479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.360793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5f78c9aa-d175-4043-b566-3aa8ae135479 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:44.364581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f78c9aa-d175-4043-b566-3aa8ae135479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.418789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] The token cache is being invalidate because project da11f64e6f1b4cf09620b34136d0f57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:44.419911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.421578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:44.423278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 849/1697] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:43 2022] DELETE /identity/v3/projects/da11f64e6f1b4cf09620b34136d0f57f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:44.424299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.426202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.472774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 849/1698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:44.474685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.475243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.475733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.502419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:44.507416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.533524 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 850/1699] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:44.533524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.533524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.567948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dcb248-dc19-408d-8c2c-3f6e72449c22 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.584145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.584809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.585089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.585520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.586177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.588339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.643523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c889c9-f30a-45bf-b763-1cf477e96b28 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.648501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.649152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.649432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.649705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.660738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.663289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2774b0-9e1b-4e1a-a356-d2fb92bff259 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.679766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 851/1700] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:44.681997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.682367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.682792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.706527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:44.707901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:44.718262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 852/1701] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:44.723616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.737394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de74c75-0959-48fe-9860-a17b7df97829 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.745338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.745984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.746394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.747034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.747742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:44.748269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.749944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.771168 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 853/1702] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:44.775248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.787945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c904a6-83b9-4382-a09e-1f0de693d7a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.794883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.795746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.796234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.796731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.797519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.802085 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 850/1703] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/users => generated 302 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:44.804004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.806149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.823091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc09433-1675-45fd-855d-86478ab3b631 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.834056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.834248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.834609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.835038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.835839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.837926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.857212 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 851/1704] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:44.860996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:44.875641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faadf83-a06b-410b-b7a4-24f5d6a5b7c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:44.884278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:44.885180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:44.885671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:44.886091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] PATH_INFO: `/v3/projects/d1feb90bddff465b8228cef45bbfb7fe/users/968b1d84fec545aa837fe8b8a2edb27e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:44.909478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1feb90bddff465b8228cef45bbfb7fe, user_id=968b1d84fec545aa837fe8b8a2edb27e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:44.912460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124eb39-7968-450e-bc4f-de7ba18fbfee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:44.932679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 854/1705] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:44.936829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.030464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac030005-3514-4092-8854-85c8de37a511 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.048725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.048725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.048725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.048725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.049017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.049017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.069800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:45.088841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 852/1706] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:44 2022] PUT /identity/v3/projects/d1feb90bddff465b8228cef45bbfb7fe/users/968b1d84fec545aa837fe8b8a2edb27e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:45.088841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.088841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.088841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.104355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] MFA Rules not processed for user `ff76a6cbd0154558a0617fd081412831`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:45.105668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:45.181067 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 853/1707] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:45.183725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.268526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 855/1708] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:44 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:45.273464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.291580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee9713-fa1c-409b-87d3-9182a4b83c2f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.311736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d45bdc-32eb-4b80-9af2-79f69ec6425c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.329815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.331088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.331725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.337058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.337058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.337058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.352988 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 854/1709] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:45.354928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.359231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:45.378939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d00ab-ba47-40b4-8c42-4cf502dcf66e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.386329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.391579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.391579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.391579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] PATH_INFO: `/v3/projects/1dbe11c2ed6c436caf0eb7c8da9beed5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.392150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbe11c2ed6c436caf0eb7c8da9beed5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.395307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.415505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.416376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.417559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.417559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.419060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.421046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.437825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 856/1710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:45.439214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.459537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a80598-13ca-4a99-bbce-a6b33fb11aec admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.464581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.465272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.465639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.466031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] PATH_INFO: `/v3/projects/d1feb90bddff465b8228cef45bbfb7fe/users/968b1d84fec545aa837fe8b8a2edb27e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.468569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1feb90bddff465b8228cef45bbfb7fe, user_id=968b1d84fec545aa837fe8b8a2edb27e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.471431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.491848 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 857/1711] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:45 2022] PUT /identity/v3/projects/d1feb90bddff465b8228cef45bbfb7fe/users/968b1d84fec545aa837fe8b8a2edb27e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:45.492797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.553031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:45.587711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'request_id': 'req-9717d617-1cef-4dcb-a9af-6789de8d2820'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:45.591543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9efa48-2a28-4c0f-840f-d5736f24107d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.598135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'request_id': 'req-9717d617-1cef-4dcb-a9af-6789de8d2820'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:45.614778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'request_id': 'req-9717d617-1cef-4dcb-a9af-6789de8d2820'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:45.681755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.682412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.682702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.682913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.683553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.695501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded968f5-b041-4646-930f-aa4783e67ac4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.701375 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 858/1712] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:45.702835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.703121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.703390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.731266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] MFA Rules not processed for user `968b1d84fec545aa837fe8b8a2edb27e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:45.733273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:45.736586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] The token cache is being invalidate because project 1dbe11c2ed6c436caf0eb7c8da9beed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:45.736878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:45.737526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9717d617-1cef-4dcb-a9af-6789de8d2820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:45.739105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 855/1713] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:45 2022] DELETE /identity/v3/projects/1dbe11c2ed6c436caf0eb7c8da9beed5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:45.740468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.740769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.741036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:35:45.749146 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:45.750913 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:35:45.752695 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 856/1714] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:35:45 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:35:45.752695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.781537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:45.832984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b35b77-3f8f-4186-92f7-679f1ce2702c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.841471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.841471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.841471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.841471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] PATH_INFO: `/v3/projects/0f2c7334e03a44f8a101032e7caaff05/users/a6bb0af667424d04a5c51e1ad704cdb5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.868856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2c7334e03a44f8a101032e7caaff05, user_id=a6bb0af667424d04a5c51e1ad704cdb5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.871544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756214f0-31eb-468f-8f96-00af4b2b395d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:45.891185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 859/1715] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:45.893089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:45.901912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:45.914615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcee669-33de-4eeb-8ca2-66825bebfb40 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:45.920039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:45.920717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:45.920999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:45.921272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] PATH_INFO: `/v3/users/9a4a4a42922f4f5fa91e71cc8030f318` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:45.922543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4a4a42922f4f5fa91e71cc8030f318)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:45.925148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:46.014347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 857/1716] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:45 2022] PUT /identity/v3/projects/0f2c7334e03a44f8a101032e7caaff05/users/a6bb0af667424d04a5c51e1ad704cdb5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:46.015693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c857c8-9077-4d6d-a7ac-8d545e2a2577 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.015976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c857c8-9077-4d6d-a7ac-8d545e2a2577 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.016243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c857c8-9077-4d6d-a7ac-8d545e2a2577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.038881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a5c857c8-9077-4d6d-a7ac-8d545e2a2577 None None] MFA Rules not processed for user `ff76a6cbd0154558a0617fd081412831`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:46.040103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a5c857c8-9077-4d6d-a7ac-8d545e2a2577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.108396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4a4a42922f4f5fa91e71cc8030f318'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:46.119150 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 858/1717] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:46.132521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.132521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.132521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.154133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] MFA Rules not processed for user `a6bb0af667424d04a5c51e1ad704cdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:46.155331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.229187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4a4a42922f4f5fa91e71cc8030f318'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:46.253189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4a4a42922f4f5fa91e71cc8030f318'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:46.254710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4a4a42922f4f5fa91e71cc8030f318'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:46.256838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4a4a42922f4f5fa91e71cc8030f318'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:46.275076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 859/1718] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:46.275076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:46.275076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.300533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 860/1719] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:45 2022] DELETE /identity/v3/users/9a4a4a42922f4f5fa91e71cc8030f318 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:46.302375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:46.307271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.395680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f781d-bce9-434a-aaa0-819464950e86 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:46.406325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:46.407609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.407900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.408744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.409433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:46.412521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:46.496438 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 861/1720] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:46 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:46.504285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:46.619895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebedb1d-0c82-4fa0-a1a4-c1025c557918 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:46.716894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163587-3b07-4868-bb7e-857981e05abf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:46.751268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:46.756107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.757284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.761973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.761973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:46.769162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:46.820351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:46.821191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.821614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.822460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.826913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.905695 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 862/1721] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:46 2022] POST /identity/v3/users => generated 295 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:46.907247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:46.912362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:46.944918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739dfc5-831c-4c4e-90cf-902224c75c73 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:46.947261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:46.949031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:46.963494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:46.966348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:46.966348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:46.966348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] PATH_INFO: `/v3/projects/da4a89bac5d84ce9a561087ded7b5a28` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:46.967401 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 860/1722] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:46.967833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4a89bac5d84ce9a561087ded7b5a28)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:46.968500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:46.970297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:46.987983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc341a1-2c96-4788-ae7b-61733c04207e service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:46.996195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:46.997878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.008723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.009099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.009806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.013505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.036787 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 861/1723] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:47.036787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.072811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82108cf0-304e-4baa-bdc5-11d1ce4b093f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.086768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.087489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.087771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.088041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] PATH_INFO: `/v3/projects/ef10b377cd11456fafafe212f8558769/users/48d87c8449a44580bdc3208e2e3a6b44/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.104654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4a89bac5d84ce9a561087ded7b5a28', 'request_id': 'req-f6216d35-50ce-4a29-8432-728203bb5690'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.108293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef10b377cd11456fafafe212f8558769, user_id=48d87c8449a44580bdc3208e2e3a6b44, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.111658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.113229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4a89bac5d84ce9a561087ded7b5a28', 'request_id': 'req-f6216d35-50ce-4a29-8432-728203bb5690'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.179306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4a89bac5d84ce9a561087ded7b5a28', 'request_id': 'req-f6216d35-50ce-4a29-8432-728203bb5690'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.186050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 862/1724] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:47 2022] PUT /identity/v3/projects/ef10b377cd11456fafafe212f8558769/users/48d87c8449a44580bdc3208e2e3a6b44/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:47.191348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.196143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] The token cache is being invalidate because project da4a89bac5d84ce9a561087ded7b5a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:47.196438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.201640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f6216d35-50ce-4a29-8432-728203bb5690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.204503 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 863/1725] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:46 2022] DELETE /identity/v3/projects/da4a89bac5d84ce9a561087ded7b5a28 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:47.209308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588df6-d039-4bab-9a9c-5be48c35e88a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.209815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588df6-d039-4bab-9a9c-5be48c35e88a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.210268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3588df6-d039-4bab-9a9c-5be48c35e88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.232853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e3588df6-d039-4bab-9a9c-5be48c35e88a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:47.234399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e3588df6-d039-4bab-9a9c-5be48c35e88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.295500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a02be9-8cf7-4ccb-add3-2883fed8823b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.300944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.301568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.301845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.302102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.302867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.304533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.321265 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 863/1726] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:47.321265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.322118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.336250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 864/1727] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:47.336434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053ac52-46eb-4b4d-ab35-ad2ec7613bed admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.339340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.339628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.340001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.342907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.343671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.344032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.344469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] PATH_INFO: `/v3/projects/ef10b377cd11456fafafe212f8558769/users/48d87c8449a44580bdc3208e2e3a6b44/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.348295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef10b377cd11456fafafe212f8558769, user_id=48d87c8449a44580bdc3208e2e3a6b44, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.351853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d27b13-a186-4338-adee-a1eaf0e0161d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.366483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 864/1728] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:47 2022] PUT /identity/v3/projects/ef10b377cd11456fafafe212f8558769/users/48d87c8449a44580bdc3208e2e3a6b44/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:47.389122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.389856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.390314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.409639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:47.410882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.425599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] MFA Rules not processed for user `48d87c8449a44580bdc3208e2e3a6b44`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:47.426823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.437297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:47.501757 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 865/1729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:47.501757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.501757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.510343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f77ec0-937e-4db2-a5ff-673513dcf82a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.520090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.521199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.521477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.521904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] PATH_INFO: `/v3/users/23ca0e5748bc44249d90b41f18381108` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.522454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 865/1730] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:47.523354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.525332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.533941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ca0e5748bc44249d90b41f18381108)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.536145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.542611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9cafc3-a584-496e-8cbc-cca1c0b05732 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.549420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.550082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.550359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.550666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] PATH_INFO: `/v3/users/0e480db9b2d24e24aca55712f935edb9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.551825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e480db9b2d24e24aca55712f935edb9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:47.553927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:47.582977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:47.734391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ca0e5748bc44249d90b41f18381108'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.799216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e480db9b2d24e24aca55712f935edb9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.869353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ca0e5748bc44249d90b41f18381108'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.884429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ca0e5748bc44249d90b41f18381108'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.885302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ca0e5748bc44249d90b41f18381108'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.885908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ca0e5748bc44249d90b41f18381108'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.901073 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 866/1731] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:47 2022] DELETE /identity/v3/users/23ca0e5748bc44249d90b41f18381108 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:47.902379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:47.904303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:47.972195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e480db9b2d24e24aca55712f935edb9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.974898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570bada-8720-4c17-a5bb-5de78086a265 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:47.993924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e480db9b2d24e24aca55712f935edb9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:47.994853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:47.995700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:47.996335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:47.996824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:47.998256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:47.998746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.001369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.006234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e480db9b2d24e24aca55712f935edb9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:48.007377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5259414-695a-44d5-a699-18f33627fb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e480db9b2d24e24aca55712f935edb9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:48.015366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 867/1732] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:48.020057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.022701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.029123 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 866/1733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:47 2022] DELETE /identity/v3/users/0e480db9b2d24e24aca55712f935edb9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:48.034104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.034882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.034882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.058796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:48.060256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.164028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3be7a-56ae-4a9a-8814-6e65d843f875 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.179444 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 867/1734] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:48.180534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.181926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.209387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61c8e-879e-4e10-9a0a-4ffc0b401839 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.219912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.220899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.224514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.224514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.225043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.230274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cbe22-b4f8-4eee-9e3f-6d185c1f436d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.283547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.284191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.284470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.284771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.287284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.337379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 868/1735] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:48 2022] POST /identity/v3/projects => generated 403 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:48.338840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.339130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.339404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.362165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:48.363565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.385820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.388384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.419777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 868/1736] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:48.421407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.425829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:48.479843 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 869/1737] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:48.480810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.501503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d684b-cff6-4eda-804d-edd801beafc5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.509523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.510926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.511217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.515617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.515617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.515921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.520139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aac5a-8379-432b-b4c6-77d789395560 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.621505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.622717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.623003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.623432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.659774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.659972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 870/1738] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:48 2022] POST /identity/v3/users => generated 302 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:48.659972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.662436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.671484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc5535-4c60-41a7-9059-b6d8d5eaf8c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.676516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.684083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.684083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.684083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.684524 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 869/1739] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:48.684524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.696276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.701509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.703019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823197b0-ce08-45d8-8b9a-b91d70dfffd1 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.709364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.710224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.710860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.711278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.712822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.715570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.726431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 871/1740] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:48.736544 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 870/1741] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:48.740525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.754935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326c5cd-dcbf-4640-9e04-2e7ec20c7372 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.766941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.768747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.769028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.769302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.772188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.776128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc290299-1e36-4c4f-bd67-155964c9d010 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:48.803755 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 872/1742] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:48.808281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:48.819183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb48f82-a279-40ac-a560-c63a8a585235 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:48.837368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:48.838538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:48.838989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:48.840436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] PATH_INFO: `/v3/projects/4589769481b746e7bd703f2d34706a67/users/da25c954869747feba32b67010ae303f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:48.873992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:48.885965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4589769481b746e7bd703f2d34706a67, user_id=da25c954869747feba32b67010ae303f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:48.889554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:49.065992 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 871/1743] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:48 2022] PUT /identity/v3/projects/4589769481b746e7bd703f2d34706a67/users/da25c954869747feba32b67010ae303f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:49.074155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:49.075009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:49.075009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:49.112691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:49.114128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:49.265891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 873/1744] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:49.277234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:49.279675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:49.337292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:49.414071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be5609-c530-42c9-ba66-8e9dcea7f74b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:49.415319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:49.419355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:49.420202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:49.422027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:49.422402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:49.422748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:49.443704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6653a85-7150-466a-97b5-2da17c89d59f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:49.453730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:49.455822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:49.457285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:49.458025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:49.458372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:49.458711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] PATH_INFO: `/v3/projects/0d02e0867b0f4d90aafc6c469bbdbcdf` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:49.460137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d02e0867b0f4d90aafc6c469bbdbcdf)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:49.462219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:49.493089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 872/1745] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:49.569431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:49.571395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:49.597040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064dfd5-6dda-4dc3-a94f-891be8b7a518 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:49.603393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:49.604201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:49.604461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:49.604797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] PATH_INFO: `/v3/projects/8af2442a3c354aaf9656274f1411489a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:49.609946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af2442a3c354aaf9656274f1411489a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:49.612834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:49.724237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d02e0867b0f4d90aafc6c469bbdbcdf', 'request_id': 'req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.733116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d02e0867b0f4d90aafc6c469bbdbcdf', 'request_id': 'req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.741138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d02e0867b0f4d90aafc6c469bbdbcdf', 'request_id': 'req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.762259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af2442a3c354aaf9656274f1411489a', 'request_id': 'req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.794658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af2442a3c354aaf9656274f1411489a', 'request_id': 'req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.854529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] The token cache is being invalidate because project 0d02e0867b0f4d90aafc6c469bbdbcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:49.854529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.854529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:49.857149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 874/1746] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:49 2022] DELETE /identity/v3/projects/0d02e0867b0f4d90aafc6c469bbdbcdf => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:49.861139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:49.872898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:49.961712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2d03-4b65-479d-b207-d5d1c5d858c9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:50.004742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af2442a3c354aaf9656274f1411489a', 'request_id': 'req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.027932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] The token cache is being invalidate because project 8af2442a3c354aaf9656274f1411489a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:50.028276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.032296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.040220 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 873/1747] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:49 2022] DELETE /identity/v3/projects/8af2442a3c354aaf9656274f1411489a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:50.058261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:50.065606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:50.067726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:50.071401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:50.071693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:50.072898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] PATH_INFO: `/v3/users/968b1d84fec545aa837fe8b8a2edb27e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:50.077108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=968b1d84fec545aa837fe8b8a2edb27e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:50.082313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:50.124277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f02d0b-d18d-4c9d-9bc5-05cf4a70c98b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:50.129597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:50.130555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:50.130834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:50.131126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] PATH_INFO: `/v3/users/ebabe3e4fbdc48948f3d1b929cf175e4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:50.132262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebabe3e4fbdc48948f3d1b929cf175e4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:50.134279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:50.322944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968b1d84fec545aa837fe8b8a2edb27e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.358571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebabe3e4fbdc48948f3d1b929cf175e4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.870556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968b1d84fec545aa837fe8b8a2edb27e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.909180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968b1d84fec545aa837fe8b8a2edb27e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.917613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968b1d84fec545aa837fe8b8a2edb27e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.919285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968b1d84fec545aa837fe8b8a2edb27e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.944039 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 875/1748] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:49 2022] DELETE /identity/v3/users/968b1d84fec545aa837fe8b8a2edb27e => generated 0 bytes in 1068 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:50.949277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebabe3e4fbdc48948f3d1b929cf175e4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.994699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebabe3e4fbdc48948f3d1b929cf175e4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.996109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebabe3e4fbdc48948f3d1b929cf175e4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:50.999062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebabe3e4fbdc48948f3d1b929cf175e4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:51.038231 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 874/1749] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:50 2022] DELETE /identity/v3/users/ebabe3e4fbdc48948f3d1b929cf175e4 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:51.120173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:51.191921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:51.193398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:51.336291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a837609-9d3f-4ac6-b5b4-00704daa0023 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:51.419220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:51.419968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:51.421115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:51.421499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:51.424254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:51.526977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:51.529735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:51.571150 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 876/1750] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:51.639694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:51.727108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:51.728843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:51.831964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:51.834289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:51.858070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16071f6e-65b3-435a-a851-d17cfbde50a1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:51.867321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1bec65-f6c1-491c-8621-13dca32011b6 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:51.875377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:51.876213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:51.876587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:51.876918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:51.877195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:51.877474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] PATH_INFO: `/v3/projects/d1feb90bddff465b8228cef45bbfb7fe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:51.877783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:51.880599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] PATH_INFO: `/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:51.881442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1feb90bddff465b8228cef45bbfb7fe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:51.882674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=153dd8a07bdd4e33a3f9b25bb6a4216f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:51.885289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:51.888844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:52.114625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:52.155756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1feb90bddff465b8228cef45bbfb7fe', 'request_id': 'req-7e8d529a-7fb7-4f67-82f0-8b222588c47e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.155756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1feb90bddff465b8228cef45bbfb7fe', 'request_id': 'req-7e8d529a-7fb7-4f67-82f0-8b222588c47e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.187210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '153dd8a07bdd4e33a3f9b25bb6a4216f', 'request_id': 'req-8ede2862-bcd5-4345-a2b9-976d624f56e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.201821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '153dd8a07bdd4e33a3f9b25bb6a4216f', 'request_id': 'req-8ede2862-bcd5-4345-a2b9-976d624f56e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.208795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '153dd8a07bdd4e33a3f9b25bb6a4216f', 'request_id': 'req-8ede2862-bcd5-4345-a2b9-976d624f56e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.463070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1feb90bddff465b8228cef45bbfb7fe', 'request_id': 'req-7e8d529a-7fb7-4f67-82f0-8b222588c47e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.477902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] The token cache is being invalidate because project d1feb90bddff465b8228cef45bbfb7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:52.477902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.477902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e8d529a-7fb7-4f67-82f0-8b222588c47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.480599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] The token cache is being invalidate because project 153dd8a07bdd4e33a3f9b25bb6a4216f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:52.482262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.485453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ede2862-bcd5-4345-a2b9-976d624f56e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:52.486009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 875/1751] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:51 2022] DELETE /identity/v3/projects/d1feb90bddff465b8228cef45bbfb7fe => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:52.488944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80f2-730e-4024-b7a8-3c2663105ec8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.490272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80f2-730e-4024-b7a8-3c2663105ec8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.491808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9f80f2-730e-4024-b7a8-3c2663105ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.509406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 877/1752] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:51 2022] DELETE /identity/v3/projects/153dd8a07bdd4e33a3f9b25bb6a4216f => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:52.514403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0ad33-d357-4a01-9b4b-1669545ec793 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.517561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0ad33-d357-4a01-9b4b-1669545ec793 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.517561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b0ad33-d357-4a01-9b4b-1669545ec793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.577117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-83b0ad33-d357-4a01-9b4b-1669545ec793 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:52.578678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bc9f80f2-730e-4024-b7a8-3c2663105ec8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:52.580998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-83b0ad33-d357-4a01-9b4b-1669545ec793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:52.581805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc9f80f2-730e-4024-b7a8-3c2663105ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:52.683593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 878/1753] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:52.692262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.692577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.692859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.731428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:52.733592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:52.736407 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 876/1754] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:52.744622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.746040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.746567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.752389 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 879/1755] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:52.761534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:52.784060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c52d3f-1034-4582-baf7-f432c7b5622d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:52.792449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:52.793263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.793706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.794080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.794887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:52.795286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:52.798154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:52.811739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:52.813027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:52.816815 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 880/1756] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:52.821674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:52.834026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 877/1757] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:52.840169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:52.842994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5f31-7245-4953-b12a-9a7095bc7c8d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:52.848241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:52.849109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.849543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.849894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.857404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:52.858306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7610b0-6c78-408f-9725-ac14ba68989f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:52.861598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:52.865587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:52.866601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.866883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.867155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.868610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:52.869366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:52.872429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:52.896534 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 878/1758] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:35:52.900437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:52.915758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d3365-44ba-45d4-8336-a79bec8737e7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:52.921281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:52.921926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:52.922201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:52.922467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:52.923261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:52.925243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.028676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 881/1759] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:53.031247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.051886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 879/1760] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:52 2022] POST /identity/v3/projects => generated 393 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:53.053218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.232265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d657-6dc8-404a-bbb8-a6a40d551f73 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.265284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff07d26-b40d-4830-8fab-6caab6a21bcf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.289549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.290474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.291097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.291532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.292386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.303901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.349113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.353296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.354313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.355356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.362170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.370052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.400055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:53.501918 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 880/1761] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:53 2022] POST /identity/v3/users => generated 297 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:35:53.512111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.539627 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 882/1762] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:53 2022] POST /identity/v3/users => generated 291 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:53.539627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.539819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77175-9cbb-4760-9a33-7d1829ae277a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.554631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.556988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.557655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.558027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.558539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc04a91-4ec3-444a-8dfe-9066c995cf8d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.558860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.562453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.575691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.576284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.576583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.576860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.577688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.579152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.604844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 881/1763] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:53.612082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.621312 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 883/1764] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:53.622390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.638971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa117-c6e5-46c2-9527-f0b2693347ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.661311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ab698-377a-455e-8af9-0ea2158b158d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.662690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.664671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.666507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.668081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.670105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.677400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.680586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.683238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.683685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.684673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.687912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.694811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.727497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 882/1765] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:53.730642 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 884/1766] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:53.732265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.734804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.745239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1048a4-3702-49ab-a8f5-f70b5df829f5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.745839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddad088-89ee-4b06-a2ca-cc5fa149b366 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:53.755165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.756109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.756610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.757069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] PATH_INFO: `/v3/projects/0b1853d4ef5641f2b759f15906db9671/users/c0c1b02e92f3478db77b6082792cb3db/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.757722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:53.758591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.761608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.762056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] PATH_INFO: `/v3/projects/8a4b8cbfeadf49b49faeeb861c169706/users/b3743368f3594472921bdbd7bf032a25/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.782826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1853d4ef5641f2b759f15906db9671, user_id=c0c1b02e92f3478db77b6082792cb3db, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.787305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4b8cbfeadf49b49faeeb861c169706, user_id=b3743368f3594472921bdbd7bf032a25, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:53.790317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.811892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1741bc-677a-4bb7-a5bf-bad55175bb08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:53.936863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 885/1767] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:53 2022] PUT /identity/v3/projects/0b1853d4ef5641f2b759f15906db9671/users/c0c1b02e92f3478db77b6082792cb3db/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:53.948562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 883/1768] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:53 2022] PUT /identity/v3/projects/8a4b8cbfeadf49b49faeeb861c169706/users/b3743368f3594472921bdbd7bf032a25/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:53.950866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcaa3-2db2-48cc-80d3-45c4c64ee386 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:53.951729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:53.954957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcaa3-2db2-48cc-80d3-45c4c64ee386 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:53.955233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dcaa3-2db2-48cc-80d3-45c4c64ee386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:53.966866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:54.021279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c30dcaa3-2db2-48cc-80d3-45c4c64ee386 None None] MFA Rules not processed for user `c0c1b02e92f3478db77b6082792cb3db`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:54.024895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c30dcaa3-2db2-48cc-80d3-45c4c64ee386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:54.093065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd6de3-6612-459e-beb8-f9af89e17e74 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:54.147849 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 884/1769] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:54.147849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.147849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.147849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:54.213139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] MFA Rules not processed for user `b3743368f3594472921bdbd7bf032a25`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:54.214530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:54.234149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:54.234836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.235232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.235899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:54.238549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:54.350588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:54.383015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:54.383015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:54.393434 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 886/1770] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:54.396330 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 885/1771] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:54.406025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:54.417073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:54.419430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:54.559227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4970d31-e5ff-47cd-b42e-7f248f80e69d service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:54.570321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:54.570948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.571233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.571505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:54.572149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:54.580641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ee15f-2622-4b72-a58c-55fb69d56b92 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:54.600989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005dd221-3781-44b7-a897-81e17204afa0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:54.613241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:54.613989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.614274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.614548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:54.632997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:54.634481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:54.646721 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 886/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:54.745676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 887/1773] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:54 2022] POST /identity/v3/projects => generated 395 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:54.749858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:54.768635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce458ed-6c1b-4d55-81b7-d3cd97689e98 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:54.824022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:54.904401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:54.905283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.905970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.906582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:54.907327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:54.910030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:54.954473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:54.954747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:54.955717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.003811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] MFA Rules not processed for user `a0475d03f0e14972a733ba9db2d32947`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:55.005640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:55.069567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 887/1774] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:54 2022] POST /identity/v3/users => generated 304 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:55.071112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:55.089164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393fce7-649b-42d7-a79b-d73ce786a621 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:55.109783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:55.111508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.112001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.114441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.116311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:55.118387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:55.135026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 888/1775] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:35:55.139613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:55.193096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26270e33-25b3-4b0c-a683-67176eeac13b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:55.210565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:55.211169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.217399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.218379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] PATH_INFO: `/v3/projects/baeeff98003148f08813c64f406fd674/users/2ce29a907db9455cb6c194f4fac881eb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.220753 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 888/1776] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:55.272432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeeff98003148f08813c64f406fd674, user_id=2ce29a907db9455cb6c194f4fac881eb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:55.275339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:55.409162 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 889/1777] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:55 2022] PUT /identity/v3/projects/baeeff98003148f08813c64f406fd674/users/2ce29a907db9455cb6c194f4fac881eb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:55.414139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:55.438747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e03f8-ac6d-4f84-afb3-91382237356a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:55.648888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:55.687342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:55.687342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.687342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.687342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.687840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:55.687840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:55.757044 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 889/1778] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:35:55.758026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:55.778192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28098cf-45f6-406a-b95d-f9932fa558de admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:55.790283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:55.790964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.791242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.795704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] PATH_INFO: `/v3/projects/baeeff98003148f08813c64f406fd674/users/2ce29a907db9455cb6c194f4fac881eb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.798819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeeff98003148f08813c64f406fd674, user_id=2ce29a907db9455cb6c194f4fac881eb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:55.803770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451021cb-b4a2-4e21-b7fb-9f1cfa8ac20f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:55.827681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 890/1779] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:35:55 2022] PUT /identity/v3/projects/baeeff98003148f08813c64f406fd674/users/2ce29a907db9455cb6c194f4fac881eb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:55.840014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d49fd-b73b-42c9-bcd0-b11da86410cd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.840575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d49fd-b73b-42c9-bcd0-b11da86410cd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.841209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d49fd-b73b-42c9-bcd0-b11da86410cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.855232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141e2e4-4342-4ef2-a3d2-3fc1c0f6a3a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:55.910721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-030d49fd-b73b-42c9-bcd0-b11da86410cd None None] MFA Rules not processed for user `2ce29a907db9455cb6c194f4fac881eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:55.912756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-030d49fd-b73b-42c9-bcd0-b11da86410cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:55.966284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:55.970109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:55.970385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:55.970662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] PATH_INFO: `/v3/users/b3743368f3594472921bdbd7bf032a25` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:55.973682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3743368f3594472921bdbd7bf032a25)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:55.975717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:56.050663 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 891/1780] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:56.056954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:56.057256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:56.057502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:35:56.064907 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:35:56.065780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:35:56.066628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 892/1781] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:35:56 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:35:56.268521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3743368f3594472921bdbd7bf032a25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:56.399393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3743368f3594472921bdbd7bf032a25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:56.416523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:56.448649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3743368f3594472921bdbd7bf032a25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:56.454224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3743368f3594472921bdbd7bf032a25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:56.454224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d50caabf-68ff-496c-bed2-c880c3b43cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3743368f3594472921bdbd7bf032a25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:56.497588 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 890/1782] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:55 2022] DELETE /identity/v3/users/b3743368f3594472921bdbd7bf032a25 => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:56.501867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649d7dc-e531-4548-ab1f-39557d587c51 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:56.502156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649d7dc-e531-4548-ab1f-39557d587c51 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:56.502444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649d7dc-e531-4548-ab1f-39557d587c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:56.552533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b649d7dc-e531-4548-ab1f-39557d587c51 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:56.568768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b649d7dc-e531-4548-ab1f-39557d587c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:56.642059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:56.657405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:56.817157 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 891/1783] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:56.819336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:56.819625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:56.819901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:56.889809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:56.890443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:56.890719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:56.890988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:56.892883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:56.896656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:56.910160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] MFA Rules not processed for user `976993a09f2342c68dab07da6a7dd236`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:56.911612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:57.032068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:57.033845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:57.049653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 893/1784] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:56 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:35:57.061632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:57.067288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:57.167705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 892/1785] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:57.188988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:57.193692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:57.239351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca5e33-4e24-47ee-a0c9-a383f2567cd2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:57.254500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:57.254500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:57.254500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:57.254500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] PATH_INFO: `/v3/users/c0c1b02e92f3478db77b6082792cb3db` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:57.255454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af865b-d8b3-4b7c-a70d-26e2269452c6 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:57.256426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c1b02e92f3478db77b6082792cb3db)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:57.259291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:57.263238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:57.264302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:57.265421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:57.265860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:57.280981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:57.282614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d5a33-7202-4d28-95e7-385de83dea43 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:57.302391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 894/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:57.513587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c1b02e92f3478db77b6082792cb3db'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:57.606325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c1b02e92f3478db77b6082792cb3db'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:57.625556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c1b02e92f3478db77b6082792cb3db'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:57.626733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c1b02e92f3478db77b6082792cb3db'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:57.627627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c1b02e92f3478db77b6082792cb3db'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:57.652201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 893/1787] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:57 2022] DELETE /identity/v3/users/c0c1b02e92f3478db77b6082792cb3db => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:57.654010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:57.654471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:57.654471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:57.692439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:57.694426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:57.777756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 895/1788] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:35:57.825746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:57.829608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:57.981241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deea959-a9ca-4a79-b0f3-b5aa43b95166 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:57.991663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:57.992595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:57.994677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:57.995123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:58.020058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:58.021614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df184f8-1d8c-4de7-847c-f24e649df38a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:58.042921 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 894/1789] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:58.346376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:58.347909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:58.380250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5591f2-105e-4724-8bf0-5475a59cfea1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:58.396064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:58.433094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:58.435566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:58.438129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:58.443385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] PATH_INFO: `/v3/projects/8a4b8cbfeadf49b49faeeb861c169706` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:58.443385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4b8cbfeadf49b49faeeb861c169706)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:58.443385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:58.764568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4b8cbfeadf49b49faeeb861c169706', 'request_id': 'req-a455a94a-749f-459f-b6b3-fcab32bde934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:58.776448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4b8cbfeadf49b49faeeb861c169706', 'request_id': 'req-a455a94a-749f-459f-b6b3-fcab32bde934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:58.792244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4b8cbfeadf49b49faeeb861c169706', 'request_id': 'req-a455a94a-749f-459f-b6b3-fcab32bde934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:58.893096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] The token cache is being invalidate because project 8a4b8cbfeadf49b49faeeb861c169706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:58.893639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:58.895388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a455a94a-749f-459f-b6b3-fcab32bde934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:58.899042 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 896/1790] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:58 2022] DELETE /identity/v3/projects/8a4b8cbfeadf49b49faeeb861c169706 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:35:58.905723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:58.906460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:58.906875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:58.979945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:58.982670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:59.141994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:59.144125 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 895/1791] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:59.152275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:59.152960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:59.154116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:59.192615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:35:59.194012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:59.248305 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 897/1792] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:35:59.254426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.278838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f74210-fc33-4ce3-8fb1-50e2d0e9effe None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:59.289664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:59.291186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:59.291544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:59.291889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:59.292652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:35:59.293032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:59.297119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:59.376823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.384763 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 896/1793] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:35:59.396766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.400736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:59.401659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4208e7-c50d-4c0c-a9f7-fde19217e1fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:59.431115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f69ca-e0d0-49b7-9d6c-5aaf6b24222b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:59.432055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:59.432714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:59.433024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:59.433353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:59.434673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:59.442279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:59.449953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:59.450619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:59.450898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:59.451171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] PATH_INFO: `/v3/projects/0b1853d4ef5641f2b759f15906db9671` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:59.453239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1853d4ef5641f2b759f15906db9671)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:59.455653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:59.656897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 898/1794] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:35:59 2022] POST /identity/v3/projects => generated 379 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:59.657876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.678607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1853d4ef5641f2b759f15906db9671', 'request_id': 'req-2e123e6d-a8b0-4bb6-b544-86d7379622e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:59.695714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1853d4ef5641f2b759f15906db9671', 'request_id': 'req-2e123e6d-a8b0-4bb6-b544-86d7379622e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:59.781550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1853d4ef5641f2b759f15906db9671', 'request_id': 'req-2e123e6d-a8b0-4bb6-b544-86d7379622e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:59.798403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] The token cache is being invalidate because project 0b1853d4ef5641f2b759f15906db9671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:35:59.798874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:59.800033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:35:59.803918 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 897/1795] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:35:59 2022] DELETE /identity/v3/projects/0b1853d4ef5641f2b759f15906db9671 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:35:59.803918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.810837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:35:59.842486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72754e-5132-4300-923e-383a660e07a9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:35:59.850477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:35:59.851427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:35:59.851923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:35:59.852337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:35:59.853211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:35:59.855815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:35:59.962115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 899/1796] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:35:59 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:35:59.969062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:35:59.975079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:00.012342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123e6d-a8b0-4bb6-b544-86d7379622e7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:00.013129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b2f43-0b02-4c6f-a41d-1552340f2f82 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:00.021376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:00.027871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:00.027871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:00.027871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] PATH_INFO: `/v3/users/2ce29a907db9455cb6c194f4fac881eb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:00.027871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce29a907db9455cb6c194f4fac881eb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:00.028432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:00.028432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:00.028432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:00.028432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] PATH_INFO: `/v3/users/a6bb0af667424d04a5c51e1ad704cdb5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:00.028765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bb0af667424d04a5c51e1ad704cdb5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:00.031452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:00.032450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:00.271499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bb0af667424d04a5c51e1ad704cdb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.304413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce29a907db9455cb6c194f4fac881eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.393801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bb0af667424d04a5c51e1ad704cdb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.413541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bb0af667424d04a5c51e1ad704cdb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.418086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bb0af667424d04a5c51e1ad704cdb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.420333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bb0af667424d04a5c51e1ad704cdb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.436875 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 898/1797] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:59 2022] DELETE /identity/v3/users/a6bb0af667424d04a5c51e1ad704cdb5 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:00.437655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:00.439198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:00.498490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce29a907db9455cb6c194f4fac881eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.536009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce29a907db9455cb6c194f4fac881eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.563051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce29a907db9455cb6c194f4fac881eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.564305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-849b42c0-21b1-4312-8d00-a738e74f9c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce29a907db9455cb6c194f4fac881eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:00.581838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 900/1798] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:59 2022] DELETE /identity/v3/users/2ce29a907db9455cb6c194f4fac881eb => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:00.581838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:00.581838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:00.581838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:00.609890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:00.611385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:00.673110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43c67-f222-4d3a-a268-fe6ad2daf93b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:00.804542 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 901/1799] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:00.827108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:00.829120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:00.925638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:00.926258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:00.926535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:00.927426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:00.927620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:00.940824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:00.956567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 899/1800] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:00.958084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:00.960079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:01.014915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079de1e-1a38-4f12-b767-e929cf8dfbe9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:01.041316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:01.043358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.043601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.043870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.046414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:01.048723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:01.070911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d3512-2c63-4ded-9e6c-3c57deaa61fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:01.071564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 900/1801] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:01.072324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:01.086898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a6c31-7805-48e1-825a-f779e25b98b6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:01.091384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:01.093259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.110914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:01.112943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.113065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.113163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.113237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.113237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] PATH_INFO: `/v3/projects/04d8baa1af2f480b911d02ed2302c250/users/1af08ea7bdf548b68639494e76a6d3ff/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.152778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:01.154462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187b7bfa-5e38-45b2-9745-592cf630aec7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:01.167660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d8baa1af2f480b911d02ed2302c250, user_id=1af08ea7bdf548b68639494e76a6d3ff, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:01.175605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:01.189886 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 902/1802] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:01.394952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:01.412262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 901/1803] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:01 2022] PUT /identity/v3/projects/04d8baa1af2f480b911d02ed2302c250/users/1af08ea7bdf548b68639494e76a6d3ff/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:01.423884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee06-efda-410d-8b33-a589f1d611d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.424527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee06-efda-410d-8b33-a589f1d611d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.425161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239ee06-efda-410d-8b33-a589f1d611d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.481295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8239ee06-efda-410d-8b33-a589f1d611d0 None None] MFA Rules not processed for user `1af08ea7bdf548b68639494e76a6d3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:01.482816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8239ee06-efda-410d-8b33-a589f1d611d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:01.582181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:01.624194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 903/1804] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:01.629146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:01.711924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.713105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.713718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.746051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d905b29-3ea1-4497-9c0d-36c625381961 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:01.753513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:01.754233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:01.754514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:01.755267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:01.755928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:01.758085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:01.779019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] MFA Rules not processed for user `da25c954869747feba32b67010ae303f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:01.794263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:01.920867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 902/1805] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:01 2022] POST /identity/v3/projects => generated 379 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:01.922056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:01.927150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:01.937872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 904/1806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:01.938931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:01.972058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a2214-1fcb-4868-9b13-db00be6964c8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:02.140110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910df56-3c01-4496-a744-bdb3c569e50c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:02.159620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:02.160294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:02.160606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:02.161403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] PATH_INFO: `/v3/projects/baeeff98003148f08813c64f406fd674` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:02.162991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=baeeff98003148f08813c64f406fd674)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:02.167191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:02.229696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:02.236082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:02.237081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:02.237784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:02.240263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:02.249768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:02.498915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 905/1807] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:01 2022] POST /identity/v3/users => generated 296 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:02.499863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:02.505982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:02.570736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb941d-71ba-42f2-95db-97ca3d6d38de admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:02.574255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baeeff98003148f08813c64f406fd674', 'request_id': 'req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:02.587707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baeeff98003148f08813c64f406fd674', 'request_id': 'req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:02.670798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baeeff98003148f08813c64f406fd674', 'request_id': 'req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:02.689579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] The token cache is being invalidate because project baeeff98003148f08813c64f406fd674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:02.691403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:02.693211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:02.696556 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 903/1808] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:01 2022] DELETE /identity/v3/projects/baeeff98003148f08813c64f406fd674 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:02.697562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:02.702066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:02.738829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:02.739545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:02.739820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:02.740472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:02.745672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:02.745672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:02.836191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a6da-56fb-4a1f-bc64-cfe6054df6ab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:02.847825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:02.848836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:02.849471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:02.849875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:02.851233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:02.854577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf97fa-0a37-4437-ba4d-9a8b35be7eb3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:02.873275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 906/1809] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:02 2022] POST /identity/v3/projects => generated 403 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:02.874445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:02.881227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:02.889489 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 904/1810] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:02.892809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:02.893524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:02.893979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:02.952141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:02.954531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:03.064811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779a4aa-ebba-431c-99ad-c53e3ba9ae82 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:03.073928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:03.076054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:03.077676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:03.078815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] PATH_INFO: `/v3/projects/0f2c7334e03a44f8a101032e7caaff05` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:03.083226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2c7334e03a44f8a101032e7caaff05)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:03.091562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:03.176452 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 905/1811] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:03.178045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:03.180827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:03.212817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97edda-a507-4173-9bca-49f87d5b1905 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:03.219527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:03.220573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:03.221671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:03.222186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] PATH_INFO: `/v3/users/936480fc35244d79a3ec7157060a1dbc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:03.224071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=936480fc35244d79a3ec7157060a1dbc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:03.227580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:03.382401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2c7334e03a44f8a101032e7caaff05', 'request_id': 'req-20000138-f59c-4b1f-ad11-6b26d087b002'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.393568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2c7334e03a44f8a101032e7caaff05', 'request_id': 'req-20000138-f59c-4b1f-ad11-6b26d087b002'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.410672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:03.420957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2c7334e03a44f8a101032e7caaff05', 'request_id': 'req-20000138-f59c-4b1f-ad11-6b26d087b002'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.503327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] The token cache is being invalidate because project 0f2c7334e03a44f8a101032e7caaff05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:03.503633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.506308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.515778 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 907/1812] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:02 2022] DELETE /identity/v3/projects/0f2c7334e03a44f8a101032e7caaff05 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:03.515778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:03.515778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:03.563799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936480fc35244d79a3ec7157060a1dbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.633840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20000138-f59c-4b1f-ad11-6b26d087b002 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:03.642117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:03.644910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:03.645281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:03.645561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:03.646312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:03.648438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdba71-0058-4556-bfaf-116b57902806 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:03.703689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936480fc35244d79a3ec7157060a1dbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.707940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:03.744960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936480fc35244d79a3ec7157060a1dbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.754449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936480fc35244d79a3ec7157060a1dbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.755467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936480fc35244d79a3ec7157060a1dbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:03.805525 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 906/1813] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:03 2022] DELETE /identity/v3/users/936480fc35244d79a3ec7157060a1dbc => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:03.810117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:03.815930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:03.862334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 908/1814] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:03 2022] POST /identity/v3/users => generated 308 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:03.864947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:03.866325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:03.867250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:03.931364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:03.933579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.079031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0da32-df61-4689-bcd9-896b3e9a0720 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.082416 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 909/1815] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:04.083553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.085857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.103336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.105207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33298faa-74f6-48bb-a504-fa264ab46dab None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.106825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.123249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.123249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] PATH_INFO: `/v3/projects/977e1957432c4aa0a5003d6e80d45b41/users/f9b2c986baea491f9007eaa042595d08/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.130874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.134362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.136051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.136531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] PATH_INFO: `/v3/users/48d87c8449a44580bdc3208e2e3a6b44` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.141443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=977e1957432c4aa0a5003d6e80d45b41, user_id=f9b2c986baea491f9007eaa042595d08, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:04.142356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d87c8449a44580bdc3208e2e3a6b44)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:04.143861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078dfc1b-dbaf-428f-9e59-62b2944dc0ef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:04.149837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:04.326091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 907/1816] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:03 2022] PUT /identity/v3/projects/977e1957432c4aa0a5003d6e80d45b41/users/f9b2c986baea491f9007eaa042595d08/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:04.328043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.328288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.328594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.352654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:04.355757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.449957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d87c8449a44580bdc3208e2e3a6b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:04.544683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 908/1817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:04.550350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.552174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.573656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545cbf3-a1a5-48ff-9489-e45898f03bae None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.581284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.582116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.582506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.583127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.583914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:04.585973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:04.605270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d87c8449a44580bdc3208e2e3a6b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:04.615180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 909/1818] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:04.618001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.645784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d87c8449a44580bdc3208e2e3a6b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:04.654234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be134-b347-4057-97fb-b4f6eaedc28e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.668945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d87c8449a44580bdc3208e2e3a6b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:04.670070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.671312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.673226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d87c8449a44580bdc3208e2e3a6b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:04.673779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.674089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.674793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:04.675101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:04.677062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:04.692706 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 910/1819] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:04 2022] DELETE /identity/v3/users/48d87c8449a44580bdc3208e2e3a6b44 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:04.693366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.695081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.712325 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 910/1820] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:04.712949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.719920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.835365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d513515-e845-403b-9a46-8ada389c47b1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.854251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904f70a-c01c-43d5-95ba-b5573765d0bf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.873953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.876140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.876443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.877484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:04.878180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:04.879867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:04.905334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 911/1821] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:04.906409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:04.916735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:04.952366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c75dc-f23d-42fb-94b3-d7a9dd4c5359 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:04.958801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:04.959492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:04.959769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:04.963887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] PATH_INFO: `/v3/projects/5eef2caea5e6495a8691216cadd2a45a/users/11ec45f64b5445369684c0afd1900e9a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.003659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.003659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.003659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.003659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.017210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:05.023803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eef2caea5e6495a8691216cadd2a45a, user_id=11ec45f64b5445369684c0afd1900e9a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.039119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.040468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.049275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.068988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 911/1822] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:05.069830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:05.073617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:05.075324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:05.116630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb32248-acf7-4745-b8f7-86383864b85e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:05.156318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.156318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.156318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.156318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.157070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.170692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.190745 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 912/1823] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:04 2022] PUT /identity/v3/projects/5eef2caea5e6495a8691216cadd2a45a/users/11ec45f64b5445369684c0afd1900e9a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:05.191584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:05.342907 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 912/1824] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:05 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:05.344718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:05.349042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2d73b-3dfb-4b02-9aeb-9d79655c98e9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:05.533458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.534154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.534427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.539318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] PATH_INFO: `/v3/projects/977e1957432c4aa0a5003d6e80d45b41/users/f9b2c986baea491f9007eaa042595d08/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.539506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6717701-6082-43cf-97ef-0514e00153bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:05.544917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=977e1957432c4aa0a5003d6e80d45b41, user_id=f9b2c986baea491f9007eaa042595d08, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.547989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.556196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.557461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.557915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.562665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.562665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.562665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975958e-91b5-41b3-afc9-9e7e61808341 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.585858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 913/1825] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:05 2022] PUT /identity/v3/projects/977e1957432c4aa0a5003d6e80d45b41/users/f9b2c986baea491f9007eaa042595d08/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:05.586968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:05.602405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 913/1826] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:05.607439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.607439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.616706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:05.630945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.698223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] MFA Rules not processed for user `f9b2c986baea491f9007eaa042595d08`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:05.699843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:05.736661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6bfd5-2016-4dc7-ae52-a45985aefb38 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:05.750991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.752005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.752005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.752430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.754035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.756805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.839553 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 914/1827] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:05.841682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:05.856128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db128fee-60aa-4530-8d79-bc8401c5f180 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:05.864117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:05.864968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:05.865585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:05.865928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] PATH_INFO: `/v3/projects/5eef2caea5e6495a8691216cadd2a45a/users/11ec45f64b5445369684c0afd1900e9a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:05.870243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eef2caea5e6495a8691216cadd2a45a, user_id=11ec45f64b5445369684c0afd1900e9a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:05.874096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:05.889705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 915/1828] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:05 2022] PUT /identity/v3/projects/5eef2caea5e6495a8691216cadd2a45a/users/11ec45f64b5445369684c0afd1900e9a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:05.929734 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 914/1829] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:05 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:05.931073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.015257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.017583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:06.095132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfe8c6-e741-43f1-ac81-32f63b9ad9d1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.102236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.102902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.103231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.103502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.104321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.114706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.161940 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 916/1830] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:06.162909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.178197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6add9-7957-4731-baae-a08a4d600739 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.186835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93941-d195-4700-8893-799378b1849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.187798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93941-d195-4700-8893-799378b1849a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.188194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93941-d195-4700-8893-799378b1849a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.188563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc93941-d195-4700-8893-799378b1849a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.189371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc93941-d195-4700-8893-799378b1849a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.192158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc93941-d195-4700-8893-799378b1849a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.212284 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 917/1831] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:06.213468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93941-d195-4700-8893-799378b1849a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.232408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc93941-d195-4700-8893-799378b1849a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.240421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.241479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.241901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.242775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] PATH_INFO: `/v3/projects/3097fd43fc3e4c328501a737f763386b/users/8eff673925504edf86484a0f83ef314d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.247182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d226f-1656-4379-aeea-45c8a9ec04d4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.270302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3097fd43fc3e4c328501a737f763386b, user_id=8eff673925504edf86484a0f83ef314d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.273953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.399041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.405053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.405342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.405614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.455906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 918/1832] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:06 2022] PUT /identity/v3/projects/3097fd43fc3e4c328501a737f763386b/users/8eff673925504edf86484a0f83ef314d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:06.455906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.458096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:06.552063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.553784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c76a1b-4f85-4bce-badc-b1b8b36ab93d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.573066 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 915/1833] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:06.575605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.575898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.576174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.600766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32f8f5-2f9f-4d4a-93a1-1e66cf0d2ca5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.608478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.609264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.610048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.610471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] PATH_INFO: `/v3/projects/8ea3b8ac6b104721ba07c7b85bbb64aa` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.611728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea3b8ac6b104721ba07c7b85bbb64aa)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.614175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.628475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] MFA Rules not processed for user `8eff673925504edf86484a0f83ef314d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:06.631120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:06.686761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:06.762449 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 916/1834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:06.762449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.767267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:06.823141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'request_id': 'req-1020c893-5be6-4a82-bfd6-81fc78056cdb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:06.825839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379b8e-4aaf-413f-a7b5-28c16af383aa None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:06.846097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'request_id': 'req-1020c893-5be6-4a82-bfd6-81fc78056cdb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:06.942301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'request_id': 'req-1020c893-5be6-4a82-bfd6-81fc78056cdb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:06.967933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] The token cache is being invalidate because project 8ea3b8ac6b104721ba07c7b85bbb64aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:06.968142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:06.970591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1020c893-5be6-4a82-bfd6-81fc78056cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:06.975838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 919/1835] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:06 2022] DELETE /identity/v3/projects/8ea3b8ac6b104721ba07c7b85bbb64aa => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:06.975838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.976923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:06.977785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:06.978478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.979419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:06.979788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] PATH_INFO: `/v3/projects/ef10b377cd11456fafafe212f8558769` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.980665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:06.984651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef10b377cd11456fafafe212f8558769)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:06.985529 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 920/1836] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:06.987635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:06.989758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:06.992596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.112454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e1d15-e44b-4e76-9e80-da55af48cc08 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:07.119523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:07.120276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.121278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.121630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.137083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.225332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef10b377cd11456fafafe212f8558769', 'request_id': 'req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.236912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef10b377cd11456fafafe212f8558769', 'request_id': 'req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.252834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef10b377cd11456fafafe212f8558769', 'request_id': 'req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.283582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:07.287059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:07.300295 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 921/1837] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:07.301322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:07.303311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.327808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41bfcb-f071-4fc0-ba15-c5024ee97299 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:07.422194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:07.422386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] The token cache is being invalidate because project ef10b377cd11456fafafe212f8558769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:07.422763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.424518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.425062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.425570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] PATH_INFO: `/v3/users/b7d62a0f07884920998ea025a2c6c968` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.427296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d62a0f07884920998ea025a2c6c968)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:07.427468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.431192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:07.436801 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 917/1838] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:06 2022] DELETE /identity/v3/projects/ef10b377cd11456fafafe212f8558769 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:07.437822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:07.441977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.578406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:07.605961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:07.608755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.704632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259be4ce-a984-4ea5-a3a5-9ff0a7457c31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:07.709773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b2c986baea491f9007eaa042595d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977e1957432c4aa0a5003d6e80d45b41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:07.710704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.711050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.711331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] PATH_INFO: `/v3/projects/04d8baa1af2f480b911d02ed2302c250` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.712690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: Authorizing `identity:get_project(project_id=04d8baa1af2f480b911d02ed2302c250)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:07.715924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e8e69-05a7-44fc-ac9f-a6db62f74e0f tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:07.718150 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 918/1839] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:07 2022] GET /identity/v3/projects/04d8baa1af2f480b911d02ed2302c250 => generated 379 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:07.719723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5b0b-22a6-4e8c-9127-603a79a9c6db None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.720422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5b0b-22a6-4e8c-9127-603a79a9c6db None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.720737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd5b0b-22a6-4e8c-9127-603a79a9c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.751019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d0dd5b0b-22a6-4e8c-9127-603a79a9c6db None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:07.751260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d62a0f07884920998ea025a2c6c968'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.752409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d0dd5b0b-22a6-4e8c-9127-603a79a9c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.768553 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 919/1840] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:07.776344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a88c1-2e1f-44f9-bebc-1b2eaeead9ba None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.776344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a88c1-2e1f-44f9-bebc-1b2eaeead9ba None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.776344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a88c1-2e1f-44f9-bebc-1b2eaeead9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.800203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-724a88c1-2e1f-44f9-bebc-1b2eaeead9ba None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:07.801500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-724a88c1-2e1f-44f9-bebc-1b2eaeead9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.810276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d62a0f07884920998ea025a2c6c968'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.814681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 920/1841] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:07.816337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:07.816649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:07.816972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:07.829013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d62a0f07884920998ea025a2c6c968'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.829885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d62a0f07884920998ea025a2c6c968'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.830522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d62a0f07884920998ea025a2c6c968'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:07.856894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:07.858845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.865160 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 922/1842] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:07 2022] DELETE /identity/v3/users/b7d62a0f07884920998ea025a2c6c968 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:07.866190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:07.867857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:07.977674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 921/1843] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:07.984524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:07.987217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:08.017942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4fc6-fbb9-42d3-965d-29a559e8ac08 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:08.037140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:08.037748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.038080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.038407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.039124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:08.039346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:08.041048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:08.067440 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 923/1844] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:08.068329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:08.079176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:08.157382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f2832-1c5e-4d07-923d-92ccebe3b4d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:08.165373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:08.166178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.166583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.167300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.169975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:08.203680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc964ed-780e-481c-8f30-c5dd5d567677 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:08.212301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:08.213196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.213656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.214207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.229676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:08.230739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:08.245974 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 924/1845] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:36:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:08.246848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:08.271409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2392b-adc9-4efc-8797-55c69175193d service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:08.276134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:08.276894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.278280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.278802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.279590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:08.282007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:08.293216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:08.295823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cee712-6759-4926-8bf0-440dd33e0e26 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:08.310238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 922/1846] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:08.404808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.405393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.405753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.407641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 923/1847] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:08.421552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:08.458172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:08.459679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:08.565782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50c5a0-8586-4b11-97fa-11dfa9848bbb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:08.570944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9b2c986baea491f9007eaa042595d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '977e1957432c4aa0a5003d6e80d45b41', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:08.571672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:08.574809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:08.574809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] PATH_INFO: `/v3/projects/04d8baa1af2f480b911d02ed2302c250` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:08.576191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: Authorizing `identity:get_project(project_id=04d8baa1af2f480b911d02ed2302c250)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:08.578452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:08.580404 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 924/1848] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:08 2022] GET /identity/v3/projects/04d8baa1af2f480b911d02ed2302c250 => generated 379 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:08.952950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 925/1849] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:08 2022] POST /identity/v3/projects => generated 373 bytes in 706 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:08.958939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:08.977583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6740-dac2-44d0-bfee-1569a01672f5 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.089424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.090100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.090445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.090802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.091612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.093651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:09.236260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 925/1850] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:08 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:09.236940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:09.246179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:09.248285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:09.265596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd787e3-3df4-4f24-8564-aa768fcaafdc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.268752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de73bb-a7c3-4758-a3ae-0477e6a0831d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.278024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.278880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.279371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.280195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.280342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.280444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.280720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.280874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.280991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] PATH_INFO: `/v3/projects/ce520fe76a5a45d48a9e662aa39d5472` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.282801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:09.284378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce520fe76a5a45d48a9e662aa39d5472)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.286446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:09.311257 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 926/1851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:09.325376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:09.332620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932a4f8-71b0-4d4b-88fa-8cdde9f69107 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.337832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.353582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.354723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.355154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.368756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.375257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:09.428982 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 927/1852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:09.430345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:09.453697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893065c-5ffa-4c4b-9948-a15a586c819c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.460593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.461338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.461571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.461847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] PATH_INFO: `/v3/projects/995da6b9680b4829984d2711fe0157b8/users/d6eb7ebfbc65407fafe075a748a0f412/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.481514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=995da6b9680b4829984d2711fe0157b8, user_id=d6eb7ebfbc65407fafe075a748a0f412, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.484462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6090e49-1d42-4927-b3ad-b7a4e950f08e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:09.615025 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 928/1853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:09 2022] PUT /identity/v3/projects/995da6b9680b4829984d2711fe0157b8/users/d6eb7ebfbc65407fafe075a748a0f412/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:09.628023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.629348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.629853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.638333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce520fe76a5a45d48a9e662aa39d5472', 'request_id': 'req-824e6162-12cf-477c-aad2-2dfd91142f04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:09.647650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce520fe76a5a45d48a9e662aa39d5472', 'request_id': 'req-824e6162-12cf-477c-aad2-2dfd91142f04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:09.656091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce520fe76a5a45d48a9e662aa39d5472', 'request_id': 'req-824e6162-12cf-477c-aad2-2dfd91142f04'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:09.688421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] MFA Rules not processed for user `d6eb7ebfbc65407fafe075a748a0f412`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:09.690453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:09.781237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] The token cache is being invalidate because project ce520fe76a5a45d48a9e662aa39d5472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:09.781604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:09.782447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-824e6162-12cf-477c-aad2-2dfd91142f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:09.788645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 926/1854] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:09 2022] DELETE /identity/v3/projects/ce520fe76a5a45d48a9e662aa39d5472 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:09.796694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456251-d628-4fe2-ac19-16aee2a49ec6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.797078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456251-d628-4fe2-ac19-16aee2a49ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.799219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456251-d628-4fe2-ac19-16aee2a49ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.847989 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 929/1855] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:09.848499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:09.850074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:09.855510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78456251-d628-4fe2-ac19-16aee2a49ec6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:09.858177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78456251-d628-4fe2-ac19-16aee2a49ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:09.979542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ecb52-40ae-4d69-a2b3-0c02bcb276fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:09.985643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:09.986511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:09.987033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:09.987301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:09.987954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:09.989945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:10.011650 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 927/1856] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:10.021219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:10.021787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:10.022688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:10.053314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:10.055408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:10.065964 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 928/1857] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:10.070842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:10.092470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d704c71-110f-4022-8235-dbe41584fb05 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:10.100141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:10.101246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:10.101674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:10.102059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:10.102836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:10.103196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:10.105882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:10.120183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 929/1858] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:10.127622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:10.143710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548496b-90f5-476f-92f6-ab2156ab32af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:10.162471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:10.163186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:10.163594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:10.163876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:10.166751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:10.169567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:11.020309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 930/1859] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:09 2022] POST /identity/v3/projects => generated 373 bytes in 1172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:11.024568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:11.084756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 930/1860] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:10 2022] POST /identity/v3/projects => generated 393 bytes in 958 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:11.086748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:11.092416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:11.178976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8fd3e-875a-4270-aa29-6600e768d994 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:11.274982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a13a26-64d5-4b33-a8d7-7d496d0dac8a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:11.291681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:11.292980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:11.293242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:11.293518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] PATH_INFO: `/v3/users/1af08ea7bdf548b68639494e76a6d3ff` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:11.295749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af08ea7bdf548b68639494e76a6d3ff)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:11.297970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:11.334631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:11.335212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:11.335491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:11.335764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:11.336433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:11.344160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:11.381051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:11.507846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:11.566809 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 931/1861] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:11 2022] POST /identity/v3/users => generated 293 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:11.566809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:11.605005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af58f8-7f75-4dbf-8fa6-6c45f3903947 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:11.613070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:11.614049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:11.614470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:11.614891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:11.615739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:11.625891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:11.682249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af08ea7bdf548b68639494e76a6d3ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:11.782007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af08ea7bdf548b68639494e76a6d3ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:11.798701 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 932/1862] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:11 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:11.798701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:11.810053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af08ea7bdf548b68639494e76a6d3ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:11.826208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af08ea7bdf548b68639494e76a6d3ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:11.827670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ec00c-61e3-4da1-8119-8c7c9c731e2d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:11.829091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af08ea7bdf548b68639494e76a6d3ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:11.837383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:11.838016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:11.838389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:11.838751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:11.840281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:11.843370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58985cef-e55a-4d7f-b1d1-9927b7a6d446 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:11.850671 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 931/1863] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:11 2022] DELETE /identity/v3/users/1af08ea7bdf548b68639494e76a6d3ff => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:11.852008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:11.865096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:11.866597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 933/1864] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:11.878331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:11.878331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:11.878331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:11.908850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:11.910360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:12.021493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9736021-9537-413f-bac4-76a7f58512b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.033571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.035133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.036095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.037344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.038527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.040297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.053263 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 934/1865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:12.062380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.064268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:12.075372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 932/1866] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:12.076646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.084381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:12.101399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb619a55-a7df-4dac-b8d4-568bce5f94d8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.111673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.112668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.113046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.113441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] PATH_INFO: `/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a/users/395953d7a19d4f63a291bb52c2fe323a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.164020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c833a220b4bd9aaf02b69f15a267a, user_id=395953d7a19d4f63a291bb52c2fe323a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.173384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.306687 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 935/1867] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:12 2022] PUT /identity/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a/users/395953d7a19d4f63a291bb52c2fe323a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:12.308661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.318798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50697063-8a93-4dcc-97bb-bfaf4fc09012 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.493587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.497089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.497481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.497851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.505350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9a92-5dde-4f53-8ab0-f02b176ab9c7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.533858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.535271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.557871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.562361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.562361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.562361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.562361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.576653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.600526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 936/1868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:12.601894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.608827 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 933/1869] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:12.610136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.630867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a034cfc-fe2f-4006-a119-9df563b28b2f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.642203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.642748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.642975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.643242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.643896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.646241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.658323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e33b7b-cc02-45f4-b3ce-96be6030bd91 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.681940 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 937/1870] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:12.683653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:12.706305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.707435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.708407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.708407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88/users/435baaf87c8e4ca0ae97521176e988b2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.708952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016d95d-d34a-46e7-9d10-c44ae92fd890 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:12.727240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:12.727895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.728163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.728439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] PATH_INFO: `/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a/users/395953d7a19d4f63a291bb52c2fe323a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.735435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9c833a220b4bd9aaf02b69f15a267a, user_id=395953d7a19d4f63a291bb52c2fe323a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.747539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee31b3-1cb2-4a30-b5d0-83fa11d8f877 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.771393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cc1940b87d4d5480b134a548aeee88, user_id=435baaf87c8e4ca0ae97521176e988b2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:12.781047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7e514-9c47-4bbd-8418-a1233130246e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:12.790873 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 938/1871] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:12 2022] PUT /identity/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a/users/395953d7a19d4f63a291bb52c2fe323a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:12.799448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.799448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.799764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.867146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] MFA Rules not processed for user `395953d7a19d4f63a291bb52c2fe323a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:12.868617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:12.878730 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 934/1872] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:12 2022] PUT /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88/users/435baaf87c8e4ca0ae97521176e988b2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:12.880814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:12.881290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:12.881702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:12.942139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] MFA Rules not processed for user `435baaf87c8e4ca0ae97521176e988b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:12.943699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:13.045861 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 939/1873] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:13.053289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.089846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15c261-fe98-45e2-9411-454739d7d30d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.109100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:13.110074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:13.110538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:13.110986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:13.112989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:13.114874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:13.116909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:13.126639 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 935/1874] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:13.129907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.184165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 940/1875] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:13.194432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.200432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6ae40-d2a0-4206-8583-5963e95a7bd6 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.206132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:13.207489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:13.207875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:13.208255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:13.209045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:13.211450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:13.341903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 941/1876] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:13 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:13.343822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.347679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2cce5-c8c5-44d6-a035-f1738bc7c7a3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.572100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d96278-b3db-4a35-a978-6662093fc75f tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.589321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:13.589963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:13.590239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:13.590522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:13.592062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:13.592379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:13.594095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:13.646646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:13.652704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:13.653877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:13.661404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:13.661932 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 942/1877] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:13.662720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:13.663092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.670261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:13.671563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:13.702519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b2584-1f70-4afe-bb72-5ed2f1b4d055 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.721591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:13.723170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:13.724683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:13.724976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] PATH_INFO: `/v3/projects/04d8baa1af2f480b911d02ed2302c250` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:13.728214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d8baa1af2f480b911d02ed2302c250)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:13.732440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:13.809189 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 936/1878] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:13 2022] POST /identity/v3/projects => generated 395 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:13.813424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:13.947577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d8baa1af2f480b911d02ed2302c250', 'request_id': 'req-36a18a2f-3ce3-4c28-9472-a0e65c51f829'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:13.965026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb1bb7-5679-4f56-97a8-e896e13740fa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:13.967437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d8baa1af2f480b911d02ed2302c250', 'request_id': 'req-36a18a2f-3ce3-4c28-9472-a0e65c51f829'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.084163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d8baa1af2f480b911d02ed2302c250', 'request_id': 'req-36a18a2f-3ce3-4c28-9472-a0e65c51f829'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.101237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.102303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.102810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.102919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] The token cache is being invalidate because project 04d8baa1af2f480b911d02ed2302c250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:14.103412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.103521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.104217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.104616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:14.107495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:14.111756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 943/1879] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:13 2022] DELETE /identity/v3/projects/04d8baa1af2f480b911d02ed2302c250 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:14.111756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:14.116764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.239735 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 937/1880] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:13 2022] POST /identity/v3/users => generated 304 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:14.240916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:14.247241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.262354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a18a2f-3ce3-4c28-9472-a0e65c51f829 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:14.272214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.273395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.273769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.274225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.277193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.279313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda3260-01cc-4538-9f2d-18436e70194e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:14.295986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.297484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.297484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.298822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] PATH_INFO: `/v3/users/f9b2c986baea491f9007eaa042595d08` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.300658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9b2c986baea491f9007eaa042595d08)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:14.307269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:14.417785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:14.419858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:14.449021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 944/1881] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:14.450358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:14.458015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.495029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633bf7c-4c1f-48d7-bf49-4fe8bedade2d service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:14.508893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.509611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.509894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.515414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.515414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:14.530515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544f51b-5839-4547-8c65-e5dde748ec6e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:14.548823 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 945/1882] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:14.553981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10800cf-1126-4752-9fea-e1890a55d2c6 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.554321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10800cf-1126-4752-9fea-e1890a55d2c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.554545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10800cf-1126-4752-9fea-e1890a55d2c6 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.559407 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 946/1883] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:14.559665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10800cf-1126-4752-9fea-e1890a55d2c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:14.596209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9b2c986baea491f9007eaa042595d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.599713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10800cf-1126-4752-9fea-e1890a55d2c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:14.609282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.609956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.610235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.611109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] PATH_INFO: `/v3/projects/9d8803b6148448a292a9630bf910e955/users/54a6e19879ea4b0ba89285389de28113/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.643412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8803b6148448a292a9630bf910e955, user_id=54a6e19879ea4b0ba89285389de28113, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:14.646753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:14.739008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:14.764415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9b2c986baea491f9007eaa042595d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.790067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9b2c986baea491f9007eaa042595d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.804928 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 947/1884] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:14 2022] PUT /identity/v3/projects/9d8803b6148448a292a9630bf910e955/users/54a6e19879ea4b0ba89285389de28113/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:14.807488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:14.808736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9b2c986baea491f9007eaa042595d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.812911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9b2c986baea491f9007eaa042595d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:14.818066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.829201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 938/1885] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:14 2022] DELETE /identity/v3/users/f9b2c986baea491f9007eaa042595d08 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:14.832240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:14.837636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:14.907440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:14.981330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150121a9-25f5-48c4-9f50-ce7d26af2a9a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:14.997092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:14.997983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:14.998524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:14.998962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:14.999824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:15.001861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:15.023351 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 939/1886] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:15.032649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:15.050752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e642db3-1045-4582-a47f-b997afd94bbc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:15.069118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:15.074871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:15.074871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:15.074871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] PATH_INFO: `/v3/projects/9d8803b6148448a292a9630bf910e955/users/54a6e19879ea4b0ba89285389de28113/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:15.076995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8803b6148448a292a9630bf910e955, user_id=54a6e19879ea4b0ba89285389de28113, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:15.083453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a610a6-b8c1-43b1-99af-7dc70784e307 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:15.120987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 940/1887] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:15 2022] PUT /identity/v3/projects/9d8803b6148448a292a9630bf910e955/users/54a6e19879ea4b0ba89285389de28113/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:15.135907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:15.136925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:15.137305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:15.156013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:15.161465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:15.236615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] MFA Rules not processed for user `54a6e19879ea4b0ba89285389de28113`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:15.237961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:15.352237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdf715-54ce-4db1-8729-c652230e3e37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:15.458947 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 941/1888] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:15.465762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:15.518109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:15.518784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:15.519326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:15.519601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects/cafd86958ba84cacb2d51000dbb0f713` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:15.528607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:get_project(project_id=cafd86958ba84cacb2d51000dbb0f713)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:15.535055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:15.537071 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 948/1889] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:14 2022] GET /identity/v3/projects/cafd86958ba84cacb2d51000dbb0f713 => generated 371 bytes in 731 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:15.643440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d6639-a261-488f-9c77-7e7e82a095a6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:15.652188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:15.654313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:15.654630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:15.654916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:15.655587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:15.660035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:15.815796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 942/1890] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:15 2022] POST /identity/v3/projects => generated 395 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:15.820038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:15.842263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c60a9-e9f5-4b99-b441-1440b72b5114 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:15.998566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:15.999348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.000827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.001220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.002010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.012202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.114804 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 949/1891] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:15 2022] POST /identity/v3/users => generated 298 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:16.119900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:16.136815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a810a5b-de49-46c8-a18b-15d716e3a6bc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:16.150034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:16.150949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.151456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.152529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.153432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.155422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49085a6-11d2-47e9-888c-78589b271bd4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.178592 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 943/1892] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:16.183084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:16.198990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8feea-5dc7-4e90-9936-6654c3befb11 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:16.209384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:16.210417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.210900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.211524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.212935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.217097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.244332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.244661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.244907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.246529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 944/1893] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:36:16.252678 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 950/1894] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:16.253035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:16.256378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:16.256569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:16.297523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331cab7-8cba-42d3-ac80-67604650550c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:16.328868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:16.329593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.329871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.330144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] PATH_INFO: `/v3/projects/cbeb96e2a91146409a52a0d7fe233d45/users/8beabb285c4d4e7e886cce309152e1f0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.395694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeb96e2a91146409a52a0d7fe233d45, user_id=8beabb285c4d4e7e886cce309152e1f0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.403144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.422766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:16.453593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:16.538233 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 951/1895] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:16 2022] PUT /identity/v3/projects/cbeb96e2a91146409a52a0d7fe233d45/users/8beabb285c4d4e7e886cce309152e1f0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:16.540175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:16.552630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:16.581348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe15bfb3-47e6-4203-89d2-c27450eeb4ca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:16.797042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:16.812988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.812988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.812988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects/cafd86958ba84cacb2d51000dbb0f713` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.813529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666eadee-eba5-47c3-bb49-a922a6e27f4c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:16.813682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:get_project(project_id=cafd86958ba84cacb2d51000dbb0f713)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.813682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e27c4-f203-4b01-8ab8-656149544ece tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.813682 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 945/1896] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:16 2022] GET /identity/v3/projects/cafd86958ba84cacb2d51000dbb0f713 => generated 371 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:36:16.813927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:16.814514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.814803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.815079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] PATH_INFO: `/v3/projects/977e1957432c4aa0a5003d6e80d45b41` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.816558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:16.816859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:16.817131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:16.817428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=977e1957432c4aa0a5003d6e80d45b41)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:16.819973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:16.925565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] MFA Rules not processed for user `8beabb285c4d4e7e886cce309152e1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:16.926874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.014349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '977e1957432c4aa0a5003d6e80d45b41', 'request_id': 'req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:17.034977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '977e1957432c4aa0a5003d6e80d45b41', 'request_id': 'req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:17.100050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 946/1897] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:17.101065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.131792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78fec5-00cc-4355-b20c-1985579a8eec None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.142394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '977e1957432c4aa0a5003d6e80d45b41', 'request_id': 'req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:17.173183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] The token cache is being invalidate because project 977e1957432c4aa0a5003d6e80d45b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:17.174157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:17.175379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:17.181248 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 952/1898] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:16 2022] DELETE /identity/v3/projects/977e1957432c4aa0a5003d6e80d45b41 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:17.182423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.187051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.303305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:17.341332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.341981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.342265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.342541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.343217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:17.343533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.345586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c44df-97e8-4de4-a361-c7b607710fe9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.378601 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 947/1899] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:17.380103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.380392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.380704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.447909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b474ba-1b13-42ca-afa8-586ffa1a4c7d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.456604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:17.458052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.466995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.469037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.471469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.472087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.475733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.614041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.627086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a02c2-e727-47d7-8367-f6ceb5bb19be service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.643774 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 948/1900] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:17.643774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.649487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.654068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 953/1901] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:17.655552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.655914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.656193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.691759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:17.694403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.715495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b141ee-494c-4ea6-8d3b-7770320f0d66 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.725585 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 954/1902] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:17.726438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.738786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.739474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.739765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.740046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.740774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.743710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94d8b-0765-4528-b0f6-c6430af1041e tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.750504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0221e9-cd08-4997-b5d0-fe98d5572c80 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.766627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.767366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.767647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.767984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.769344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:17.770076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.773045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.788477 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 955/1903] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:17.793418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.834691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616afe0f-5572-4683-86bd-2c560f5ffaa6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.843394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.844325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.844797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.845207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.846442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.849804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75b9b9a-f27a-40cb-bd04-657956ef1a80 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.880896 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 949/1904] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:17 2022] POST /identity/v3/users => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:17.884862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c7cd-b7ef-40cf-a56c-8dba28e814c6 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.884862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c7cd-b7ef-40cf-a56c-8dba28e814c6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.884862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c7cd-b7ef-40cf-a56c-8dba28e814c6 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.884862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 950/1905] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:17.885151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6c7cd-b7ef-40cf-a56c-8dba28e814c6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.910019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6c7cd-b7ef-40cf-a56c-8dba28e814c6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.918849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.920687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.921092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.921612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.923201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:17.923201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.924520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.939937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 951/1906] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:17.944184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:17.945957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:17.968707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:17.979175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8fdee-667d-4b92-aa71-c67d3cdff4fc tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:17.985764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:17.986482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:17.986784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:17.987109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:17.988842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:17.991192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:17.993602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 952/1907] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:17 2022] GET /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 393 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:18.052577 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 956/1908] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:17 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:18.058310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:18.078729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f75a-8be7-4848-8615-f6a5fe678c35 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:18.261457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:18.264631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.265707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.274647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.274647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:18.274647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:18.301993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.302765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.302765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.304244 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 957/1909] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:18.311026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:18.409844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:18.456615 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 953/1910] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:18 2022] POST /identity/v3/users => generated 287 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:18.464870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:18.483651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fccdcc-79f7-44ea-a672-da780547ffb4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:18.500876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:18.501660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.502037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.502571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.503323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:18.505143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:18.542103 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 954/1911] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:18.548020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:18.567855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69838e3-ada8-493a-9b75-584cc1c313a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:18.584808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:18.587546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:18.591392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.592347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.592827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.593639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:18.597419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:18.629345 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 955/1912] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:18.635805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:18.674500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e995b08-a206-48b9-993a-a89161e8b122 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:18.690082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:18.690863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.691239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.691612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] PATH_INFO: `/v3/projects/f445e708656d45e794fa8c5e35026c82/users/2c037ec5e686458080297d30079c4198/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.731633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f445e708656d45e794fa8c5e35026c82, user_id=2c037ec5e686458080297d30079c4198, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:18.735535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd083bc-fab6-4079-81a8-528e748614d4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:18.756352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e239fb12-9bab-4aad-937d-040218cd4810 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:18.774693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:18.775804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.776120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.776403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects/cafd86958ba84cacb2d51000dbb0f713` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.779626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:get_project(project_id=cafd86958ba84cacb2d51000dbb0f713)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:18.790387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2f8d2-c045-411c-9eae-392b1d474081 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:18.790387 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 958/1913] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:18 2022] GET /identity/v3/projects/cafd86958ba84cacb2d51000dbb0f713 => generated 371 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:36:18.817464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:18.829233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 956/1914] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:18 2022] PUT /identity/v3/projects/f445e708656d45e794fa8c5e35026c82/users/2c037ec5e686458080297d30079c4198/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:18.850931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:18.851199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:18.851468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:18.924693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] MFA Rules not processed for user `2c037ec5e686458080297d30079c4198`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:18.925965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:19.041983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.043026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.043125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.089715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] MFA Rules not processed for user `11ec45f64b5445369684c0afd1900e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:19.090977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:19.100564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 959/1915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:19.106557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.191849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bc6b6-8b03-40f4-b5ec-1de09fac5967 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.199036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.199976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.200262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.200710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.201365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.203601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.230690 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 957/1916] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:19.332004 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 960/1917] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:19 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:19.338586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.344874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.356259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a12459-0331-4f4f-a13c-cb44994585a8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.446532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b07a1-31ca-4e12-88fb-fe020185941d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.455710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.457427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.457713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.457991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.460062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:19.475039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.475915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.477495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.477950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.487725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.490330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.507015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:19.557437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.557437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c3276-f153-4e34-ba82-8cf3b8662431 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.566420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 961/1918] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:19.567721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.568012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.568284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.569618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 962/1919] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:19.576874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:19.593881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.612533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 958/1920] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:19 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:19.617443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.635549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c8acd-b71a-4632-a273-91fcaeba9f3b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.644460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.645463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.645842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.646206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.646952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.649497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.675764 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 959/1921] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:19.678179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.694456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c635-e6bd-462c-a98a-cfefccbefc54 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.707555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecd53f-4e91-4329-a8dc-5c1e2993b52d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.708123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.708871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.709149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.709421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] PATH_INFO: `/v3/projects/c96ba96646f94a1abd971edc179f0813/users/7ede494e3a104b0ebdacdc5d22699060/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.720783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.722399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.722399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.722399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.725064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.732107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.740733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ba96646f94a1abd971edc179f0813, user_id=7ede494e3a104b0ebdacdc5d22699060, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.741683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 963/1922] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:19 2022] GET /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 393 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:19.744014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b434c-b7c7-4cd5-acd3-fa18860d9e53 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:19.806995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.852414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94170f63-6298-4cd3-80af-bd5ebfe5bb90 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:19.861364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:19.862329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.862782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.863297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.866088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:19.879275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 960/1923] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:19 2022] PUT /identity/v3/projects/c96ba96646f94a1abd971edc179f0813/users/7ede494e3a104b0ebdacdc5d22699060/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:19.880829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25c4c-f37a-4945-8d81-7dffd2d0327b None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:19.881180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25c4c-f37a-4945-8d81-7dffd2d0327b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:19.881504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b25c4c-f37a-4945-8d81-7dffd2d0327b None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:19.890562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 961/1924] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:19.891587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25c4c-f37a-4945-8d81-7dffd2d0327b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:19.993656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:19.995979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.006558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b25c4c-f37a-4945-8d81-7dffd2d0327b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:20.009962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:20.014623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 964/1925] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:19 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:20.015484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:20.021615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:20.023058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.023455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.023591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.024373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:20.026789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.043267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:20.049968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 962/1926] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:20.054446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:20.070042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af544e1c-2ddc-46cc-8620-4ecf2d97db76 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:20.079172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:20.080026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.080473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.080923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] PATH_INFO: `/v3/projects/c96ba96646f94a1abd971edc179f0813/users/7ede494e3a104b0ebdacdc5d22699060/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.085419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ba96646f94a1abd971edc179f0813, user_id=7ede494e3a104b0ebdacdc5d22699060, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:20.088733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9e50e-27fe-430e-a389-357785d6a9f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.117667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 963/1927] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:20 2022] PUT /identity/v3/projects/c96ba96646f94a1abd971edc179f0813/users/7ede494e3a104b0ebdacdc5d22699060/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:20.136820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.137266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.137372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.179306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59970a51-c2c6-4a1a-8414-cf3266dbd66d service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:20.189531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] MFA Rules not processed for user `7ede494e3a104b0ebdacdc5d22699060`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:20.195042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:20.311207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:20.312778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.313204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.314999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects/cafd86958ba84cacb2d51000dbb0f713` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.317418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:get_project(project_id=cafd86958ba84cacb2d51000dbb0f713)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:20.319512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193f30b-e852-4fa9-a850-d3ea006fceca tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.324972 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 965/1928] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:20 2022] GET /identity/v3/projects/cafd86958ba84cacb2d51000dbb0f713 => generated 371 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:20.327757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272e8e-6282-4b61-bd74-84528e8bd5c3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.328805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272e8e-6282-4b61-bd74-84528e8bd5c3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.331005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72272e8e-6282-4b61-bd74-84528e8bd5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.371746 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 964/1929] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:20.377359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-72272e8e-6282-4b61-bd74-84528e8bd5c3 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:20.378608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-72272e8e-6282-4b61-bd74-84528e8bd5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:20.396525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:20.411159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11ada2-225b-449c-98ff-a83c333f2856 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:20.425629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:20.426574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.426976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.427266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/users/4ef257fd6b714fc9819d8ec0d5b1d377` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.450872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ef257fd6b714fc9819d8ec0d5b1d377)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:20.453520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.535259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 966/1930] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:36:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:20.549807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.553281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.553722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.564662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 967/1931] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:20 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:20.565745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:20.571731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:20.603989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef257fd6b714fc9819d8ec0d5b1d377'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:20.749516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8a32-2457-4f7a-b869-8757f2fec7ff None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:20.762519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:20.763290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:20.763620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:20.764376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:20.781031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:20.783092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:20.804247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 968/1932] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:36:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:20.804247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:20.832821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef257fd6b714fc9819d8ec0d5b1d377'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:20.838883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:20.858314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef257fd6b714fc9819d8ec0d5b1d377'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:20.874937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef257fd6b714fc9819d8ec0d5b1d377'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:20.876704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef257fd6b714fc9819d8ec0d5b1d377'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:20.884973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 965/1933] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:20 2022] DELETE /identity/v3/users/4ef257fd6b714fc9819d8ec0d5b1d377 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:20.888998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:20.890991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:20.959117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:21.001873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b5335-90a8-42b2-a229-199e73877802 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.012131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395953d7a19d4f63a291bb52c2fe323a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a9c833a220b4bd9aaf02b69f15a267a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.012131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.012131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.012401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] PATH_INFO: `/v3/projects/cafd86958ba84cacb2d51000dbb0f713` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.013593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cafd86958ba84cacb2d51000dbb0f713)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.015917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.059141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a024969-37eb-46e5-a73d-22b007f7d60b service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.138752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.140569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.141346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.141595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.142996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.153980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.156284 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 969/1934] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:20 2022] GET /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 393 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:21.198015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cafd86958ba84cacb2d51000dbb0f713', 'request_id': 'req-96ad90b0-66ed-4368-b76a-f81120cd1ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.207880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cafd86958ba84cacb2d51000dbb0f713', 'request_id': 'req-96ad90b0-66ed-4368-b76a-f81120cd1ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.216266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cafd86958ba84cacb2d51000dbb0f713', 'request_id': 'req-96ad90b0-66ed-4368-b76a-f81120cd1ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.285881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:21.296595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.382884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] The token cache is being invalidate because project cafd86958ba84cacb2d51000dbb0f713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:21.383181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.385417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.394666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 966/1935] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:20 2022] DELETE /identity/v3/projects/cafd86958ba84cacb2d51000dbb0f713 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:21.395532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:21.402930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38efdea-e59b-41b5-aac7-3a9ace14ba23 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.406306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.487660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.488319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.488633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.488910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.491299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.512727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad90b0-66ed-4368-b76a-f81120cd1ef8 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.520056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.521695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.522332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.522776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] PATH_INFO: `/v3/users/d6eb7ebfbc65407fafe075a748a0f412` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.524200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6eb7ebfbc65407fafe075a748a0f412)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.526943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.581057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.582716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.594269 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 970/1936] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:36:21.595130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:21.596578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.616358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb0819-ccdb-4b26-ab87-6e1617db8cd8 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.624447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.625040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.625319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.625588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.628093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.717793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.719446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.734513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 971/1937] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:21.735243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:21.737474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:21.757365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2108b6-32a7-4bfc-8f32-4b27037ddf92 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:21.762584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:21.763405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:21.764302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:21.764302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] PATH_INFO: `/v3/users/8eff673925504edf86484a0f83ef314d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:21.765245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eff673925504edf86484a0f83ef314d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:21.767779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:21.910555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6eb7ebfbc65407fafe075a748a0f412'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:21.936180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:22.049822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6eb7ebfbc65407fafe075a748a0f412'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.071018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6eb7ebfbc65407fafe075a748a0f412'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.075045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eff673925504edf86484a0f83ef314d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.098177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6eb7ebfbc65407fafe075a748a0f412'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.098177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6eb7ebfbc65407fafe075a748a0f412'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.103418 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 967/1938] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:21 2022] DELETE /identity/v3/users/d6eb7ebfbc65407fafe075a748a0f412 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:22.103418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:22.103418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.199418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eff673925504edf86484a0f83ef314d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.205727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d61d7-daa8-4ad7-8e9d-fa1250718fdb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:22.212643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:22.213318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.213787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.214416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.216851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.222630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eff673925504edf86484a0f83ef314d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.223446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eff673925504edf86484a0f83ef314d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.224534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd950aae-ac7e-40be-b169-e4d26ea70557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eff673925504edf86484a0f83ef314d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:22.248636 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 972/1939] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:21 2022] DELETE /identity/v3/users/8eff673925504edf86484a0f83ef314d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:22.250073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1abc-5728-4b23-85a1-a39f1295f96a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.250418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1abc-5728-4b23-85a1-a39f1295f96a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.250748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1abc-5728-4b23-85a1-a39f1295f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.277647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0bbb1abc-5728-4b23-85a1-a39f1295f96a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:22.280336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bbb1abc-5728-4b23-85a1-a39f1295f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.301384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:22.303005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d99632-3fc5-438b-969b-d5f7fe493a9c service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:22.313822 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 968/1940] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:22.315204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.315498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.315768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.346759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:22.348546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.371137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 973/1941] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:22.371996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038878a-6302-4656-8246-5fcd51201594 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.377054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038878a-6302-4656-8246-5fcd51201594 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.377054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038878a-6302-4656-8246-5fcd51201594 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.377054 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 974/1942] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:22.386590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.387133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.387591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:36:22.396770 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:22.397830 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:36:22.401086 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 975/1943] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:36:22.402455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:22.405463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.442766 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 969/1944] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:22.463168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:22.464799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:22.519016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b434a4-c338-4b14-9ce5-25b16a843619 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:22.533896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:22.534875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.535259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.535709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.552224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:22.554349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2563-abc3-4690-be9d-9cee87e4ad27 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:22.563019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0cd1-d834-492b-8607-aacb978c9089 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:22.567421 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 976/1945] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:22.567547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:22.568088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:22.568370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:22.568878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:22.604150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:22.607742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:22.632919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 970/1946] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:23.312269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:23.312586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:23.313234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:23.346249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] MFA Rules not processed for user `976993a09f2342c68dab07da6a7dd236`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:23.351860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:23.427363 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 977/1947] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:23.684237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:23.687577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:23.687904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:23.689075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:23.709685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0984ba7-35ba-4a18-9374-71d2e6ec8fb8 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:23.710696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84167200-9ae1-4cdd-92c6-bfb180e05430 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:23.730879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:23.730879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:23.730879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:23.730879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] PATH_INFO: `/v3/projects/3097fd43fc3e4c328501a737f763386b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:23.731556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3097fd43fc3e4c328501a737f763386b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:23.731556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:23.735606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:23.737327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:23.738429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:23.742422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] PATH_INFO: `/v3/projects/995da6b9680b4829984d2711fe0157b8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:23.743990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995da6b9680b4829984d2711fe0157b8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:23.748012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:23.911345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995da6b9680b4829984d2711fe0157b8', 'request_id': 'req-ea7afc96-a721-4b12-bf06-a3653a7f7408'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:23.918702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995da6b9680b4829984d2711fe0157b8', 'request_id': 'req-ea7afc96-a721-4b12-bf06-a3653a7f7408'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:23.937948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:23.943226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995da6b9680b4829984d2711fe0157b8', 'request_id': 'req-ea7afc96-a721-4b12-bf06-a3653a7f7408'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:23.951593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3097fd43fc3e4c328501a737f763386b', 'request_id': 'req-613e40f0-ec00-4250-b782-81fb3ca3829d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:23.959479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3097fd43fc3e4c328501a737f763386b', 'request_id': 'req-613e40f0-ec00-4250-b782-81fb3ca3829d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.138141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] The token cache is being invalidate because project 995da6b9680b4829984d2711fe0157b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:24.138539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.139537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.142306 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 971/1948] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:23 2022] DELETE /identity/v3/projects/995da6b9680b4829984d2711fe0157b8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:24.155639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:24.157972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:24.183174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:24.215056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3097fd43fc3e4c328501a737f763386b', 'request_id': 'req-613e40f0-ec00-4250-b782-81fb3ca3829d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.250804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] The token cache is being invalidate because project 3097fd43fc3e4c328501a737f763386b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:24.262588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.262588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.262588 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 978/1949] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:23 2022] DELETE /identity/v3/projects/3097fd43fc3e4c328501a737f763386b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:24.270267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:24.275128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:24.386527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e40f0-ec00-4250-b782-81fb3ca3829d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:24.393305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:24.394683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:24.395129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:24.395339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] PATH_INFO: `/v3/users/2c037ec5e686458080297d30079c4198` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:24.396729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c037ec5e686458080297d30079c4198)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:24.398307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7afc96-a721-4b12-bf06-a3653a7f7408 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:24.398695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:24.418668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:24.419417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:24.419792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:24.420094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] PATH_INFO: `/v3/users/395953d7a19d4f63a291bb52c2fe323a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:24.422929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395953d7a19d4f63a291bb52c2fe323a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:24.425006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:24.715753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c037ec5e686458080297d30079c4198'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.830159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395953d7a19d4f63a291bb52c2fe323a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.858969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c037ec5e686458080297d30079c4198'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.873581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c037ec5e686458080297d30079c4198'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.874361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c037ec5e686458080297d30079c4198'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.874979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7316bd8c-5c16-4143-bc2d-934960db463b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c037ec5e686458080297d30079c4198'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:24.889828 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 979/1950] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:24 2022] DELETE /identity/v3/users/2c037ec5e686458080297d30079c4198 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:24.891165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:24.891458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:24.891723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:24.913931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:24.915174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:24.983504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 980/1951] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:24.984603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:24.986102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.028238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395953d7a19d4f63a291bb52c2fe323a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:25.048322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395953d7a19d4f63a291bb52c2fe323a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:25.060003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395953d7a19d4f63a291bb52c2fe323a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:25.061105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-aa94c4df-e68b-4ec0-963c-5c7928a32e23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395953d7a19d4f63a291bb52c2fe323a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:25.075191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 972/1952] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:24 2022] DELETE /identity/v3/users/395953d7a19d4f63a291bb52c2fe323a => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:25.075388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ae7b-f0c6-48e2-a4f8-824d7031917c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.075540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ae7b-f0c6-48e2-a4f8-824d7031917c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.075998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32ae7b-f0c6-48e2-a4f8-824d7031917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.103083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4a7eb-0e88-4dee-b5bd-d4c26f87c91c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.108697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6c32ae7b-f0c6-48e2-a4f8-824d7031917c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:25.109938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6c32ae7b-f0c6-48e2-a4f8-824d7031917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.212551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 973/1953] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:25.212551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.212941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.212941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.212941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.212941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.213307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.213401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.213401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.239992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:25.240967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.249328 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 974/1954] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:25.253479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:25.255677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.295722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.297385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.309882 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 981/1955] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:25.313653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:25.324510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a15a2-a569-4eac-9038-3aa91df735b0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.331887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.332542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a945b-fc26-4696-b65f-422ccb9ac6f7 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.332660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.332872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.333152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.337869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.339131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.339939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.345638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.345638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:25.345638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.345638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.346063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.348621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.358622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 982/1956] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:25.364024 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 975/1957] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:25.364474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:25.375237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef5624-d96a-4b98-b280-44d465b51098 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.380813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.381445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.381723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.381995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.382635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.384772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.767341 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 983/1958] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:25 2022] POST /identity/v3/projects => generated 391 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:25.768275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:25.778799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cba3a9-f45b-46f6-9c73-25ab5cc30adc service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.862702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.863351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.863589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.864242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.864998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.867248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18365667-dc52-483b-89e7-15f17f04c71e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.868050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:25.870593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:25.884993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014018f-3b65-464b-a0a7-9bf3fe45eff4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:25.891684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:25.892335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:25.892733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:25.893018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] PATH_INFO: `/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:25.901381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9c833a220b4bd9aaf02b69f15a267a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:25.903670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:25.921031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:26.050375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:26.056333 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 976/1959] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:25 2022] POST /identity/v3/users => generated 296 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:26.057893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1984ab-65f2-465a-9f0c-fd9c5c86e4c7 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.061591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1984ab-65f2-465a-9f0c-fd9c5c86e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.061591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1984ab-65f2-465a-9f0c-fd9c5c86e4c7 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.061591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 977/1960] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:26.064783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1984ab-65f2-465a-9f0c-fd9c5c86e4c7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:26.081639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9c833a220b4bd9aaf02b69f15a267a', 'request_id': 'req-7098fc5d-8461-4125-a461-2a6f775856f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.089670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9c833a220b4bd9aaf02b69f15a267a', 'request_id': 'req-7098fc5d-8461-4125-a461-2a6f775856f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.155083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1984ab-65f2-465a-9f0c-fd9c5c86e4c7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:26.160197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:26.160922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.161199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.161477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.162124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:26.163725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:26.175000 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 978/1961] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:26.176020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:26.177723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:26.257267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:26.264109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:26.323285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26355a01-4a53-426f-9859-1562e64060fc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:26.328032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:26.328714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.328986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.329260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.330384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:26.332441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:26.334110 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 979/1962] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:26 2022] GET /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 393 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:26.334870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:26.345424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626ffa-22d7-411c-9ec9-547fcaef55c8 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:26.349964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:26.350540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.350819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.351089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.351715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:26.353311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:26.357801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9c833a220b4bd9aaf02b69f15a267a', 'request_id': 'req-7098fc5d-8461-4125-a461-2a6f775856f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.366699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 980/1963] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:26.370561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:26.377749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] The token cache is being invalidate because project 1a9c833a220b4bd9aaf02b69f15a267a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:26.378274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.379194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.386182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd38698-9360-496f-ba73-4f2cbc936948 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:26.387588 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 984/1964] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:25 2022] DELETE /identity/v3/projects/1a9c833a220b4bd9aaf02b69f15a267a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:26.388965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:26.392284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:26.393074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.393291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.393852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] PATH_INFO: `/v3/projects/70a0a123c2f74bfeb12dec018ad0d4d7/users/b81c259b7cab41409e166497eb1c45d1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.396444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:26.411333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098fc5d-8461-4125-a461-2a6f775856f4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:26.415499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a0a123c2f74bfeb12dec018ad0d4d7, user_id=b81c259b7cab41409e166497eb1c45d1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:26.415950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:26.416658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.416943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.417216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] PATH_INFO: `/v3/projects/f445e708656d45e794fa8c5e35026c82` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.418333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f445e708656d45e794fa8c5e35026c82)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:26.418440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1fe5ed-f2f1-4612-9ddb-a1050b3d8a2a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:26.420614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:26.757495 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 981/1965] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:26 2022] PUT /identity/v3/projects/70a0a123c2f74bfeb12dec018ad0d4d7/users/b81c259b7cab41409e166497eb1c45d1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:26.759362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92f9d-f371-4a16-bbe9-74d03790cf0c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.759650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92f9d-f371-4a16-bbe9-74d03790cf0c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.759925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd92f9d-f371-4a16-bbe9-74d03790cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.783645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f445e708656d45e794fa8c5e35026c82', 'request_id': 'req-5ba6fc14-78f0-4481-a386-ddb4bd562599'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.793292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1fd92f9d-f371-4a16-bbe9-74d03790cf0c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:26.795110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1fd92f9d-f371-4a16-bbe9-74d03790cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:26.795570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f445e708656d45e794fa8c5e35026c82', 'request_id': 'req-5ba6fc14-78f0-4481-a386-ddb4bd562599'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.888555 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 982/1966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:26.888555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.888555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.888555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.927717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] MFA Rules not processed for user `b81c259b7cab41409e166497eb1c45d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:26.929032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:26.952549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f445e708656d45e794fa8c5e35026c82', 'request_id': 'req-5ba6fc14-78f0-4481-a386-ddb4bd562599'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.979597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] The token cache is being invalidate because project f445e708656d45e794fa8c5e35026c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:26.980152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.980852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5ba6fc14-78f0-4481-a386-ddb4bd562599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:26.983530 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 985/1967] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:26 2022] DELETE /identity/v3/projects/f445e708656d45e794fa8c5e35026c82 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:26.985115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1f6f-da7b-44c6-aa12-63e2b0f19a17 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.985395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1f6f-da7b-44c6-aa12-63e2b0f19a17 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.985667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a1f6f-da7b-44c6-aa12-63e2b0f19a17 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:26.987131 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 986/1968] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:26.988466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:26.988779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:26.989038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.013777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 983/1969] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:27.018218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:27.018716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.020065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.020251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.033805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37302e-6d8e-45bd-8fb6-9d4a58c0bfbc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:27.035718 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 987/1970] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:27.037574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:27.040331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.045753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:27.045983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.046257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.046524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] PATH_INFO: `/v3/users/7ede494e3a104b0ebdacdc5d22699060` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.050847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ede494e3a104b0ebdacdc5d22699060)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:27.052987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:27.137509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.138903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.218456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49574f-0f19-48f0-a2af-286c11ee54b8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:27.223150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:27.223822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.229821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.229821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.229821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:27.229821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:27.229821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 988/1971] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:27 2022] GET /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 393 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:27.230873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.241390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183006b-301e-4471-a41b-3759235e20b9 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:27.245999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:27.246593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.246863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.247127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.247834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:27.248055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:27.249680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:27.267429 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 989/1972] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:27.272418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.283095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f330a-6bb4-480d-99a3-ffae9d1611b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:27.287887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:27.288415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.288744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.289016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.289641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:27.291613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:27.642478 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 990/1973] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:27 2022] POST /identity/v3/projects => generated 391 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:27.654083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ede494e3a104b0ebdacdc5d22699060'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:27.654260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.654260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.759354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b49883-515c-49d6-86b1-f40ba9eb27ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:27.765826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:27.766464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.766895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.767010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.780926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ede494e3a104b0ebdacdc5d22699060'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:27.807285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ede494e3a104b0ebdacdc5d22699060'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:27.849399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ede494e3a104b0ebdacdc5d22699060'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:27.850174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ede494e3a104b0ebdacdc5d22699060'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:27.875269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:27.877056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7c628-9e60-4dc1-b1e1-23a777ee047d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:27.888508 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 991/1975] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:27.890538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9a8a-b45a-4120-92c7-ddf6993a85ab None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:27.891589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9a8a-b45a-4120-92c7-ddf6993a85ab None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:27.891934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f9a8a-b45a-4120-92c7-ddf6993a85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:27.895860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 984/1975] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:27 2022] DELETE /identity/v3/users/7ede494e3a104b0ebdacdc5d22699060 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:27.896702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:27.899338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:27.997028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ba5f9a8a-b45a-4120-92c7-ddf6993a85ab None None] MFA Rules not processed for user `da25c954869747feba32b67010ae303f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:28.000283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ba5f9a8a-b45a-4120-92c7-ddf6993a85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:28.115357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5494a-ea65-43cd-983f-e9efe33a34ad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.120858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.122446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.123081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.123468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.124324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.126803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.177792 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 992/1976] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:28.184395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.184929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.185440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.188596 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 993/1977] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:28.195243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:36:28.203382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:28.304172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 985/1978] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:27 2022] POST /identity/v3/users => generated 296 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:28.305543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.337055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59dab1-cf30-4e40-acfd-c49cad026d0d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.342497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.343656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.343947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.344218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.345060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.346754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.357941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.361122 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 986/1979] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:28.364648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:28.365684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.381958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206b025-6f88-4a06-b394-3cc91649f9f6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.397794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.399089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.406612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.406612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.406612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.406612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.440872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 987/1980] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:28.444085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.465089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3eb775-4852-4648-842f-aa81a9700e0f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.471725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.473092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.473393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.473664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] PATH_INFO: `/v3/projects/3051ce9242f94e48a9ba3ee4f881aa7f/users/8d9cf741305a4b5582b43fcbac6b3bb7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.497080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3051ce9242f94e48a9ba3ee4f881aa7f, user_id=8d9cf741305a4b5582b43fcbac6b3bb7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.501105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.509000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af37ad4-bb3f-4b92-89d7-7c49df045dd1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.522868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a6e19879ea4b0ba89285389de28113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d8803b6148448a292a9630bf910e955', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.523636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.523743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:28.523855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.524238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] PATH_INFO: `/v3/projects/cbeb96e2a91146409a52a0d7fe233d45` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.525639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorizing `identity:get_project(project_id=cbeb96e2a91146409a52a0d7fe233d45)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.529153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256ec8c-7e14-4be2-af06-f7f0c03836a5 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.531175 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 994/1981] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:36:28 2022] GET /identity/v3/projects/cbeb96e2a91146409a52a0d7fe233d45 => generated 395 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:28.594534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:28.616544 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 988/1982] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:28 2022] PUT /identity/v3/projects/3051ce9242f94e48a9ba3ee4f881aa7f/users/8d9cf741305a4b5582b43fcbac6b3bb7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:28.638897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.639376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.639711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.678191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] MFA Rules not processed for user `8d9cf741305a4b5582b43fcbac6b3bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:28.679583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:28.781409 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 995/1983] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:28.786478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.815186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:28.816701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:28.874158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b497097d-8890-448c-a929-32974a9797c6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.880668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.881295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.881570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.882495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.883362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.885625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d80167-536e-468e-af9a-063b0e303eea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:28.914690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af58f11-3694-4532-9645-71980b45b1ce None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:28.923169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:28.923860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:28.924139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:28.924409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] PATH_INFO: `/v3/projects/c96ba96646f94a1abd971edc179f0813` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:28.925781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96ba96646f94a1abd971edc179f0813)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:28.928770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:29.087805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 989/1984] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:28 2022] POST /identity/v3/projects => generated 391 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:29.092581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:29.092866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:29.093170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:36:29.100699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:29.101732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:36:29.102739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 990/1985] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:36:29.103430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:29.210887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96ba96646f94a1abd971edc179f0813', 'request_id': 'req-8627a822-ef79-4604-8cfb-eb89c0fc19c8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.220153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96ba96646f94a1abd971edc179f0813', 'request_id': 'req-8627a822-ef79-4604-8cfb-eb89c0fc19c8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.260404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f56c3a-cc15-4863-b556-5194050fd5d1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:29.345278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:29.345933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:29.346365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:29.346646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:29.347356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:29.350238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:29.483559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96ba96646f94a1abd971edc179f0813', 'request_id': 'req-8627a822-ef79-4604-8cfb-eb89c0fc19c8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.495093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] The token cache is being invalidate because project c96ba96646f94a1abd971edc179f0813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:29.495379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.496038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.497800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 996/1986] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:28 2022] DELETE /identity/v3/projects/c96ba96646f94a1abd971edc179f0813 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:29.498359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:29.499661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:29.513967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627a822-ef79-4604-8cfb-eb89c0fc19c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:29.522657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:29.523796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:29.523796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:29.524100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] PATH_INFO: `/v3/users/435baaf87c8e4ca0ae97521176e988b2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:29.525486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435baaf87c8e4ca0ae97521176e988b2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:29.528070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:29.554182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 991/1987] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:29 2022] POST /identity/v3/users => generated 302 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:29.562186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:29.562186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:29.587834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758204-d0d8-4ef1-9fc3-28e859479844 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:29.593893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:29.596432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:29.596432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:29.596432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] PATH_INFO: `/v3/users/b81c259b7cab41409e166497eb1c45d1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:29.596432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81c259b7cab41409e166497eb1c45d1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:29.598378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:29.826258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435baaf87c8e4ca0ae97521176e988b2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.871234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81c259b7cab41409e166497eb1c45d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.947171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435baaf87c8e4ca0ae97521176e988b2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.973199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435baaf87c8e4ca0ae97521176e988b2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.975527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435baaf87c8e4ca0ae97521176e988b2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.976402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0eb7d002-48af-4a6d-98d9-c47f24488e34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435baaf87c8e4ca0ae97521176e988b2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:29.992917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:30.004474 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 997/1988] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:29 2022] DELETE /identity/v3/users/435baaf87c8e4ca0ae97521176e988b2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:30.006652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce4e0-fa7f-42d5-9cb2-108831515130 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.007063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce4e0-fa7f-42d5-9cb2-108831515130 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.007479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ce4e0-fa7f-42d5-9cb2-108831515130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.033786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8b9ce4e0-fa7f-42d5-9cb2-108831515130 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:30.043176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b9ce4e0-fa7f-42d5-9cb2-108831515130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.067176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81c259b7cab41409e166497eb1c45d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:30.096436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81c259b7cab41409e166497eb1c45d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:30.120221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81c259b7cab41409e166497eb1c45d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:30.122721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81c259b7cab41409e166497eb1c45d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:30.139138 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 992/1989] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:29 2022] DELETE /identity/v3/users/b81c259b7cab41409e166497eb1c45d1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:30.140606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.144452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.198760 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 998/1990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:30.201837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53142-a631-431e-a371-413e72175b9a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.202116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53142-a631-431e-a371-413e72175b9a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.202385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c53142-a631-431e-a371-413e72175b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.249715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e5a74-977d-45bb-9b09-00203a1297da admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.253552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17c53142-a631-431e-a371-413e72175b9a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:30.255115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17c53142-a631-431e-a371-413e72175b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.258928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.259912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.261061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.261492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.262389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.264373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d3331-aa3c-4d8a-b5af-87864efe302d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.278440 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 993/1991] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:30.280259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.280771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.281354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.292326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 999/1992] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:30.293956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.300333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.300909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.305270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:30.306595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.319645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 994/1993] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:30.326936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.343005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:30.344751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.348043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8d974-6af8-45ec-9709-54b9f4e04210 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.362493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.363183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.365245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.365535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] PATH_INFO: `/v3/projects/7ec4cadfdf894b90820ff77e3767371f/users/e2963847d4e24b1985e2242acbe5ce4c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.372874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1000/1994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:30.373970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.375666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.409078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec4cadfdf894b90820ff77e3767371f, user_id=e2963847d4e24b1985e2242acbe5ce4c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.410446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.484071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bcf4a-91df-4417-b63c-63d6c9e234cc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.488713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.489431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.489801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.490284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.502512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.504104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.517802 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1001/1995] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:30.518557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.530533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa660b-2a79-42c7-85e8-307d604529f6 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.545572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.546307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.546594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.546921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.558304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.560525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.570533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1002/1996] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:30.577627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.588875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868dfc-766c-4d3e-bdec-a4e3a7c2ba9e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.595534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.596180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.596634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.596911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.597572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:30.597877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.599594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.616316 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1003/1997] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:30.634968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 995/1998] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:30 2022] PUT /identity/v3/projects/7ec4cadfdf894b90820ff77e3767371f/users/e2963847d4e24b1985e2242acbe5ce4c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:30.636374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.636602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.650543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac7a1d-2aa3-4bf8-9b08-0d7dceff3459 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.722161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7b8a-93a8-47d0-bf77-eaa4799ef236 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.733889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.735942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.736417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.736986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.743498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.748788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.775475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.783145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.783145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.783145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.783145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.783145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.791023 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 996/1999] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:30.794708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:30.827581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a021b-0437-44d8-96c7-e69f47c9149e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:30.841731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:30.844763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.846668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.847148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] PATH_INFO: `/v3/projects/7ec4cadfdf894b90820ff77e3767371f/users/e2963847d4e24b1985e2242acbe5ce4c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.858269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec4cadfdf894b90820ff77e3767371f, user_id=e2963847d4e24b1985e2242acbe5ce4c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:30.881956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b490a-a0c2-4b3e-9e00-8a57d8a3f307 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:30.904293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 997/2000] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:30 2022] PUT /identity/v3/projects/7ec4cadfdf894b90820ff77e3767371f/users/e2963847d4e24b1985e2242acbe5ce4c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:30.915827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:30.916966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:30.917292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:30.954249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] MFA Rules not processed for user `e2963847d4e24b1985e2242acbe5ce4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:30.955471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:30.986777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1004/2001] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/projects => generated 371 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:30.988851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.032638 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 998/2002] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:31.046723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.048271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.066526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940ada1-ef6b-4b18-9195-be947b8d36b8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.072221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.073068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.073357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.073635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.074728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.077438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.142340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6753eae-a056-4a6d-aad9-44b0427e678b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.219978 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1005/2003] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:30 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:31.222858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.240457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cce131-e88a-4eaa-be67-b64e08e503b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.246418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.248536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.248536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.248778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.252609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.254511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.255633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.256332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.256332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.258487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.264089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.281662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1006/2004] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:31.282893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.297449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fa404-0cba-4d58-9223-a64b61fcc28e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.306147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.307225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.307757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.308249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.309159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.311355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.337318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1007/2005] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:31.340132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.353670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1db29-11af-40a0-9865-b3090b64d411 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.365793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.367190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.367456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.367727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] PATH_INFO: `/v3/projects/57ab8b7723184d3e9eff5809eafffb20/users/9379cc116a1e4896b7df09dcfa75eb4f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.381751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.383971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.388306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ab8b7723184d3e9eff5809eafffb20, user_id=9379cc116a1e4896b7df09dcfa75eb4f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.391197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3858c99-b90d-4b70-9683-92d120279d4b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.400210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 999/2006] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:36:31.492200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.494503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.523628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf7249-1833-4d98-8f69-568fc0bd9957 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.549676 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1008/2007] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:31 2022] PUT /identity/v3/projects/57ab8b7723184d3e9eff5809eafffb20/users/9379cc116a1e4896b7df09dcfa75eb4f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:31.555534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.555778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.556049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.564817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.565725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.565999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.566266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] PATH_INFO: `/v3/projects/70a0a123c2f74bfeb12dec018ad0d4d7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.575973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a0a123c2f74bfeb12dec018ad0d4d7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.586937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.608377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:31.609992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.684751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1009/2008] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:31.696771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.699064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.771669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cf09-c797-4d34-9f07-b8cebfd4534c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.775465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.776270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.776590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.776868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.786995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.788627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.800137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1010/2009] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:36:31.861369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:31.862943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:31.879709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f0b67-2d27-4074-a57b-6baa7b089a42 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:31.899445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:31.899795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:31.900075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:31.900338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] PATH_INFO: `/v3/projects/c8cc1940b87d4d5480b134a548aeee88` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:31.906071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cc1940b87d4d5480b134a548aeee88)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:31.908765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:31.957919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a0a123c2f74bfeb12dec018ad0d4d7', 'request_id': 'req-b61327c7-7fd5-4a71-84b6-56021d543507'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:31.969081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a0a123c2f74bfeb12dec018ad0d4d7', 'request_id': 'req-b61327c7-7fd5-4a71-84b6-56021d543507'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:31.977552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a0a123c2f74bfeb12dec018ad0d4d7', 'request_id': 'req-b61327c7-7fd5-4a71-84b6-56021d543507'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.118425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cc1940b87d4d5480b134a548aeee88', 'request_id': 'req-422db5bb-9e04-419f-ae01-d06f58c0a36d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.127408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cc1940b87d4d5480b134a548aeee88', 'request_id': 'req-422db5bb-9e04-419f-ae01-d06f58c0a36d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.154032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] The token cache is being invalidate because project 70a0a123c2f74bfeb12dec018ad0d4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:32.154504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.155794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b61327c7-7fd5-4a71-84b6-56021d543507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.160563 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1000/2010] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:31 2022] DELETE /identity/v3/projects/70a0a123c2f74bfeb12dec018ad0d4d7 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:32.171302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf512-99dd-4a4f-976c-99ffdd4253d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.171698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf512-99dd-4a4f-976c-99ffdd4253d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.172036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf512-99dd-4a4f-976c-99ffdd4253d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.200262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e51bf512-99dd-4a4f-976c-99ffdd4253d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:32.201771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e51bf512-99dd-4a4f-976c-99ffdd4253d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:32.272185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cc1940b87d4d5480b134a548aeee88', 'request_id': 'req-422db5bb-9e04-419f-ae01-d06f58c0a36d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.291165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] The token cache is being invalidate because project c8cc1940b87d4d5480b134a548aeee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:32.292213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.293803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:32.298048 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1011/2011] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:31 2022] DELETE /identity/v3/projects/c8cc1940b87d4d5480b134a548aeee88 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:32.302612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:32.304969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:32.306374 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1001/2012] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:32.308640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.309597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.309961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.348593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:32.350208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:32.358402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422db5bb-9e04-419f-ae01-d06f58c0a36d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:32.367380 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1002/2013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:32.370018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:32.375138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:32.376153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.376639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.377108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] PATH_INFO: `/v3/users/54a6e19879ea4b0ba89285389de28113` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.379495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a6e19879ea4b0ba89285389de28113)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:32.383332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:32.384264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeec3a6-cc98-42d6-a0d7-04b82ad212d4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:32.392050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:32.392895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.393527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.394491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.397407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:32.397851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:32.400105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:32.421578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1003/2014] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:32.424439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:32.442365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ceaaa-b551-4685-9556-3dad4c7dbca1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:32.453759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:32.466184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.466184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.466184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.466184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:32.466184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:32.772308 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1004/2015] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:32 2022] POST /identity/v3/projects => generated 381 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:32.777190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:32.852284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3da779-d8d8-45cb-a855-b9b85d787645 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:32.857023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:32.857644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:32.857914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:32.858179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:32.858808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:32.860795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:32.905104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a6e19879ea4b0ba89285389de28113'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:33.043713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a6e19879ea4b0ba89285389de28113'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:33.055995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1005/2016] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:32 2022] POST /identity/v3/users => generated 291 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:33.061800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:33.065018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a6e19879ea4b0ba89285389de28113'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:33.067532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a6e19879ea4b0ba89285389de28113'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:33.068901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a6e19879ea4b0ba89285389de28113'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:33.071100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d98ebb-8f76-4211-8d51-51851796ad97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:33.079421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:33.080118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:33.080408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:33.080734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:33.081398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:33.083147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:33.106150 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1012/2017] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:32 2022] DELETE /identity/v3/users/54a6e19879ea4b0ba89285389de28113 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:33.106749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:33.107654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1006/2018] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:33.108392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:33.250291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aee70d-d792-4f61-8392-a6a51f729ebd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:33.264178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:33.265134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:33.266135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:33.266564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:33.267383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:33.270782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95898c1-3482-48ee-9adb-c57963b9db95 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:33.285930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1013/2019] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:33.291064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:33.303848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47638f84-e300-4686-bbbc-d943a15db513 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:33.316786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:33.316786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:33.316786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:33.317223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] PATH_INFO: `/v3/projects/d20ecfbbcbcd4953aed36bc1c7e4c054/users/b6215b447217431dbf79ad5b037d1b59/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:33.359169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20ecfbbcbcd4953aed36bc1c7e4c054, user_id=b6215b447217431dbf79ad5b037d1b59, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:33.364346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:33.492566 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1007/2020] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:33 2022] PUT /identity/v3/projects/d20ecfbbcbcd4953aed36bc1c7e4c054/users/b6215b447217431dbf79ad5b037d1b59/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:33.495952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:33.496243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:33.496545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:33.525270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:33.526909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:33.659000 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1014/2021] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:33.691727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:33.701138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:33.868288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09f2c9-bd2f-4163-beb8-f8e625614b33 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:33.873981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:33.875077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:33.875415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:33.875729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:33.899568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:33.902376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:33.935478 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1008/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:34.002523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:34.004072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:34.112114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:34.164211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e5174-825d-40ee-8d14-8404f32e65b3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:34.196710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:34.197872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:34.198338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:34.198754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:34.200926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:34.303681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:34.309299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:34.324802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:34.326702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:34.339655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700a3e7-8d7c-408e-a4ea-37243e54a23c service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:34.347509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:34.348710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:34.351311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:34.352069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] PATH_INFO: `/v3/projects/9d8803b6148448a292a9630bf910e955` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:34.354197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8803b6148448a292a9630bf910e955)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:34.355319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1015/2023] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:34.357036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:34.591031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8803b6148448a292a9630bf910e955', 'request_id': 'req-57d7a078-8b0f-43db-a504-2b116fb643c0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:34.598570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8803b6148448a292a9630bf910e955', 'request_id': 'req-57d7a078-8b0f-43db-a504-2b116fb643c0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:34.614103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8803b6148448a292a9630bf910e955', 'request_id': 'req-57d7a078-8b0f-43db-a504-2b116fb643c0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:34.753304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] The token cache is being invalidate because project 9d8803b6148448a292a9630bf910e955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:34.753554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:34.755897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:34.756102 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1009/2024] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:34 2022] DELETE /identity/v3/projects/9d8803b6148448a292a9630bf910e955 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:34.760161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:34.776099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b9bc-8345-4cdd-8845-34e83224adea service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:34.876401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:34.877162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:34.877444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:34.877716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] PATH_INFO: `/v3/users/8beabb285c4d4e7e886cce309152e1f0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:34.879018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8beabb285c4d4e7e886cce309152e1f0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:34.886756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:35.227535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8beabb285c4d4e7e886cce309152e1f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:35.346888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8beabb285c4d4e7e886cce309152e1f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:35.371709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8beabb285c4d4e7e886cce309152e1f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:35.372727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8beabb285c4d4e7e886cce309152e1f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:35.373830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b0ab128a-09c9-430e-82d7-d0e7f066a9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8beabb285c4d4e7e886cce309152e1f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:36.064675 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1016/2025] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:34 2022] DELETE /identity/v3/users/8beabb285c4d4e7e886cce309152e1f0 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:36.074555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:37.051107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:37.057588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:37.080146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7a078-8b0f-43db-a504-2b116fb643c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:37.202261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:37.204385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.205792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.206245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] PATH_INFO: `/v3/projects/cbeb96e2a91146409a52a0d7fe233d45` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.209341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbeb96e2a91146409a52a0d7fe233d45)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:37.216244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:37.464358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbeb96e2a91146409a52a0d7fe233d45', 'request_id': 'req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:37.474786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbeb96e2a91146409a52a0d7fe233d45', 'request_id': 'req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:37.488897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbeb96e2a91146409a52a0d7fe233d45', 'request_id': 'req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:37.625639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] The token cache is being invalidate because project cbeb96e2a91146409a52a0d7fe233d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:37.625639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:37.627164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f988dfe6-a1e7-4240-8f1d-cfbb5cd7e021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:37.635816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1010/2026] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:37 2022] DELETE /identity/v3/projects/cbeb96e2a91146409a52a0d7fe233d45 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:37.638153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61637-39df-4cb2-b203-33871138e941 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.638153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61637-39df-4cb2-b203-33871138e941 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.638153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de61637-39df-4cb2-b203-33871138e941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.670631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7de61637-39df-4cb2-b203-33871138e941 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:37.678442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ec4f-d721-422c-a698-b0e7b325cd52 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.678713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ec4f-d721-422c-a698-b0e7b325cd52 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.678989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6ec4f-d721-422c-a698-b0e7b325cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b5c6ec4f-d721-422c-a698-b0e7b325cd52 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:36:37.687777 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:37.688781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:36:37.689674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7de61637-39df-4cb2-b203-33871138e941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:37.691066 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1011/2027] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:36:37.756466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651372fc-2ba1-46da-9683-071eb7be4d48 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.756800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651372fc-2ba1-46da-9683-071eb7be4d48 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.757025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651372fc-2ba1-46da-9683-071eb7be4d48 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.758672 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1012/2028] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:36:37.793053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.793338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.793591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.831185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:37.832591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:37.853594 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1017/2029] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:37.864949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.865472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.865815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.909707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:37.910996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:37.940100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1018/2030] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:37.944897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:37.967122 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1013/2031] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:36:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:37.969756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bd117-c899-46d2-95b3-bc1cd1603fd4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:37.975073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:37.981108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.003459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.010988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1019/2032] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:38.017806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8bce-1d93-4a44-be5d-8ed5469bcf59 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.023508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.037349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.039623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:38.044405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.044718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.044991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:38.045644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:38.047594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.086940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31869d06-04bc-4075-8df9-134c1ce4106f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.102510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.103244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.103580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.103850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:38.131317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:38.131317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.154554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1020/2033] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:36:38.343115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1014/2034] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:38 2022] POST /identity/v3/projects => generated 383 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:38.346963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.365471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e534f0-c792-4e69-a57f-122b3049ae0f service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.598125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.599005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.601250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.601639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:38.602419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:38.607240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.749884 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1021/2035] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:38 2022] POST /identity/v3/users => generated 292 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:38.753881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.772423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a212e-a0ec-4c9a-ac36-9ab5a35d4ba5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.783578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.786258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.786932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.787373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:38.788189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:38.794497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.830941 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1015/2036] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:38.832241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.851397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322afe8-d48e-4417-8840-5bef77f58af3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.858181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.859238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.859928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.860412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:38.861499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:38.863720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad9ea-f96a-4fac-a472-524cb17fd467 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:38.883258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1022/2037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:38.889029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:38.945717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc395713-f3e6-4659-b65c-8637e51698fa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:38.958083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:38.965083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:38.966861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:38.967317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:38.973338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] PATH_INFO: `/v3/projects/39a0e479523048f5807b9fc358d3a64e/users/a72d09dfd5cf4dceb7d50eeaa221adcf/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:39.026098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a0e479523048f5807b9fc358d3a64e, user_id=a72d09dfd5cf4dceb7d50eeaa221adcf, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:39.033426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:39.687192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1016/2038] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:38 2022] PUT /identity/v3/projects/39a0e479523048f5807b9fc358d3a64e/users/a72d09dfd5cf4dceb7d50eeaa221adcf/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:39.697263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:39.697573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:39.698112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:39.733519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] MFA Rules not processed for user `a72d09dfd5cf4dceb7d50eeaa221adcf`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:39.735154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:39.826780 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1023/2039] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:39.831125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.012922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bb580-09cb-4e0e-b424-1ebdcb54b8b3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.032705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.033622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.034066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.034584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.035431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.039622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:40.164995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1017/2040] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:39 2022] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:40.168680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.184588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66047b-4791-4b79-a1ed-7e5264483bc5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.209793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:40.267359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.268262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.268750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.269188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.269832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.272215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:40.420884 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1024/2041] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:40 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:40.424981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.442423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b232-06a3-4336-a84e-ae3b1d788a1b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.459055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.459817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.460153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.462243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.463109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.464901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:40.495036 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1018/2042] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:40.495437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.507252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93cd9-8ba7-43f9-bbbb-3eaad45f5295 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.519138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.519841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.520122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.520399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] PATH_INFO: `/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9/users/5a9706deeba84c1b87d01bdbc0cb5743/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.564460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295e9b2f77be407e8cc2e3d4c186bbd9, user_id=5a9706deeba84c1b87d01bdbc0cb5743, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.567841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:40.750009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1025/2043] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:40 2022] PUT /identity/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9/users/5a9706deeba84c1b87d01bdbc0cb5743/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:40.755516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.770624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5474-6ca2-4e00-8fa8-b36399d18ea4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.929669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.931752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.932363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.934202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.938617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.938617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8b98c-e417-4b76-bdfe-82f762db8671 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:40.957622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:40.958096 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1019/2044] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:40.971632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eb3a3-a462-4c30-a27f-0216a1e2a112 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:40.981666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:40.988330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:40.988330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:40.988330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] PATH_INFO: `/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9/users/5a9706deeba84c1b87d01bdbc0cb5743/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:40.988330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=295e9b2f77be407e8cc2e3d4c186bbd9, user_id=5a9706deeba84c1b87d01bdbc0cb5743, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:40.991213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:41.014898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1026/2045] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:40 2022] PUT /identity/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9/users/5a9706deeba84c1b87d01bdbc0cb5743/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:41.026895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:41.027669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:41.028274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:41.067335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] MFA Rules not processed for user `5a9706deeba84c1b87d01bdbc0cb5743`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:41.068643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:41.173100 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1020/2046] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:41.191531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:41.193389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:41.288434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e8c8b-6bc3-4342-a2a5-7b9e1fcd34ad admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:41.299353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:41.299353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:41.299353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:41.299353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:41.307646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:41.309977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd57897-f769-46f8-826b-eca1a58017c8 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:41.326899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1027/2047] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:41.861450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:41.889751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:42.774919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:42.991121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:43.969494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:44.335867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:44.636272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:44.779179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9fe4-f1f5-4b9c-9827-ea0c92299938 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:44.792112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:44.794059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:44.794454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:44.794739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] PATH_INFO: `/v3/users/a72d09dfd5cf4dceb7d50eeaa221adcf` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:44.806174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72d09dfd5cf4dceb7d50eeaa221adcf)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:44.808533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:45.008225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b596-0bbe-456d-8d9c-cb6fdaef7936 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:45.008807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b596-0bbe-456d-8d9c-cb6fdaef7936 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:45.008807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020b596-0bbe-456d-8d9c-cb6fdaef7936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c020b596-0bbe-456d-8d9c-cb6fdaef7936 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:36:45.015960 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:45.017078 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:36:45.019900 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1028/2048] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:45 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:36:45.095276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c938-b4f3-4efd-aa6e-5e2bbbe7f6c7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:45.095938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c938-b4f3-4efd-aa6e-5e2bbbe7f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:45.096390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4c938-b4f3-4efd-aa6e-5e2bbbe7f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:45.126401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bcb4c938-b4f3-4efd-aa6e-5e2bbbe7f6c7 None None] MFA Rules not processed for user `976993a09f2342c68dab07da6a7dd236`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:45.126589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72d09dfd5cf4dceb7d50eeaa221adcf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:45.128766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcb4c938-b4f3-4efd-aa6e-5e2bbbe7f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:45.225575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1029/2049] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:45.226531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72d09dfd5cf4dceb7d50eeaa221adcf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:45.267210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72d09dfd5cf4dceb7d50eeaa221adcf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:45.279321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72d09dfd5cf4dceb7d50eeaa221adcf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:45.280727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72d09dfd5cf4dceb7d50eeaa221adcf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:45.288292 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1021/2050] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:44 2022] DELETE /identity/v3/users/a72d09dfd5cf4dceb7d50eeaa221adcf => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:45.292461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:45.292891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:45.293548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:45.319448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:45.321876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:45.409842 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1030/2051] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:45.483603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:45.485171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:45.627161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188369c-3d0f-426d-8350-a33c7fa64021 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:45.645096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:45.646386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:45.646386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:45.646386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:45.661074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:45.663077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:45.671754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:45.686723 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1022/2052] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:45.710906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:46.284517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:47.254093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:48.142078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:48.149282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:48.209891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8acdce-9fe2-4ba6-9865-e8411cb3c513 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:48.230146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:48.231732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:48.232025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:48.232303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] PATH_INFO: `/v3/projects/39a0e479523048f5807b9fc358d3a64e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:48.233921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a0e479523048f5807b9fc358d3a64e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:48.236546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:48.683984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a0e479523048f5807b9fc358d3a64e', 'request_id': 'req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:48.700056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a0e479523048f5807b9fc358d3a64e', 'request_id': 'req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:48.706750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:48.838365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a0e479523048f5807b9fc358d3a64e', 'request_id': 'req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:48.866652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] The token cache is being invalidate because project 39a0e479523048f5807b9fc358d3a64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:48.866652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:48.866652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:48.869448 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1031/2053] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:48 2022] DELETE /identity/v3/projects/39a0e479523048f5807b9fc358d3a64e => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:36:48.873705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:48.888335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d164c5-0c4f-4c26-9c5d-b14afdc061f9 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:48.969141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:49.117339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:49.117981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:49.118257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:49.119242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] PATH_INFO: `/v3/users/5a9706deeba84c1b87d01bdbc0cb5743` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:49.125155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9706deeba84c1b87d01bdbc0cb5743)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:49.131656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:49.214897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:49.229831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:49.285307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222bf9f1-dbf8-4a31-8d6b-29c8061cffd1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:49.305997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:49.307431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:49.307714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:49.307986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] PATH_INFO: `/v3/users/8d9cf741305a4b5582b43fcbac6b3bb7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:49.310475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9cf741305a4b5582b43fcbac6b3bb7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:49.315170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:49.626427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9706deeba84c1b87d01bdbc0cb5743'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.647747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:49.668572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9cf741305a4b5582b43fcbac6b3bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.711939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9706deeba84c1b87d01bdbc0cb5743'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.737990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9706deeba84c1b87d01bdbc0cb5743'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.757240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9706deeba84c1b87d01bdbc0cb5743'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.758286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-81979504-d424-4dda-a703-a410edd0f611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9706deeba84c1b87d01bdbc0cb5743'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.770923 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1023/2054] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:48 2022] DELETE /identity/v3/users/5a9706deeba84c1b87d01bdbc0cb5743 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:49.772393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:49.772717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:49.773269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:49.817301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] MFA Rules not processed for user `9379cc116a1e4896b7df09dcfa75eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:49.818664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:49.822211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9cf741305a4b5582b43fcbac6b3bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.850675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9cf741305a4b5582b43fcbac6b3bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.851568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9cf741305a4b5582b43fcbac6b3bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.852351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-51124ec8-4032-4017-ae3c-9da49d5cd5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9cf741305a4b5582b43fcbac6b3bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:49.891785 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1032/2055] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:49 2022] DELETE /identity/v3/users/8d9cf741305a4b5582b43fcbac6b3bb7 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:49.898112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:49.900550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:49.901131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:49.957873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:49.960593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:50.028818 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1024/2056] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:50.032908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.035634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:50.085523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1033/2057] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:50.100924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.105795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:50.174339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc400eb-8d29-431e-a058-ee461740d9c0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.182748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.188713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.189391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.190135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.191000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.194077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.206878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a2dce-d2e5-4338-aa41-3e0b0f4ed284 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.210367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.211602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.214053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.214559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.239600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.241585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.263021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1034/2058] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:50.264604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.269143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:50.306781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f41746-1521-4b09-9877-e02a585976e7 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.320535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.322073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.322573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.322926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] PATH_INFO: `/v3/users/da25c954869747feba32b67010ae303f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.325148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=da25c954869747feba32b67010ae303f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.328799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.396703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1025/2059] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:50 2022] POST /identity/v3/projects => generated 367 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:36:50.403223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.508752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f49f70-2762-452d-a28a-b456b5326020 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.519664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.519664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.520032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.520160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.529012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.544446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.769576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da25c954869747feba32b67010ae303f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:50.822610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1026/2060] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:50 2022] POST /identity/v3/users => generated 290 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:50.827489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.846322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157e938-3907-4fdd-9d9c-b02dd72f3a6d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.853650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.854380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.854721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.855100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.855823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.857779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.870175 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1027/2061] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:50.875984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:50.904057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da25c954869747feba32b67010ae303f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:50.905932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff303ef-8755-4ab1-b2af-aba75eccc038 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:50.916218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:50.917053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:50.917341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:50.917616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] PATH_INFO: `/v3/projects/b32522c2fe384c72abb75d027338cbea/users/cca7a2d46b204d7a9580267df3c8107c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:50.953004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da25c954869747feba32b67010ae303f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:50.953108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32522c2fe384c72abb75d027338cbea, user_id=cca7a2d46b204d7a9580267df3c8107c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:50.954649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da25c954869747feba32b67010ae303f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:50.955735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:50.955854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da25c954869747feba32b67010ae303f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.000045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1035/2062] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:50 2022] DELETE /identity/v3/users/da25c954869747feba32b67010ae303f => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:51.001335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:51.002898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.098457 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1028/2063] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:50 2022] PUT /identity/v3/projects/b32522c2fe384c72abb75d027338cbea/users/cca7a2d46b204d7a9580267df3c8107c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:51.105430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:51.109131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.182123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f91f9a-fe6b-489d-b1e2-8c81c876a4ce admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:51.299277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769565a6-e4da-4af0-91db-172b5d76f248 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:51.307091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:51.309072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.309072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.309293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:51.313072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:51.316347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:51.335943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:51.337011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.337649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.340372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] PATH_INFO: `/v3/projects/3051ce9242f94e48a9ba3ee4f881aa7f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:51.342581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3051ce9242f94e48a9ba3ee4f881aa7f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:51.345055 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1029/2064] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:51.345198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:51.347178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:51.365694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379563-9c78-4b59-bc66-d2e61bbb3d98 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:51.381586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:51.382569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.382569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.385704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] PATH_INFO: `/v3/projects/b32522c2fe384c72abb75d027338cbea/users/cca7a2d46b204d7a9580267df3c8107c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:51.387878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32522c2fe384c72abb75d027338cbea, user_id=cca7a2d46b204d7a9580267df3c8107c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:51.397143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9d1f3-72da-4ad0-a54a-7ac9af24634e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:51.415697 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1030/2065] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:51 2022] PUT /identity/v3/projects/b32522c2fe384c72abb75d027338cbea/users/cca7a2d46b204d7a9580267df3c8107c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:51.436920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77756-6262-4d00-b720-fd00ad37d50a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.437532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77756-6262-4d00-b720-fd00ad37d50a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.438420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c77756-6262-4d00-b720-fd00ad37d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:51.529132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e8c77756-6262-4d00-b720-fd00ad37d50a None None] MFA Rules not processed for user `b6215b447217431dbf79ad5b037d1b59`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:51.530512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e8c77756-6262-4d00-b720-fd00ad37d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.538423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3051ce9242f94e48a9ba3ee4f881aa7f', 'request_id': 'req-053abd69-6a43-4af9-9875-53b058e58399'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.553253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3051ce9242f94e48a9ba3ee4f881aa7f', 'request_id': 'req-053abd69-6a43-4af9-9875-53b058e58399'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.669407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1031/2066] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:51.680430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.680430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.680896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:51.711832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3051ce9242f94e48a9ba3ee4f881aa7f', 'request_id': 'req-053abd69-6a43-4af9-9875-53b058e58399'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.752926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] The token cache is being invalidate because project 3051ce9242f94e48a9ba3ee4f881aa7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:51.753210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.758616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:51.762133 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1036/2067] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:50 2022] DELETE /identity/v3/projects/3051ce9242f94e48a9ba3ee4f881aa7f => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:51.766722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] MFA Rules not processed for user `b6215b447217431dbf79ad5b037d1b59`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:51.768931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:51.773947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.775678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.799852 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1032/2068] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:51.814629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:51.820351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:51.985656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9725771-d74d-4a58-9465-41d4f2d0c241 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:51.994514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:51.996505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:51.997528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:51.997882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] PATH_INFO: `/v3/projects/4589769481b746e7bd703f2d34706a67` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:52.001199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4589769481b746e7bd703f2d34706a67)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:52.008250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:52.054957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053abd69-6a43-4af9-9875-53b058e58399 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:52.059856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:52.060720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:52.061287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:52.061513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] PATH_INFO: `/v3/users/e2963847d4e24b1985e2242acbe5ce4c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:52.063334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2963847d4e24b1985e2242acbe5ce4c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:52.065570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:52.146675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:52.285816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4589769481b746e7bd703f2d34706a67', 'request_id': 'req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.299292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4589769481b746e7bd703f2d34706a67', 'request_id': 'req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.310055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4589769481b746e7bd703f2d34706a67', 'request_id': 'req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.455014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2963847d4e24b1985e2242acbe5ce4c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.488201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] The token cache is being invalidate because project 4589769481b746e7bd703f2d34706a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:52.491244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.495488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.499910 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1033/2069] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:51 2022] DELETE /identity/v3/projects/4589769481b746e7bd703f2d34706a67 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:52.501320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:52.511501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:52.562968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2963847d4e24b1985e2242acbe5ce4c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.585254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2963847d4e24b1985e2242acbe5ce4c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.586255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2963847d4e24b1985e2242acbe5ce4c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.589114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2963847d4e24b1985e2242acbe5ce4c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:52.623382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1037/2070] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:51 2022] DELETE /identity/v3/users/e2963847d4e24b1985e2242acbe5ce4c => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:52.625359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:52.626983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:52.779918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531ee8-3ed2-4a7e-bf09-5eeb7a020b80 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:52.839252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee89773-d50d-40f4-9720-0d2bce1c363b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:52.855225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:52.856049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:52.856381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:52.872201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] PATH_INFO: `/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:52.872201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] RBAC: Authorizing `identity:delete_project(project_id=295e9b2f77be407e8cc2e3d4c186bbd9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:52.872201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:52.942265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:52.943039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:52.943456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:52.943894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:52.947487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:53.068628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295e9b2f77be407e8cc2e3d4c186bbd9', 'request_id': 'req-8ab63846-e345-4a1d-86f2-9845a922485a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.074613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:53.076357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:53.095102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:53.099302 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1034/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:53.100178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:53.101058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295e9b2f77be407e8cc2e3d4c186bbd9', 'request_id': 'req-8ab63846-e345-4a1d-86f2-9845a922485a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.109723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:53.137177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f0c21-5105-40b7-9d6d-c4e5a377f495 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:53.203596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295e9b2f77be407e8cc2e3d4c186bbd9', 'request_id': 'req-8ab63846-e345-4a1d-86f2-9845a922485a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.223588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] The token cache is being invalidate because project 295e9b2f77be407e8cc2e3d4c186bbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:53.224217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.225140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ab63846-e345-4a1d-86f2-9845a922485a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.226897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1038/2072] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:52 2022] DELETE /identity/v3/projects/295e9b2f77be407e8cc2e3d4c186bbd9 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:53.232234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89bdb-c68c-490e-86db-8a147657c6ce None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.232805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89bdb-c68c-490e-86db-8a147657c6ce None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.233218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89bdb-c68c-490e-86db-8a147657c6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.259503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-33d89bdb-c68c-490e-86db-8a147657c6ce None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:53.260893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-33d89bdb-c68c-490e-86db-8a147657c6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:53.278708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:53.281631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.281840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.282122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] PATH_INFO: `/v3/users/11ec45f64b5445369684c0afd1900e9a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.283559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11ec45f64b5445369684c0afd1900e9a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:53.286634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:53.405125 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1039/2073] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:53.414242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.414529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.414801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.478067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:53.481502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:53.496975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1040/2074] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:36:53.501236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:53.533080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38c18c-b03d-4d5f-91f9-a4cddf068716 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:53.539935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:53.541706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.542184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.542635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.543553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:53.544074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:53.546691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d3b3-bb29-4a6a-90a5-d51ccd0216cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:53.563922 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1041/2075] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:53.565451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086101-bcb7-420c-b5b6-70c360a8c987 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.565910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086101-bcb7-420c-b5b6-70c360a8c987 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.567180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086101-bcb7-420c-b5b6-70c360a8c987 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.568867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1042/2076] 10.222.0.64 () {54 vars in 921 bytes} [Wed Nov 2 12:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:36:53.569822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086101-bcb7-420c-b5b6-70c360a8c987 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:53.590237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086101-bcb7-420c-b5b6-70c360a8c987 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:53.598646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:53.599685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.600152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.600790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.601830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:53.605906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb7517-5810-43de-813c-e838db2e9dcd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:53.739396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11ec45f64b5445369684c0afd1900e9a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.798749 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1043/2077] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:53 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:53.800175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:53.800462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:53.800962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:53.850118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] MFA Rules not processed for user `6af56c33cae041dfbfe1cddcd37db3ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:53.852166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:53.885110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11ec45f64b5445369684c0afd1900e9a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.916969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11ec45f64b5445369684c0afd1900e9a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.939202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11ec45f64b5445369684c0afd1900e9a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.941109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11ec45f64b5445369684c0afd1900e9a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:53.972756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1035/2078] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:36:53 2022] DELETE /identity/v3/users/11ec45f64b5445369684c0afd1900e9a => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:53.972756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:53.976756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:54.027776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1044/2079] 10.222.0.64 () {58 vars in 1018 bytes} [Wed Nov 2 12:36:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:54.124240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b71e4-4249-462c-8acc-954658727a60 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.130199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.131197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.131582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.131922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.132695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.135566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.272578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.273981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:54.276990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1036/2080] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:53 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:54.284099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.301492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777b64f-2e05-401b-b829-ced2bac3840b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.322918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c684f-e0d4-4ac0-9b74-a4410c4fdb3a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.338950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.341891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.342183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.346111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.347469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.355437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.389895 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1037/2081] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:36:54.391532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.441729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328c884-8d87-4fe9-87c0-a5bac3df998f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.458130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.458761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.459055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.459330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.459985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.461668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.484687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.485414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.485769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.486122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.490756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1038/2082] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:54.491736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.507161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.511248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.514084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e94b-3cf6-453a-ac2c-fef2784320ed admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.531595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.532150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.532150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.532300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] PATH_INFO: `/v3/projects/21b8876635434dabbace96d2b6ce03c0/users/ea22f5f79fb4479687c195848c2b94f8/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.535130 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1045/2083] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:36:54.554414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21b8876635434dabbace96d2b6ce03c0, user_id=ea22f5f79fb4479687c195848c2b94f8, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.558914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dad002-3a08-4d93-9301-2241654003e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.594099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.595579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:54.634777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933b197-51da-4702-8654-57fdeac482c3 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:54.644422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:54.645284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.645808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.646400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] PATH_INFO: `/v3/projects/7ec4cadfdf894b90820ff77e3767371f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.647747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec4cadfdf894b90820ff77e3767371f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:54.651236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:54.663390 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1039/2084] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:54 2022] PUT /identity/v3/projects/21b8876635434dabbace96d2b6ce03c0/users/ea22f5f79fb4479687c195848c2b94f8/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:54.674995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.675939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.676225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.755210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] MFA Rules not processed for user `ea22f5f79fb4479687c195848c2b94f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:54.762825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:54.803190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec4cadfdf894b90820ff77e3767371f', 'request_id': 'req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:54.840547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec4cadfdf894b90820ff77e3767371f', 'request_id': 'req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:54.917266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec4cadfdf894b90820ff77e3767371f', 'request_id': 'req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:54.935385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] The token cache is being invalidate because project 7ec4cadfdf894b90820ff77e3767371f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:54.936337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:54.937937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2ffdbc0-a42f-4eea-8bfd-a9e7aa4f446e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:54.943068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1046/2085] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:54 2022] DELETE /identity/v3/projects/7ec4cadfdf894b90820ff77e3767371f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:54.953778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fa0a7-1521-4d04-99de-ca4b57babb18 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.954256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fa0a7-1521-4d04-99de-ca4b57babb18 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.954532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fa0a7-1521-4d04-99de-ca4b57babb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-bc9fa0a7-1521-4d04-99de-ca4b57babb18 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:36:54.966738 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:36:54.967805 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:36:54.969492 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1047/2086] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:36:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:36:54.971004 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1040/2087] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:54.978982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:54.979949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d33e-d309-4e92-88ea-7902c715c933 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:54.980228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d33e-d309-4e92-88ea-7902c715c933 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:54.980537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287d33e-d309-4e92-88ea-7902c715c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:54.999678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:55.049788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4287d33e-d309-4e92-88ea-7902c715c933 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:55.051392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4287d33e-d309-4e92-88ea-7902c715c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:55.173151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c5791-e1ce-4d10-9a7a-f6fde71d5e73 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:55.261874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1048/2088] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:55.265566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:55.270999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:55.270999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:55.319744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:55.321563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:55.322157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:55.322647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:55.324373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:55.327018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:55.329583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:55.330809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:55.369369 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1049/2089] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:55.370484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:55.387007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97504143-37c2-4af9-a1fe-00aa60b40f7b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:55.401911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:55.402672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:55.402949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:55.410153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:55.412523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:55.412523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:55.414398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:55.441899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1050/2090] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:55.448580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:55.505096 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1041/2091] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:54 2022] POST /identity/v3/projects => generated 385 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:55.506143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:55.514676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:55.528576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da54865-d8eb-43ea-810b-d944f312648f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:55.744880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:55.745515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:55.745787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:55.746050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:55.746690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:55.751621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:55.768010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372ca8a-3adf-402d-9b2b-6b037139c10d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:55.794040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:55.794704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:55.795000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:55.795338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:55.796001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:55.801774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:55.942496 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1051/2092] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:55 2022] POST /identity/v3/projects => generated 375 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:55.943383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:55.956167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:55.971722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:55.983845 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1042/2093] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:55 2022] POST /identity/v3/users => generated 299 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:55.987106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.005208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd6d7-a8e0-47b8-926e-ab16b704933c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.136260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.136260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.136260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.136260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.136885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.139333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.148086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16eda-98b9-495a-b65a-11fa7f6a43d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.162356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.163018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.163301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.163574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] PATH_INFO: `/v3/projects/5eef2caea5e6495a8691216cadd2a45a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.169191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eef2caea5e6495a8691216cadd2a45a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.173330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.295436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1043/2094] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:55 2022] POST /identity/v3/users => generated 288 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:56.295436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.308091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14412a36-dae0-482f-b1d8-651bf60d064e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.313845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.314473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.314750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.315023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.320826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.328976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.347288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eef2caea5e6495a8691216cadd2a45a', 'request_id': 'req-01a17ce2-41a2-4846-90bc-00a4c66e5ded'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:56.361511 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1044/2095] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:56.362689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.364472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eef2caea5e6495a8691216cadd2a45a', 'request_id': 'req-01a17ce2-41a2-4846-90bc-00a4c66e5ded'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:56.382295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7a262-6fd4-4a50-8799-376289d0b779 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.473328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.474149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.474535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.474969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.475954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.492618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fb33-abe3-4643-85a1-16930553a136 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.500083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eef2caea5e6495a8691216cadd2a45a', 'request_id': 'req-01a17ce2-41a2-4846-90bc-00a4c66e5ded'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:56.530251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] The token cache is being invalidate because project 5eef2caea5e6495a8691216cadd2a45a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:36:56.530868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:56.532890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:36:56.552656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1052/2096] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:55 2022] DELETE /identity/v3/projects/5eef2caea5e6495a8691216cadd2a45a => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:56.554169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.558543 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1045/2097] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:56.563267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:56.566424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.567004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.568827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.624641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a17ce2-41a2-4846-90bc-00a4c66e5ded admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.638665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:56.641311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.645744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.645744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.645744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] PATH_INFO: `/v3/projects/d798b14d99db4d34b12f37001a08a406/users/101a8fea0b8c45f695b7090e299185b1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.646017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:56.657871 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1046/2098] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:56.659228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.668066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:56.674214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d798b14d99db4d34b12f37001a08a406, user_id=101a8fea0b8c45f695b7090e299185b1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.680472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.686797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9b56b-127e-46fe-8b2f-e60efe7d2f18 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.695691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.696869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.697337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.700125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:56.703149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.703149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.705533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97678bc-a7ef-43bb-9ea5-346a2ef622c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.722146 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1047/2099] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:56.725005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.725545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.726861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.761584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:56.765253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1053/2100] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:56 2022] PUT /identity/v3/projects/d798b14d99db4d34b12f37001a08a406/users/101a8fea0b8c45f695b7090e299185b1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:56.765253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.769685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:56.909171 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1048/2101] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:56.911595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.925503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce753137-9a4d-400a-a7e2-7fb0fbd41da1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.932172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.933215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.933477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.933909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.935038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.936981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.938889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69d8b-922c-4c84-90f9-5478123ba950 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.945128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.945811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.946089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.946953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] PATH_INFO: `/v3/projects/b94df274ea1b4a2387fa8a717cb3ca3b/users/bbede44ae7194b4e97bc67e0dc8207b3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.957858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1049/2102] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:56.960574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:56.982225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debdb1e-114e-485e-b804-3d8dfc28b522 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:56.983898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94df274ea1b4a2387fa8a717cb3ca3b, user_id=bbede44ae7194b4e97bc67e0dc8207b3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.986666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516a0a-3c3e-4233-a193-3699c77b9645 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:56.987697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:56.988583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:56.988976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:56.989314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:56.990405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:36:56.990795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:56.992613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:57.007600 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1050/2103] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:36:57.009262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:57.022333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cf665-dd0f-438a-a299-47bec7357915 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:57.052985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:57.054128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.054613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.055250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] PATH_INFO: `/v3/projects/d798b14d99db4d34b12f37001a08a406/users/101a8fea0b8c45f695b7090e299185b1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.065146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d798b14d99db4d34b12f37001a08a406, user_id=101a8fea0b8c45f695b7090e299185b1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:57.073207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:57.113752 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1051/2104] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:57 2022] PUT /identity/v3/projects/d798b14d99db4d34b12f37001a08a406/users/101a8fea0b8c45f695b7090e299185b1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:57.114879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:57.150279 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1054/2105] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:56 2022] PUT /identity/v3/projects/b94df274ea1b4a2387fa8a717cb3ca3b/users/bbede44ae7194b4e97bc67e0dc8207b3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:57.151968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf67a-74d8-4d26-97f8-f7e90ab5bedc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.160149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf67a-74d8-4d26-97f8-f7e90ab5bedc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.160149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf67a-74d8-4d26-97f8-f7e90ab5bedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.228139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5d7bf67a-74d8-4d26-97f8-f7e90ab5bedc None None] MFA Rules not processed for user `101a8fea0b8c45f695b7090e299185b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:57.230010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5d7bf67a-74d8-4d26-97f8-f7e90ab5bedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:57.235946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bb949-2858-4a85-bcac-74ea54febdb4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:57.426050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:57.426993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.427812 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1055/2106] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:57.428231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.428231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.428711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:57.436646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:57.436859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.438719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.439112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.524786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] MFA Rules not processed for user `bbede44ae7194b4e97bc67e0dc8207b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:57.533232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:57.599243 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1052/2107] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:57 2022] POST /identity/v3/projects => generated 399 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:57.599243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:57.599243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:57.693988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1056/2108] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:57.695154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:57.723839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3ae0-9305-4cdf-85e2-8cbb73f96c58 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:57.735471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f4ff-776c-4eee-a7e0-4309a4d56b63 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:57.743685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:57.755658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.756365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.762007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.846688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:57.847706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.848190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.848753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.849618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:57.850500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:57.852053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:57.902980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:57.904955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:57.921095 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1053/2109] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:57.942453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:57.967686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043e58a-fa85-47ad-b6ea-bb120099dd43 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:57.968816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:57.973567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:57.974294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:57.974579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:57.974857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:57.975547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:57.979760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.000801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1057/2110] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:57 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:58.013590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.035483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cb62f-01b6-4847-8491-26b6be61eb01 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.059530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.060301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.060726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.061093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.061882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:58.063734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.088943 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1058/2111] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:58.099764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.115660 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1054/2112] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:57 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:58.119989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d8492-2734-4b82-aff8-f1fa01400d80 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.123695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.311268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.311893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.312170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.312433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.313184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:58.315572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.351795 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1059/2113] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:58.354584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf059572-1176-4d34-b358-e24cbef0ad7e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.356557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.373212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.374528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.374808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.375128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.378304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:58.386089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3bc2c-8dcb-468b-8d9c-41d2f83406f7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.389344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.404699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.405380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.405654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.405918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] PATH_INFO: `/v3/projects/ee661ddce84e47739e0959409b2b9437/users/5360364df7cc46219d391aea722ed616/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.452566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee661ddce84e47739e0959409b2b9437, user_id=5360364df7cc46219d391aea722ed616, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:58.456830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.555515 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1055/2114] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:58 2022] POST /identity/v3/users => generated 295 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:58.555515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.606170 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1060/2115] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:58 2022] PUT /identity/v3/projects/ee661ddce84e47739e0959409b2b9437/users/5360364df7cc46219d391aea722ed616/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:58.606170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:58.756590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee10d75-544b-46ef-9576-f02247b6dad4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.779116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45331e65-e9e5-4644-bc57-fdb913303028 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:58.793991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.794751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.795049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.795317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.795973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:58.798456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122651f-571e-4335-aec3-2a3fb2b83b14 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:58.837410 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1061/2116] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:58.837410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.841007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.841417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.858048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:58.859750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:58.860103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:58.860766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:58.864171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:58.921008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] MFA Rules not processed for user `5360364df7cc46219d391aea722ed616`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:58.923662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:59.019011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.021123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.044650 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1056/2117] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:36:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:36:59.045522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.073934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926cd4c-f9c8-4e0f-a9a0-8e497a1591b6 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.078239 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1062/2118] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:59.079434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.091179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.091936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.092334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.092730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] PATH_INFO: `/v3/projects/50acc6150881430ebd7e9400b1646a4a/users/5439f28d6fa34298af69d396bdcbf41d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.106038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3feed5-08c7-4f41-bfc4-76a257deac01 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.115730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50acc6150881430ebd7e9400b1646a4a, user_id=5439f28d6fa34298af69d396bdcbf41d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.117486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.119154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.119759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.120110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.121099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.122185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.126581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.295014 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1063/2119] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:36:59 2022] POST /identity/v3/projects => generated 397 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:59.295947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.296343 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1057/2120] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:59 2022] PUT /identity/v3/projects/50acc6150881430ebd7e9400b1646a4a/users/5439f28d6fa34298af69d396bdcbf41d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:59.300029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.447561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0860c-2b48-454b-8f35-c97c86bc0fd1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.457347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7b5f2-418a-4c23-81c7-f41473fc5c5c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.463110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.464563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.464884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.465415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.469213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.470185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.478381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.479226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.479613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.479954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.482216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.484687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.508177 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1058/2121] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:59.528473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.550526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb6930-2ffd-445b-92b5-9fe2b45a7350 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.565080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.565861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.566490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.566490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] PATH_INFO: `/v3/projects/50acc6150881430ebd7e9400b1646a4a/users/5439f28d6fa34298af69d396bdcbf41d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.574882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=50acc6150881430ebd7e9400b1646a4a, user_id=5439f28d6fa34298af69d396bdcbf41d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.577625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dff582-0527-4cab-b65f-58d3a4d693ee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.602574 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1059/2122] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:59 2022] PUT /identity/v3/projects/50acc6150881430ebd7e9400b1646a4a/users/5439f28d6fa34298af69d396bdcbf41d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:36:59.617033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5eb14-d0b9-4eba-9104-e63694592f04 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.617312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5eb14-d0b9-4eba-9104-e63694592f04 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.617595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5eb14-d0b9-4eba-9104-e63694592f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.624682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1064/2123] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:36:59 2022] POST /identity/v3/users => generated 305 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:36:59.636208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8ec5eb14-d0b9-4eba-9104-e63694592f04 None None] MFA Rules not processed for user `5439f28d6fa34298af69d396bdcbf41d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:59.692966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f04a1c-1fd0-45b8-a8f6-d2a7312e4d6a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:36:59.693983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ec5eb14-d0b9-4eba-9104-e63694592f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:59.916474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1060/2124] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:36:59.918037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.918320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.918596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.931500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.934288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:36:59.934923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:36:59.935205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:36:59.935479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:36:59.938291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:36:59.939949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:36:59.959019 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1065/2125] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:36:59.965149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:36:59.967848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] MFA Rules not processed for user `bbede44ae7194b4e97bc67e0dc8207b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:36:59.969107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:36:59.985416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94e02e-4e1c-40f5-bafc-30dc90f4c4f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.001858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.003058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.003499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.004399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] PATH_INFO: `/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7/users/a71ed8d0a2b84b62970be869e4ded2cc/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.050409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9211ecdb00a45a8abb6d6511f3c1fd7, user_id=a71ed8d0a2b84b62970be869e4ded2cc, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:00.057601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:00.076001 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1061/2126] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:36:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:00.095496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:00.105343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c429f0f-b7a9-47df-b3e3-d86357e01408 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.111718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.112669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.113131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.113492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] PATH_INFO: `/v3/users/ea22f5f79fb4479687c195848c2b94f8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.114932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea22f5f79fb4479687c195848c2b94f8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:00.117089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:00.209825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1066/2127] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:36:59 2022] PUT /identity/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7/users/a71ed8d0a2b84b62970be869e4ded2cc/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:00.213733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:00.369696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9efaa-146c-4d6d-8a0b-245b7578d555 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.393725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.396180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.396938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.398071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.400121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea22f5f79fb4479687c195848c2b94f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:00.400553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:00.404739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:00.424161 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1067/2128] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:00.428852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:00.442812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293ef5c-216f-4004-b92b-e58c1718fca3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.464964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.467007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.467007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.467007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] PATH_INFO: `/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7/users/a71ed8d0a2b84b62970be869e4ded2cc/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.468858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9211ecdb00a45a8abb6d6511f3c1fd7, user_id=a71ed8d0a2b84b62970be869e4ded2cc, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:00.472136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473909b-3aa9-4348-a937-a7fdb6294ad0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:00.489583 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1068/2129] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:00 2022] PUT /identity/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7/users/a71ed8d0a2b84b62970be869e4ded2cc/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:00.500957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea22f5f79fb4479687c195848c2b94f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:00.501827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:00.505094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.509911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.509911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.543354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea22f5f79fb4479687c195848c2b94f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:00.565304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea22f5f79fb4479687c195848c2b94f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:00.566189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e47ee24-3e5a-49e6-9ed7-2b62f509dba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea22f5f79fb4479687c195848c2b94f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:00.577990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] MFA Rules not processed for user `a71ed8d0a2b84b62970be869e4ded2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:00.578533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1062/2130] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:00 2022] DELETE /identity/v3/users/ea22f5f79fb4479687c195848c2b94f8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:00.584790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:00.590619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.590899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.591171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.628581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:00.632536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:00.756682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1069/2131] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:00 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:00.756682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:00.756682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:00.771426 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1063/2132] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:00.811919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:00.813987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:00.947388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f58789-f1f0-4303-ba8b-0f850704bc2d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.955368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.956323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.956810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.957225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:00.959237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:00.972799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff2ea1-beda-4c36-b6d8-834183176dbc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:00.985628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:00.988026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:00.989496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:00.989899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:01.021434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:01.026291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:01.068008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1064/2133] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:01.089009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:01.090646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:01.094761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:01.096582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:01.103146 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1070/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:01.140314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1faa-5083-400c-b1ad-48fa35c1f63a service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:01.167837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:01.171291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:01.173237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:01.173237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:01.179140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:01.313586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:01.315449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:01.351258 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1065/2135] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:01.422823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:01.437868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2580d6-4cdb-4f0f-b433-fe7332934fd4 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:01.445371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:01.446732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:01.447266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:01.448534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:01.462971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:01.465040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:01.476282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1071/2136] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:01 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:02.256934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:02.258521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:02.278666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b50c7-3ed3-4214-a34f-db5d0011f528 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:02.285944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:02.286678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:02.286959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:02.287460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] PATH_INFO: `/v3/projects/21b8876635434dabbace96d2b6ce03c0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:02.291630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21b8876635434dabbace96d2b6ce03c0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:02.294256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:02.389513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:02.391037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:02.415192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384369d-97e2-4b11-8e1a-258f10788df5 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:02.421790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:02.422879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:02.423350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:02.423789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] PATH_INFO: `/v3/users/b6215b447217431dbf79ad5b037d1b59` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:02.426445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6215b447217431dbf79ad5b037d1b59)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:02.429361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:02.517338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21b8876635434dabbace96d2b6ce03c0', 'request_id': 'req-ad1afdf3-9c87-48e8-82cc-a8798693c369'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.533910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21b8876635434dabbace96d2b6ce03c0', 'request_id': 'req-ad1afdf3-9c87-48e8-82cc-a8798693c369'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.546023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21b8876635434dabbace96d2b6ce03c0', 'request_id': 'req-ad1afdf3-9c87-48e8-82cc-a8798693c369'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.645421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] The token cache is being invalidate because project 21b8876635434dabbace96d2b6ce03c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:02.646012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.647291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.649090 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1066/2137] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:02 2022] DELETE /identity/v3/projects/21b8876635434dabbace96d2b6ce03c0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:02.654913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:02.656990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:02.740989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6215b447217431dbf79ad5b037d1b59'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.792887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1afdf3-9c87-48e8-82cc-a8798693c369 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:02.800306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:02.801074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:02.801401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:02.801850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] PATH_INFO: `/v3/users/101a8fea0b8c45f695b7090e299185b1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:02.804083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101a8fea0b8c45f695b7090e299185b1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:02.807404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:02.845766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6215b447217431dbf79ad5b037d1b59'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.898793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6215b447217431dbf79ad5b037d1b59'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.899918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6215b447217431dbf79ad5b037d1b59'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.900851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6215b447217431dbf79ad5b037d1b59'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:02.922912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1072/2138] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:02 2022] DELETE /identity/v3/users/b6215b447217431dbf79ad5b037d1b59 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:03.148087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101a8fea0b8c45f695b7090e299185b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:03.353878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:03.355501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:03.407429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101a8fea0b8c45f695b7090e299185b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:03.441210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101a8fea0b8c45f695b7090e299185b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:03.471705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101a8fea0b8c45f695b7090e299185b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:03.475804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101a8fea0b8c45f695b7090e299185b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:03.497293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1067/2139] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:02 2022] DELETE /identity/v3/users/101a8fea0b8c45f695b7090e299185b1 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:03.576298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6c8ad-f0e4-4d76-9886-3476d37d5cf0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:03.735683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:03.737814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:03.738300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:03.738720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] PATH_INFO: `/v3/users/5360364df7cc46219d391aea722ed616` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:03.740302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5360364df7cc46219d391aea722ed616)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:03.760245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:03.783387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:03.785031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:03.808012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab659e-ad7e-49c8-805c-a94a4dc44403 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:03.820940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:03.821735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:03.823943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:03.824350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] PATH_INFO: `/v3/projects/d20ecfbbcbcd4953aed36bc1c7e4c054` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:03.826670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20ecfbbcbcd4953aed36bc1c7e4c054)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:03.831853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:04.083549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5360364df7cc46219d391aea722ed616'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.092073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:04.098850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20ecfbbcbcd4953aed36bc1c7e4c054', 'request_id': 'req-a3e6b643-fc0d-4ca1-973e-c883e9741d38'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.121727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20ecfbbcbcd4953aed36bc1c7e4c054', 'request_id': 'req-a3e6b643-fc0d-4ca1-973e-c883e9741d38'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.138203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20ecfbbcbcd4953aed36bc1c7e4c054', 'request_id': 'req-a3e6b643-fc0d-4ca1-973e-c883e9741d38'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.241223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5360364df7cc46219d391aea722ed616'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.277298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5360364df7cc46219d391aea722ed616'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.278972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5360364df7cc46219d391aea722ed616'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.280913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d86d708-5a1d-402f-ac51-94261232fbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5360364df7cc46219d391aea722ed616'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.312434 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1073/2140] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:03 2022] DELETE /identity/v3/users/5360364df7cc46219d391aea722ed616 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:04.323629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.325017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.325547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.369886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] The token cache is being invalidate because project d20ecfbbcbcd4953aed36bc1c7e4c054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:04.369886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.370767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3e6b643-fc0d-4ca1-973e-c883e9741d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:04.377025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:04.378521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:04.386628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1068/2141] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:03 2022] DELETE /identity/v3/projects/d20ecfbbcbcd4953aed36bc1c7e4c054 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:04.388562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb000c-1743-40da-b470-92098fd36d6c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.391084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb000c-1743-40da-b470-92098fd36d6c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.391566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb000c-1743-40da-b470-92098fd36d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.436279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-58cb000c-1743-40da-b470-92098fd36d6c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:04.438458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-58cb000c-1743-40da-b470-92098fd36d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:04.547030 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1069/2142] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:04.555269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.555553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.555828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.560211 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1074/2143] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:04.584725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:04.586242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:04.603095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:04.604664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:04.626810 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1070/2144] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:04.628213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:04.663161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88780316-dc97-4fd0-be26-ec512313c1ce None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:04.675223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:04.679594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:04.680799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.681203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.681481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.682187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:04.682590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:04.687091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:04.702548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10972c3-f93b-445a-965b-03c38234a122 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:04.709470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:04.710458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.710945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.711457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.715751 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1071/2145] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:04.716744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:04.725342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:04.727245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:04.739623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1075/2146] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:04.741135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09993d2-9128-4595-becc-efe16e3bdfdc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:04.746811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:04.747620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:04.748083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:04.748775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:04.749583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:04.751837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:04.914022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1072/2147] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:04 2022] POST /identity/v3/projects => generated 397 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:04.918963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:04.931743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22383d-3b94-4f2b-aa74-478f6a92184a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:05.045692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.047679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:05.104547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:05.105144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.105427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.106212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.107321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:05.109520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:05.174981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7bde-2dfb-469f-8160-10e534ceb81e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:05.179961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:05.181208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.181487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.182357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] PATH_INFO: `/v3/projects/d798b14d99db4d34b12f37001a08a406` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.183550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d798b14d99db4d34b12f37001a08a406)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:05.185747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:05.261045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1076/2148] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:04 2022] POST /identity/v3/users => generated 299 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:05.264871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.277858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c802600-6ab3-4533-85c0-1ccfb4ee6460 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:05.283982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:05.285173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.285455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.285730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.287173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:05.290158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:05.303138 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1077/2149] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:05.319628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.347476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667c4e-ec0b-47de-96d7-822aeb27a5d5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:05.365127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:05.365761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.366039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.366310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.366964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:05.369297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:05.394315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1078/2150] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:05.398194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.411860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29dc64-d94b-4e31-aeb2-c052e802ecb9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:05.419987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:05.421044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.423891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.423891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] PATH_INFO: `/v3/projects/f06f62ec55ad43f7879d7a8d18071ba8/users/843c51faea574f27919b070331f3fe7e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.456868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06f62ec55ad43f7879d7a8d18071ba8, user_id=843c51faea574f27919b070331f3fe7e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:05.460113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56e07e-fea0-49ab-9d97-2d7a41c2c712 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:05.469435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd798b14d99db4d34b12f37001a08a406', 'request_id': 'req-180cd5f6-e9cf-480c-975c-77831aba010b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:05.481968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd798b14d99db4d34b12f37001a08a406', 'request_id': 'req-180cd5f6-e9cf-480c-975c-77831aba010b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:05.490199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd798b14d99db4d34b12f37001a08a406', 'request_id': 'req-180cd5f6-e9cf-480c-975c-77831aba010b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:05.660971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] The token cache is being invalidate because project d798b14d99db4d34b12f37001a08a406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:05.661508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:05.662386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-180cd5f6-e9cf-480c-975c-77831aba010b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:05.663364 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1079/2151] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:05 2022] PUT /identity/v3/projects/f06f62ec55ad43f7879d7a8d18071ba8/users/843c51faea574f27919b070331f3fe7e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:05.672974 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1073/2152] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:05 2022] DELETE /identity/v3/projects/d798b14d99db4d34b12f37001a08a406 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:05.674924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa53df-2f53-402e-be89-b8ef23ff4e87 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.676774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.677164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.677681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.680882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa53df-2f53-402e-be89-b8ef23ff4e87 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.681880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa53df-2f53-402e-be89-b8ef23ff4e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.723479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-70aa53df-2f53-402e-be89-b8ef23ff4e87 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:05.725065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70aa53df-2f53-402e-be89-b8ef23ff4e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:05.741991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] MFA Rules not processed for user `843c51faea574f27919b070331f3fe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:05.747287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:05.884667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1074/2153] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:05.904680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.904680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:05.931173 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1080/2154] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:05.941106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:05.941450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:05.941728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:05.978535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:05.979781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:05.996504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1081/2155] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:05.997386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:05.998701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:06.018889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99200e-c5ef-43a3-9501-cd7b43769ad7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.025761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.026996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.028162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.028443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] PATH_INFO: `/v3/projects/ee661ddce84e47739e0959409b2b9437` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.029769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee661ddce84e47739e0959409b2b9437)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.032558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:06.106103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f305e-94b9-4db0-9b40-70a5b49a8795 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.112725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.113582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.114020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.114438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.124140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.126096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:06.160444 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1075/2156] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:06.161496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:06.184979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee34fa-c45d-438f-83e2-7ec23c15c168 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.200751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.201552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.201994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.202415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.203415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:06.203885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.205738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:06.241849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1076/2157] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:06.247067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:06.280584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96613ed-5aaa-4820-a71a-1fb579b0f310 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.343803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee661ddce84e47739e0959409b2b9437', 'request_id': 'req-890d0b31-df6f-4cee-b834-f6b149f82a40'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:06.361058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee661ddce84e47739e0959409b2b9437', 'request_id': 'req-890d0b31-df6f-4cee-b834-f6b149f82a40'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:06.404040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.404831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.405276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.406176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.406534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.408747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:06.546921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee661ddce84e47739e0959409b2b9437', 'request_id': 'req-890d0b31-df6f-4cee-b834-f6b149f82a40'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:06.570547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] The token cache is being invalidate because project ee661ddce84e47739e0959409b2b9437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:06.571206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:06.573985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-890d0b31-df6f-4cee-b834-f6b149f82a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:06.577253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1082/2158] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:05 2022] DELETE /identity/v3/projects/ee661ddce84e47739e0959409b2b9437 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:06.579261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.579826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.580324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.612312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] MFA Rules not processed for user `843c51faea574f27919b070331f3fe7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:06.613886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:06.656564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1077/2159] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:06 2022] POST /identity/v3/projects => generated 387 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:37:06.657746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:06.668761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:06.762258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1083/2160] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:06.764182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:06.769732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:06.779990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:06.807245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a2651-3271-46af-af2a-860516cf7b3d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.819437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ede470-8dd2-49e7-9e87-2666d36620e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:06.822963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.823667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.824008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.824445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.825203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.825708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:06.826427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:06.826782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:06.827121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] PATH_INFO: `/v3/users/a71ed8d0a2b84b62970be869e4ded2cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:06.828481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a71ed8d0a2b84b62970be869e4ded2cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:06.830047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:06.830830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.002517 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1084/2161] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:06 2022] POST /identity/v3/users => generated 294 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:07.007144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.025639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb53a1-9e7e-4386-bed5-aa70fb61891d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.035755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.035755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.035755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.035755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.036122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.037977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.061555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1085/2162] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:07.063121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.075945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3145178-644c-4195-8a44-fd7b690978c7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.088127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.089090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.089517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.089935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.090921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.092925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.111260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1086/2163] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:07.112501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.120999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71ed8d0a2b84b62970be869e4ded2cc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:07.127504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d4f960-c607-4f12-9842-5c8247b2d495 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.149999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.150699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.153457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.154030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] PATH_INFO: `/v3/projects/4614501647ac42bd9f10f9e8256f7e9a/users/9eb4cb2eb6f54baab042f88d4c718705/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.183581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4614501647ac42bd9f10f9e8256f7e9a, user_id=9eb4cb2eb6f54baab042f88d4c718705, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.186495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3bc73-6bec-4e2e-b4e0-139ea3fef9ad admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.202712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:07.242664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71ed8d0a2b84b62970be869e4ded2cc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:07.266379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71ed8d0a2b84b62970be869e4ded2cc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:07.292821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71ed8d0a2b84b62970be869e4ded2cc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:07.301858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71ed8d0a2b84b62970be869e4ded2cc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:07.320052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1087/2164] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:07 2022] PUT /identity/v3/projects/4614501647ac42bd9f10f9e8256f7e9a/users/9eb4cb2eb6f54baab042f88d4c718705/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:07.321825 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1078/2165] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:06 2022] DELETE /identity/v3/users/a71ed8d0a2b84b62970be869e4ded2cc => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:07.333776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.333776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.333776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.388283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] MFA Rules not processed for user `9eb4cb2eb6f54baab042f88d4c718705`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:07.390066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:07.535658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.535980 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1088/2166] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:07.537301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:07.574490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.576198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:07.651265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70077f6-a58c-491d-aa31-5381d7bcab2e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.652343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:07.658742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.659351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.663488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.663488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.663488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.663488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.743921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4dc431-e185-4c87-be9d-c2a4d36e843a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.754023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.755129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.755415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.755756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] PATH_INFO: `/v3/users/ff76a6cbd0154558a0617fd081412831` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.757461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff76a6cbd0154558a0617fd081412831)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.760231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:07.811436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1079/2167] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:07 2022] POST /identity/v3/projects => generated 387 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:07.823093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:07.830498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:07.954157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55121d6-c633-4d36-ac08-725365159b90 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:07.960525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:07.960525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:07.960525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:07.961465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] PATH_INFO: `/v3/users/843c51faea574f27919b070331f3fe7e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:07.962673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843c51faea574f27919b070331f3fe7e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:07.965167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:08.141328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff76a6cbd0154558a0617fd081412831'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.260481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff76a6cbd0154558a0617fd081412831'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.293235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843c51faea574f27919b070331f3fe7e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.296756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff76a6cbd0154558a0617fd081412831'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.297817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff76a6cbd0154558a0617fd081412831'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.298951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff76a6cbd0154558a0617fd081412831'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.324182 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1089/2168] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:07 2022] DELETE /identity/v3/users/ff76a6cbd0154558a0617fd081412831 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:08.325619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:08.328595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:08.501584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843c51faea574f27919b070331f3fe7e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.510450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19a004-54fb-4828-83a1-9146d88b6e7c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:08.525919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843c51faea574f27919b070331f3fe7e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.528714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:08.530602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:08.531486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:08.531486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:08.531684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:08.550137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:08.561884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843c51faea574f27919b070331f3fe7e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.562856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58d412d2-d644-4b5f-8afd-d04d0983beb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843c51faea574f27919b070331f3fe7e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:08.573854 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1080/2169] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:07 2022] DELETE /identity/v3/users/843c51faea574f27919b070331f3fe7e => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:08.579250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:08.579514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:08.579877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:08.612110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:08.613607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:08.741729 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1090/2170] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:08 2022] POST /identity/v3/users => generated 300 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:08.745601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:08.751105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:08.766341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d74ec4-dd01-4ebd-a3fa-ff6612f041e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:08.832474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1081/2171] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:08.834536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:08.840189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:08.901294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:08.902093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:08.903190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:08.903668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:08.904869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:08.910555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:08.936574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1091/2172] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:08.936809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:08.941542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:08.987826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125a51b-77a9-4a27-871d-c07fde6d2b5b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:08.995803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:08.996995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:08.999939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:08.999939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] PATH_INFO: `/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.000533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9211ecdb00a45a8abb6d6511f3c1fd7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.002671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.035714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05319143-3b8f-4b2a-a020-37ddc704861b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:09.041330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:09.042254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.042720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.043571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.081453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.083537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.100003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:09.110047 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1082/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:09.110864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:09.123126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348806d-5962-41b9-ae06-46a52704f113 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:09.129575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:09.131120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.131479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.131823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] PATH_INFO: `/v3/projects/4bcace4cff73419496f326310091e2eb/users/8bec84816c31434c910aecaadd180784/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.179138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcace4cff73419496f326310091e2eb, user_id=8bec84816c31434c910aecaadd180784, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.182774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.293807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1083/2174] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:09 2022] PUT /identity/v3/projects/4bcace4cff73419496f326310091e2eb/users/8bec84816c31434c910aecaadd180784/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:09.295282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:09.300799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:09.317128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9211ecdb00a45a8abb6d6511f3c1fd7', 'request_id': 'req-a7fff42a-9f90-4b3a-900d-3f332711ae90'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.334153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9211ecdb00a45a8abb6d6511f3c1fd7', 'request_id': 'req-a7fff42a-9f90-4b3a-900d-3f332711ae90'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.418864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73d7d6-909f-4c16-96b4-1889db4e618c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:09.425394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9211ecdb00a45a8abb6d6511f3c1fd7', 'request_id': 'req-a7fff42a-9f90-4b3a-900d-3f332711ae90'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.443245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] The token cache is being invalidate because project a9211ecdb00a45a8abb6d6511f3c1fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:09.444009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.444750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.447644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1092/2175] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:08 2022] DELETE /identity/v3/projects/a9211ecdb00a45a8abb6d6511f3c1fd7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:09.449557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:09.454894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:09.461374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:09.499840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:09.500735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.501011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.501651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] PATH_INFO: `/v3/projects/9774a0fd28c545c490450ef89610c63d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.502697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9774a0fd28c545c490450ef89610c63d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.504944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.538082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fff42a-9f90-4b3a-900d-3f332711ae90 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:09.545484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:09.546377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.546648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.546922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.548055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.549390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad38070-e68c-4d7d-a455-466bdb8d1ecb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.561848 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1093/2176] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:09.563428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fdc8-6e91-4682-ae62-18fdcf57f8a1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.563719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fdc8-6e91-4682-ae62-18fdcf57f8a1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.564153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15fdc8-6e91-4682-ae62-18fdcf57f8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.607798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2d15fdc8-6e91-4682-ae62-18fdcf57f8a1 None None] MFA Rules not processed for user `cca7a2d46b204d7a9580267df3c8107c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:09.609408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2d15fdc8-6e91-4682-ae62-18fdcf57f8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:09.670592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9774a0fd28c545c490450ef89610c63d', 'request_id': 'req-999d5154-ae56-421f-b7cf-a804dd5a9561'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.695273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9774a0fd28c545c490450ef89610c63d', 'request_id': 'req-999d5154-ae56-421f-b7cf-a804dd5a9561'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.718842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9774a0fd28c545c490450ef89610c63d', 'request_id': 'req-999d5154-ae56-421f-b7cf-a804dd5a9561'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.759648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1094/2177] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:09.761342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b990-5deb-44b9-a884-f7bef92d0e85 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.761525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b990-5deb-44b9-a884-f7bef92d0e85 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.762182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16b990-5deb-44b9-a884-f7bef92d0e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.812908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6c16b990-5deb-44b9-a884-f7bef92d0e85 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:09.815468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6c16b990-5deb-44b9-a884-f7bef92d0e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:09.831330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] The token cache is being invalidate because project 9774a0fd28c545c490450ef89610c63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:09.831606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.833360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:09.836465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1084/2178] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:09 2022] DELETE /identity/v3/projects/9774a0fd28c545c490450ef89610c63d => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:09.837003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:09.839421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:09.946449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d5154-ae56-421f-b7cf-a804dd5a9561 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:09.953118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:09.953118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.953118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.953481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] PATH_INFO: `/v3/projects/4bcace4cff73419496f326310091e2eb/users/8bec84816c31434c910aecaadd180784/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:09.956013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcace4cff73419496f326310091e2eb, user_id=8bec84816c31434c910aecaadd180784, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:09.960027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:09.987971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1095/2179] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:09.989552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452317-2bbd-4ff1-b1f8-21dcd78940e4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:09.989839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452317-2bbd-4ff1-b1f8-21dcd78940e4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:09.992947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452317-2bbd-4ff1-b1f8-21dcd78940e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.012653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1085/2180] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:09 2022] PUT /identity/v3/projects/4bcace4cff73419496f326310091e2eb/users/8bec84816c31434c910aecaadd180784/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:10.016862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:10.021969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.041481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b9452317-2bbd-4ff1-b1f8-21dcd78940e4 None None] MFA Rules not processed for user `9379cc116a1e4896b7df09dcfa75eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:10.042761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9452317-2bbd-4ff1-b1f8-21dcd78940e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.117987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5449-8dbc-4011-9f81-91c10c25df91 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:10.125055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:10.126021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.126462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.127256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] PATH_INFO: `/v3/users/c6a478a25bdc454fbe3337bd8525ae41` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.128814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a478a25bdc454fbe3337bd8525ae41)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:10.131345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:10.213575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1096/2181] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:10.213575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba93e-367d-42c6-8837-8f7c13f9b8af None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.213575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba93e-367d-42c6-8837-8f7c13f9b8af None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.213575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba93e-367d-42c6-8837-8f7c13f9b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.252339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3fcba93e-367d-42c6-8837-8f7c13f9b8af None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:10.253812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3fcba93e-367d-42c6-8837-8f7c13f9b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.265738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1097/2182] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:10.267574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.268026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.268435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.357864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] MFA Rules not processed for user `8bec84816c31434c910aecaadd180784`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:10.359111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.502710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1098/2183] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:10 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:10.505136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:10.532416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08db54-21b0-4a86-a230-cb96fac961fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:10.539191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:10.540691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.541214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.542077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.543059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:10.543900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:10.547024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:10.573722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1099/2184] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:10.580024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:10.588407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.652173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a478a25bdc454fbe3337bd8525ae41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:10.732310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d759734-0d32-41fb-a373-ee6d7d9868ac admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:10.738347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:10.738966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.739244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.739514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.741570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.753779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:10.755647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:10.765888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1100/2185] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:10.767062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:10.777701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50484c-dbdc-4687-98d6-0b5fba53f759 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:10.780002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a478a25bdc454fbe3337bd8525ae41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:10.795009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:10.795688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.795951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.796145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.797097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:10.798740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:10.801659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a478a25bdc454fbe3337bd8525ae41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:10.815141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a478a25bdc454fbe3337bd8525ae41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:10.817195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a478a25bdc454fbe3337bd8525ae41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:10.832903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1086/2186] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:10 2022] DELETE /identity/v3/users/c6a478a25bdc454fbe3337bd8525ae41 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:10.832903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:10.832903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:10.942823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b5b7b-13fe-4de7-912b-50f1a61cf2cd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:10.952570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:10.954798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:10.955046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:10.955498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] PATH_INFO: `/v3/projects/f06f62ec55ad43f7879d7a8d18071ba8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:10.957606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06f62ec55ad43f7879d7a8d18071ba8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:10.961197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:11.025568 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1101/2187] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:10 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:11.027931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:11.032831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.162948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091894f-3436-4b24-82b4-f06b6bb6b9c4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:11.178731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06f62ec55ad43f7879d7a8d18071ba8', 'request_id': 'req-00a86fbf-6491-480a-83c6-d0806f45c77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.197054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06f62ec55ad43f7879d7a8d18071ba8', 'request_id': 'req-00a86fbf-6491-480a-83c6-d0806f45c77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.213720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06f62ec55ad43f7879d7a8d18071ba8', 'request_id': 'req-00a86fbf-6491-480a-83c6-d0806f45c77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.270958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:11.271582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.271859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.272137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.274218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.294963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] The token cache is being invalidate because project f06f62ec55ad43f7879d7a8d18071ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:11.298929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.298929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.298929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1087/2188] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:10 2022] DELETE /identity/v3/projects/f06f62ec55ad43f7879d7a8d18071ba8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:11.298929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:11.300399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.353107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:11.355053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41950119-44ae-4045-b50b-6b16671b6c87 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:11.380320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1102/2189] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:11.386215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a418-d705-485c-9f76-b060088e77ad None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.386215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a418-d705-485c-9f76-b060088e77ad None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.386420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21a418-d705-485c-9f76-b060088e77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-fc21a418-d705-485c-9f76-b060088e77ad None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:37:11.396209 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:11.402368 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:37:11.423652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a86fbf-6491-480a-83c6-d0806f45c77f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:11.436762 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1103/2190] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:37:11.436762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658dfde-4b85-4798-8463-4160b13546be None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.436762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658dfde-4b85-4798-8463-4160b13546be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.436762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658dfde-4b85-4798-8463-4160b13546be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.447655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:11.447655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.447655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.447655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.448065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:11.448065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219ed06-0d4f-4b9d-ab6c-572364168386 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:11.479124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e658dfde-4b85-4798-8463-4160b13546be None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:11.479884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e658dfde-4b85-4798-8463-4160b13546be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.532801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1104/2191] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:11.536870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658dfde-4b85-4798-8463-4160b13546be None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:11.541405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e658dfde-4b85-4798-8463-4160b13546be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.562027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658dfde-4b85-4798-8463-4160b13546be None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:11.569992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:11.570533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.570834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.571185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] PATH_INFO: `/v3/projects/6f2c8035f0584149a43ffcc4c36d85db` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.572971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2c8035f0584149a43ffcc4c36d85db)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:11.575790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:11.621021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1088/2192] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/users => generated 303 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:11.623990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc547-d36b-4f37-b630-7d2f6be5a0ae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.624756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc547-d36b-4f37-b630-7d2f6be5a0ae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.625134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bc547-d36b-4f37-b630-7d2f6be5a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.649581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:11.670087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9d9bc547-d36b-4f37-b630-7d2f6be5a0ae None None] MFA Rules not processed for user `9379cc116a1e4896b7df09dcfa75eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:11.672025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9d9bc547-d36b-4f37-b630-7d2f6be5a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.741381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2c8035f0584149a43ffcc4c36d85db', 'request_id': 'req-c98066da-c623-444a-b31e-5e3b2dd9dd9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.752189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2c8035f0584149a43ffcc4c36d85db', 'request_id': 'req-c98066da-c623-444a-b31e-5e3b2dd9dd9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.788185 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1089/2193] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:11.790691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241a6-01d7-4526-8adb-de6c094aca00 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.791206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241a6-01d7-4526-8adb-de6c094aca00 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.791692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94241a6-01d7-4526-8adb-de6c094aca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:11.819773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a94241a6-01d7-4526-8adb-de6c094aca00 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:11.821485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a94241a6-01d7-4526-8adb-de6c094aca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.841613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2c8035f0584149a43ffcc4c36d85db', 'request_id': 'req-c98066da-c623-444a-b31e-5e3b2dd9dd9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.862046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] The token cache is being invalidate because project 6f2c8035f0584149a43ffcc4c36d85db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:11.862483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.863573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:11.872737 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1105/2194] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:11 2022] DELETE /identity/v3/projects/6f2c8035f0584149a43ffcc4c36d85db => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:11.874269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:11.892783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:11.985465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1090/2195] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:11.986936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:11.987219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:11.987665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.029646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:12.031089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:12.048108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:12.050284 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1091/2196] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:12.053720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.058307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:12.059533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98066da-c623-444a-b31e-5e3b2dd9dd9e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.080375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.081711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.082217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.083284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.083945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.087300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.102470 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1106/2197] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:12.103465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.126042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e88f-0478-4460-a49a-d3e2b8131b3c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.135821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.136446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.136758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.137028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.140426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:12.140853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.142771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095d54f8-94c3-47cf-a6d9-611426625762 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.202822 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1107/2198] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:12.202822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.202822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.202822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.233400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:12.234634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:12.255996 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1108/2199] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:12.264099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.293070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77600c-29c1-478f-b10b-ec39df8c1af9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.307922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59443c3-613b-4ffd-9275-bd42fcfbfcf3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.309572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.310216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.310583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.310740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.312997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:12.334372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.334980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.335389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.335847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.337341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.338858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.380217 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1109/2200] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:12.382626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.412252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.414222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.417383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e872bb1-1b81-40df-ad9c-e2f27ee39fc3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.424112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.424772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.425046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.425311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.425948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.428091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.429860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1092/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:12.430928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.485407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a335-921f-4b3b-a767-a85dcd6c4959 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.494738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.495756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.496465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.497051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.498942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:12.499640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.502705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.534865 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1093/2202] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:12.539205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.558186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d009c63-3415-43e1-ae2b-6de29908087a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.581989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.583601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.584116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.584727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] PATH_INFO: `/v3/projects/4a825a5c09b94750aa1382e00bd6a956/users/d8552963e6944dbebe1ab05cf249a4a6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.636050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a825a5c09b94750aa1382e00bd6a956, user_id=d8552963e6944dbebe1ab05cf249a4a6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.640533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.646875 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1110/2203] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:12 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:12.647930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.781839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1094/2204] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:12 2022] PUT /identity/v3/projects/4a825a5c09b94750aa1382e00bd6a956/users/d8552963e6944dbebe1ab05cf249a4a6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:12.801900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:12.838770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fa5c8-8c0d-4d45-831b-31ba1786ce82 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.947072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b295ae-b2f8-43c4-b5bf-88085d9d6ecd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:12.976285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.978027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.978839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.979685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.981789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.981987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:12.982922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:12.983387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:12.983847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:12.989727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:12.995847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77e3e2-2bfd-454a-bf1a-f26b6bdfbe29 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:12.997342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324c0d3-04e7-41a4-8027-03a6c8b1d472 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.174640 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1095/2205] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:12 2022] POST /identity/v3/users => generated 294 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:13.176881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.177436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.179597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.189026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1111/2206] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:12 2022] POST /identity/v3/projects => generated 385 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:13.192348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.192965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.193594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:37:13.210868 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:13.211887 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:37:13.213397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:13.214109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1112/2207] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:37:13.215744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.229982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:13.237116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:13.346148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3b03-afac-49d3-abd9-9ceb54a6384b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.356366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.357875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.358870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.360941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] PATH_INFO: `/v3/users/9eb4cb2eb6f54baab042f88d4c718705` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.363616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb4cb2eb6f54baab042f88d4c718705)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.366310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.368236 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1096/2208] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:13.369985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.391196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb1a6f-b0f9-48e0-b0aa-f1b780261931 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.407669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.408300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.411055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.411383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.412062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.415028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.434266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1097/2209] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:13.434266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.450417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb16f7-5e0f-42f8-b04e-b12ee92dde11 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.460077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.460998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.461636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.471192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.471192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.479713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.524956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:13.609494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1098/2210] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:13 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:13.610998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.614871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:13.650898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb4cb2eb6f54baab042f88d4c718705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:13.718968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5948c-91f7-447c-bc1e-ec9589586d45 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.725469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.726434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.726434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.727485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.739019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.740471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.751510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1099/2211] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:13.752093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.763244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35e1b-9aec-440f-b2b4-135f2dae740d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.771009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.772294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.772847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.773195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.774848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.777426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.795897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1100/2212] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:13.795897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.804993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb4cb2eb6f54baab042f88d4c718705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:13.806135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca88287-a406-4425-8d9e-4cef33bcc221 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.818876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.819727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.820006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.821019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.821019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.822740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.824665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb4cb2eb6f54baab042f88d4c718705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:13.825500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb4cb2eb6f54baab042f88d4c718705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:13.826178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb4cb2eb6f54baab042f88d4c718705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:13.836852 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1101/2213] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:13.837805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.840536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:13.848289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1113/2214] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:13 2022] DELETE /identity/v3/users/9eb4cb2eb6f54baab042f88d4c718705 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:13.849097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:13.850941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:13.860246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4def8d5-f4b6-4161-a217-19034f3dae07 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.960683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75432-b5a7-4fc7-8555-f316cee1a19e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:13.967076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.968068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.968354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.968704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] PATH_INFO: `/v3/projects/892fb03c420b40bca466510fca720571/users/fa2b6dc15a41463d86d252948b613f48/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.971157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:13.972064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:13.972654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:13.973131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:13.973997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.975913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497787ea-6170-4dc3-9ea4-06dd665918a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:13.980658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:13.991567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=892fb03c420b40bca466510fca720571, user_id=fa2b6dc15a41463d86d252948b613f48, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:13.995063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:14.011612 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1114/2215] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:14.011612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.011612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.011612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.031285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:14.032699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:14.042613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1115/2216] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:14.046928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:14.057597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34208bf1-4196-4146-ae4f-d8f9101206c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:14.063151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:14.063891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.064196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.064457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] PATH_INFO: `/v3/projects/b2967018bbd64629a9a49c051c3d1e60/users/fd9a2cf92b094c54bdce2e0bf8903af3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.082929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2967018bbd64629a9a49c051c3d1e60, user_id=fd9a2cf92b094c54bdce2e0bf8903af3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:14.089146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174e77c-1db9-4d28-8e55-42aa54d569db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:14.089368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1102/2217] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:13 2022] PUT /identity/v3/projects/892fb03c420b40bca466510fca720571/users/fa2b6dc15a41463d86d252948b613f48/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:14.089368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:14.091323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:14.183710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a3961-82f0-4816-9fb1-177b9f727f8b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:14.201981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:14.205119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.205404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.206919 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1116/2218] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:14 2022] PUT /identity/v3/projects/b2967018bbd64629a9a49c051c3d1e60/users/fd9a2cf92b094c54bdce2e0bf8903af3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:14.207091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.230891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.231372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.231841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.284208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:14.286405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:14.413153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:14.420193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39082f28-9778-4447-a9cf-f1b51e947567 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:14.458107 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1103/2219] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:14.464926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.465270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.467569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.481682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1117/2220] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:14.498286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:14.502362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:14.566240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] MFA Rules not processed for user `fd9a2cf92b094c54bdce2e0bf8903af3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:14.571200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:14.673877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1104/2221] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:14.678530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d874b7-823c-4bd6-9ab5-39af5a870a56 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:14.684163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:14.685775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:14.687076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.687806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.688773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.720443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:14.720978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae3b13-09f7-49b6-b564-31939f5dd148 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:14.721127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:14.737666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:14.738674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:14.739127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:14.739956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:14.741136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:14.749822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:14.772443 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1118/2222] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:14.949452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1105/2223] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:14 2022] POST /identity/v3/projects => generated 387 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:14.954519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:14.973804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909984-76b1-4cd4-a85b-8d71249f24fa service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.155094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.155722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.156052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.156539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.158340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.168662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.323740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1119/2224] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:14 2022] POST /identity/v3/users => generated 300 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:15.324026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:15.332524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc778-345d-4400-91a5-af78f24781f7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.344751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.345758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.346053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.346332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.348153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.354425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7063b-ebfb-4c9b-96bb-7617ac6222de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.369249 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1106/2225] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:15.373357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:15.385070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0543a-5314-4557-b9a4-cd4218c0352d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.407267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.407267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.407267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.407267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] PATH_INFO: `/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.467292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d4fa85f0fc497f96bf3533a0b98c1f, user_id=8f7ae91cc1a34bfcab5a04fd57e8a2c2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.470256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.592023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.592333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.592626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:37:15.600856 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:15.602406 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:37:15.603393 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1107/2226] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:37:15.648117 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1120/2227] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:15 2022] PUT /identity/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:15.649899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:15.745275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:15.747291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:15.763115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974d6a-4f75-45fb-83e3-575be4bbebee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.771113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.771113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.771113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.771113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] PATH_INFO: `/v3/projects/4614501647ac42bd9f10f9e8256f7e9a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.772369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4614501647ac42bd9f10f9e8256f7e9a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.774679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.798079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.810017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.811672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.812551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.813252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.814813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.819375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.850888 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1108/2228] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:15.853484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:15.872620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29b0de-518b-45b5-bfe6-59b8b6f4d145 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:15.877616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:15.878299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.878574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.878840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] PATH_INFO: `/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.880974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d4fa85f0fc497f96bf3533a0b98c1f, user_id=8f7ae91cc1a34bfcab5a04fd57e8a2c2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:15.884195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f12891-0fc6-4d76-ac3f-1b41bba409df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:15.896817 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1109/2229] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:15 2022] PUT /identity/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:15.910349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac69b4b-68fa-4832-bb89-0777cd25632d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:15.910646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac69b4b-68fa-4832-bb89-0777cd25632d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:15.910945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac69b4b-68fa-4832-bb89-0777cd25632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:15.940977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9ac69b4b-68fa-4832-bb89-0777cd25632d None None] MFA Rules not processed for user `8f7ae91cc1a34bfcab5a04fd57e8a2c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:15.942186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ac69b4b-68fa-4832-bb89-0777cd25632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:15.988815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4614501647ac42bd9f10f9e8256f7e9a', 'request_id': 'req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:15.996999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4614501647ac42bd9f10f9e8256f7e9a', 'request_id': 'req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.033522 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1110/2230] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:16.045552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:16.045839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:16.046113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:16.072704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] MFA Rules not processed for user `fd9a2cf92b094c54bdce2e0bf8903af3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:16.073958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:16.117697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4614501647ac42bd9f10f9e8256f7e9a', 'request_id': 'req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.152268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] The token cache is being invalidate because project 4614501647ac42bd9f10f9e8256f7e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:16.152604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.155528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.161677 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1121/2231] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:15 2022] DELETE /identity/v3/projects/4614501647ac42bd9f10f9e8256f7e9a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:16.166436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:16.171716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:16.202225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1111/2232] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:16.209992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:16.306532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bfda-5ea2-4d36-ac9c-c758180feb76 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:16.314375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:16.315447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:16.316702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:16.317354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] PATH_INFO: `/v3/users/8bec84816c31434c910aecaadd180784` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:16.327022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bec84816c31434c910aecaadd180784)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:16.327022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:16.447066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:16.455120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:16.587320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d4ff-dacd-4c91-bd07-ed92f6c97f57 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:16.596955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:16.600880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:16.600880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:16.600880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:16.602714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:16.617763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:16.619934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:16.633952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1112/2233] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:16.787736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bec84816c31434c910aecaadd180784'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.934291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bec84816c31434c910aecaadd180784'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.958416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bec84816c31434c910aecaadd180784'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.959499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bec84816c31434c910aecaadd180784'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.960427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-682f50fc-411d-4378-a7cb-9650f509d246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bec84816c31434c910aecaadd180784'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:16.977841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1122/2234] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:16 2022] DELETE /identity/v3/users/8bec84816c31434c910aecaadd180784 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:17.212827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:17.739641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:18.183953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:18.204672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2226e-9a82-45ee-82a0-47be55dc892d service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:18.372392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:18.375898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:18.376191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:18.376457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] PATH_INFO: `/v3/projects/4bcace4cff73419496f326310091e2eb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:18.381923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcace4cff73419496f326310091e2eb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:18.386021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:18.670986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcace4cff73419496f326310091e2eb', 'request_id': 'req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:18.698776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcace4cff73419496f326310091e2eb', 'request_id': 'req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:18.718793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcace4cff73419496f326310091e2eb', 'request_id': 'req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:18.829551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] The token cache is being invalidate because project 4bcace4cff73419496f326310091e2eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:18.829912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:18.830654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3eb5d6a3-0a7f-4fd4-8786-076cd914ca61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:18.832504 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1113/2235] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:18 2022] DELETE /identity/v3/projects/4bcace4cff73419496f326310091e2eb => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:18.837995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:18.838689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:18.838981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:18.894503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:18.896434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:19.028716 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1123/2236] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:19.038419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.038698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.039650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.092952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:19.096806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:19.124708 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1114/2237] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:19.136277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:19.153413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a7090-ffcd-43f2-a375-8ba63923b7f0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:19.173258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:19.174963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.177682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.177682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.178146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:19.180042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:19.185042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:19.208046 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1124/2238] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:19.212357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:19.231027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f162ea-8094-4f96-b3a0-ed7097a4a4ae None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:19.235040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:19.235993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.236419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.237640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.238740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:19.241199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e26482-50e3-4372-a10d-da1ff8eb3543 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:19.412019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1115/2239] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:19 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:19.416398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:19.429341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d01fb3-4ba7-44d3-8508-07fffc4d4a37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:19.517650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:19.517650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.517650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.518825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.519335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:19.524788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:19.615928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.616340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.617009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.659822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] MFA Rules not processed for user `9379cc116a1e4896b7df09dcfa75eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:19.661441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:19.760465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1125/2240] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:19 2022] POST /identity/v3/users => generated 290 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:19.762340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:19.807414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fd748-e97d-4f9b-90eb-30140f8a57c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:19.839164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:19.839804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.840054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.840320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.841042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:19.842903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:19.879768 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1126/2241] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:19.880849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:19.885427 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1116/2242] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:19.911908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817fd75-4495-4271-a970-acefe2a946a6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:19.930043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:19.930660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:19.930941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:19.931206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:19.932010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:19.933707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be10992-eedf-44bc-aaf6-f12112efda86 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:19.973417 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1127/2243] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:19.974653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:20.039994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e44efc-c2bb-482c-a040-a0eef1e245bb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:20.060000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:20.061290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.067432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.067747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] PATH_INFO: `/v3/projects/95b6d74ac68341569ff25caa541cb079/users/6a087341c8e649e8af3902af139c9551/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.124871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b6d74ac68341569ff25caa541cb079, user_id=6a087341c8e649e8af3902af139c9551, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:20.132020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:20.185535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:20.268127 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1117/2244] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:19 2022] PUT /identity/v3/projects/95b6d74ac68341569ff25caa541cb079/users/6a087341c8e649e8af3902af139c9551/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:20.280810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.281339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.281896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.360815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] MFA Rules not processed for user `6a087341c8e649e8af3902af139c9551`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:20.362061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:20.556515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:20.558829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:20.589582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1128/2245] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:20.593660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:20.769759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464c3fe-a536-4874-a026-b8ad0aa6d75f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:20.781112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:20.781766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.782046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.782325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.783110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:20.784979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed286b-d0c1-40b6-af28-497ba97700b5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:20.785177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87a98b-271d-4cae-825a-9d1b3786007f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:20.791733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:20.792477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.792891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.793262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.796524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:20.812464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:20.814179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff3c63-7918-42ca-a6b0-c32e13ff0b15 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:20.825875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1118/2246] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:20.827744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.828134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.828646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:37:20.854732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:20.859720 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:37:20.866391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1119/2247] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:37:20.866391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:20.866391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:20.900657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d2f90-4e91-451e-b947-d71fbcf0c651 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:20.900657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:20.900657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:20.900657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:20.901475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:20.919984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:20.923541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:20.940587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1120/2248] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:20.963534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:20.965452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:20.999256 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1129/2249] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:20 2022] POST /identity/v3/projects => generated 379 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:21.017051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:21.020206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:21.025210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:21.074222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] MFA Rules not processed for user `9379cc116a1e4896b7df09dcfa75eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:21.081266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:21.118261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f8fa0c-513f-44c8-84eb-a877ac4cfcb4 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:21.187241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1130/2250] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:21.188704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:21.287552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:21.290491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:21.291015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:21.291826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:21.294636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:21.380650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:21.408755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4bdbe-f5eb-4239-aa43-a825899f602d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:21.444952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:21.451845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:21.452105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:21.452863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:21.454010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:21.456627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:21.485029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:21.488443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:21.516531 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1121/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:21.725690 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1131/2252] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:21 2022] POST /identity/v3/users => generated 296 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:21.743263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:21.760451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b049a-a758-4a88-b49b-a3717e32c217 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:21.774460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:21.775094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:21.775570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:21.775856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:21.776641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:21.779902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:21.826039 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1122/2253] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:21.830509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:21.850345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d08c1c-9d76-4c81-9f23-569e9bb3f3d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:21.860166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:21.860943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:21.861225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:21.861501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] PATH_INFO: `/v3/projects/db8dfe4992014ea8850773642bb50b55/users/dd3ccc5dbb0841e8b2b1f8732140fb99/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:21.902896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8dfe4992014ea8850773642bb50b55, user_id=dd3ccc5dbb0841e8b2b1f8732140fb99, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:21.906796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:22.064317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1132/2254] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:21 2022] PUT /identity/v3/projects/db8dfe4992014ea8850773642bb50b55/users/dd3ccc5dbb0841e8b2b1f8732140fb99/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:22.065154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:22.082742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad538d-e467-4533-a561-1acfab096137 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:22.187090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:22.255967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:22.256823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:22.257292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:22.258365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:22.259911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:22.264584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac20e4c-2094-41b2-ac3e-56fa37376dbc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:22.291925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1123/2255] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:22.296016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:22.330321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7f365-c828-4f06-8688-e002b856259e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:22.347601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:22.348578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:22.349110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:22.349724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] PATH_INFO: `/v3/projects/db8dfe4992014ea8850773642bb50b55/users/dd3ccc5dbb0841e8b2b1f8732140fb99/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:22.370509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8dfe4992014ea8850773642bb50b55, user_id=dd3ccc5dbb0841e8b2b1f8732140fb99, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:22.381200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:22.405721 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1133/2256] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:22 2022] PUT /identity/v3/projects/db8dfe4992014ea8850773642bb50b55/users/dd3ccc5dbb0841e8b2b1f8732140fb99/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:22.417827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:22.417996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:22.418301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:22.499147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] MFA Rules not processed for user `dd3ccc5dbb0841e8b2b1f8732140fb99`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:22.505319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:22.693665 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1124/2257] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:22.974791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:22.978551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:23.117474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b56cf-bb0f-4a58-ac96-94e0b2e48c9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:23.124628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:23.125122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:23.125514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:23.125784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:23.137886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:23.140531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3669c8-1351-466b-bb13-a85d4258d4f1 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:23.157645 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1134/2258] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:24.088634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:24.319951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853232-ee92-4de8-8d01-b640d4a82ff1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:24.339371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:24.340450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:24.345947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:24.346344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] PATH_INFO: `/v3/users/6a087341c8e649e8af3902af139c9551` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:24.355585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a087341c8e649e8af3902af139c9551)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:24.362501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:24.963071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a087341c8e649e8af3902af139c9551'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:25.140063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a087341c8e649e8af3902af139c9551'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:25.187574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a087341c8e649e8af3902af139c9551'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:25.229876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a087341c8e649e8af3902af139c9551'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:25.240754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a087341c8e649e8af3902af139c9551'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:25.260863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1125/2259] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:24 2022] DELETE /identity/v3/users/6a087341c8e649e8af3902af139c9551 => generated 0 bytes in 1173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:25.268257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:25.269765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:25.277344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:25.321029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:25.325610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:25.723994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1135/2260] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:25.764538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:26.174753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:26.177793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:26.449673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf27ec0-3e92-44f6-91e2-11825e47fd44 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:26.457168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:26.460256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:26.461325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:26.462215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:26.483550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:26.485602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:26.488726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:26.516995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1126/2261] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:27.231078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:28.734481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:29.545378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:30.535108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:30.585796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:31.142894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:31.142894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:31.168225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76161f64-9f5d-46e1-9988-7d8cd936bef9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:31.182895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:31.185252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:31.186603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:31.187522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] PATH_INFO: `/v3/users/bbede44ae7194b4e97bc67e0dc8207b3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:31.197575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbede44ae7194b4e97bc67e0dc8207b3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:31.201957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:31.502165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:31.505188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:31.583089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63979ca5-fa4c-4f4d-8541-4f9829d59b78 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:31.596273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbede44ae7194b4e97bc67e0dc8207b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:31.613569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:31.615509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:31.617179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:31.621169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] PATH_INFO: `/v3/projects/95b6d74ac68341569ff25caa541cb079` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:31.628127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b6d74ac68341569ff25caa541cb079)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:31.640008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:31.828457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbede44ae7194b4e97bc67e0dc8207b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:31.873433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbede44ae7194b4e97bc67e0dc8207b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:31.875190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbede44ae7194b4e97bc67e0dc8207b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:31.877170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9883ea42-9f02-4d80-b184-92cca7cab16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbede44ae7194b4e97bc67e0dc8207b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:31.954796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1136/2262] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:31 2022] DELETE /identity/v3/users/bbede44ae7194b4e97bc67e0dc8207b3 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:31.957598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:31.958076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:31.958572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:31.986560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b6d74ac68341569ff25caa541cb079', 'request_id': 'req-7d197d31-b14e-4120-87d9-e1278054b31b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:32.013008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b6d74ac68341569ff25caa541cb079', 'request_id': 'req-7d197d31-b14e-4120-87d9-e1278054b31b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:32.037787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b6d74ac68341569ff25caa541cb079', 'request_id': 'req-7d197d31-b14e-4120-87d9-e1278054b31b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:32.077445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] MFA Rules not processed for user `d8552963e6944dbebe1ab05cf249a4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:32.079116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:32.202077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] The token cache is being invalidate because project 95b6d74ac68341569ff25caa541cb079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:32.203568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:32.205845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d197d31-b14e-4120-87d9-e1278054b31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:32.220813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1127/2263] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:31 2022] DELETE /identity/v3/projects/95b6d74ac68341569ff25caa541cb079 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:32.229027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:32.231542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:32.232373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:32.327452 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1137/2264] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:32.329692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:32.334729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:32.343727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:32.352029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:32.728856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126db42c-d4ee-41d0-8ef3-7a32a71fa079 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:32.743530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1128/2265] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:32.745753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:32.753422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:32.753605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:32.754813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:32.755384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:32.755773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] PATH_INFO: `/v3/users/dd3ccc5dbb0841e8b2b1f8732140fb99` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:32.759068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3ccc5dbb0841e8b2b1f8732140fb99)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:32.770685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:32.812678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032722c5-f393-4e3d-b7c7-6a3142f89b76 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:32.818910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:32.820232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:32.820648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:32.821057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:32.834972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:32.837767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:33.120897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1129/2266] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:32 2022] POST /identity/v3/projects => generated 401 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:33.124525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:33.139309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:33.160279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3ccc5dbb0841e8b2b1f8732140fb99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:33.309117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3ccc5dbb0841e8b2b1f8732140fb99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:33.342556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3ccc5dbb0841e8b2b1f8732140fb99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:33.348440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac986a4-2bcf-4572-9773-8b084a864f6b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:33.349763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3ccc5dbb0841e8b2b1f8732140fb99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:33.351979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3ccc5dbb0841e8b2b1f8732140fb99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:33.356385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:33.360110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:33.361484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:33.362242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:33.368553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:33.385251 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1138/2267] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:32 2022] DELETE /identity/v3/users/dd3ccc5dbb0841e8b2b1f8732140fb99 => generated 0 bytes in 1057 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:33.391831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:33.397132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:33.532814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b5746-456d-4dc2-a6d1-84ea3473b74e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:33.539246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:33.539872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:33.540146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:33.540409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:33.541178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:33.543375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:33.574332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.700308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:33.700759 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1139/2268] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:33 2022] POST /identity/v3/users => generated 307 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:33.703963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:33.706084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:33.736045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668e9f4-ceec-45f7-a251-1094237d37a0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:33.753446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:33.754642 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1130/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:33.755353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:33.755502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:33.755762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:33.761123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:33.771527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:33.803598 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1140/2270] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:33.805561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:33.840126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9be477-9edc-4fa9-988f-d4cf06f7dd65 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:33.845824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:33.846587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:33.846898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:33.847735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] PATH_INFO: `/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb/users/8287611a77514fcfb28fb30ec7b08f13/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:33.878927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f204e1d6ec04e3eb9513cecc5f951eb, user_id=8287611a77514fcfb28fb30ec7b08f13, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:33.882647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:34.016404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:34.024586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1131/2271] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:33 2022] PUT /identity/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb/users/8287611a77514fcfb28fb30ec7b08f13/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:34.053068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545c1fd-ff32-40e4-9fd7-bffef11b6441 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:34.270101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:34.272117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:34.273104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:34.273601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:34.275396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:34.278310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:34.297756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1141/2272] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:34.302526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:34.332668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:34.335082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:34.356523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef592c1-5ee8-4ba6-94c9-b206a72d3032 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:34.392117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:34.397254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:34.404715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:34.405270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] PATH_INFO: `/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb/users/8287611a77514fcfb28fb30ec7b08f13/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:34.408460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f204e1d6ec04e3eb9513cecc5f951eb, user_id=8287611a77514fcfb28fb30ec7b08f13, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:34.415737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:34.455857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1132/2273] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:34 2022] PUT /identity/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb/users/8287611a77514fcfb28fb30ec7b08f13/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:34.518922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:34.521595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:34.587872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab33ef-3292-4ff9-8e40-9ebe72534bd3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:34.761057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a155f3b-c35e-44ab-aa02-99816be6ec35 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:34.787410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:34.787410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:34.787410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:34.787410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] PATH_INFO: `/v3/projects/b94df274ea1b4a2387fa8a717cb3ca3b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:34.788141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94df274ea1b4a2387fa8a717cb3ca3b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:34.794325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:34.896921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:34.902682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:34.904209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:34.904728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:34.905268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:34.910062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:34.947935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:34.981954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:35.026113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1142/2274] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:35.033825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:35.040283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:35.078273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'request_id': 'req-121d7af6-d150-4e62-b05f-4657b7baf350'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.097507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'request_id': 'req-121d7af6-d150-4e62-b05f-4657b7baf350'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.125380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785416e5-3564-4c3f-957e-750bbc9f2119 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:35.125522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'request_id': 'req-121d7af6-d150-4e62-b05f-4657b7baf350'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.340953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:35.341693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:35.346177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:35.346177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] PATH_INFO: `/v3/projects/db8dfe4992014ea8850773642bb50b55` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:35.346177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8dfe4992014ea8850773642bb50b55)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:35.354454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:35.384310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] The token cache is being invalidate because project b94df274ea1b4a2387fa8a717cb3ca3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:35.387333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.390162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.397728 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1133/2275] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:34 2022] DELETE /identity/v3/projects/b94df274ea1b4a2387fa8a717cb3ca3b => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:35.404229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:35.406237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:35.449544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d7af6-d150-4e62-b05f-4657b7baf350 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:35.474343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:35.475189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:35.475684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:35.476426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] PATH_INFO: `/v3/users/5439f28d6fa34298af69d396bdcbf41d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:35.479055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5439f28d6fa34298af69d396bdcbf41d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:35.487250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:35.695367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8dfe4992014ea8850773642bb50b55', 'request_id': 'req-5760a22a-0111-41c3-835e-f3db0c23e91d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.745728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8dfe4992014ea8850773642bb50b55', 'request_id': 'req-5760a22a-0111-41c3-835e-f3db0c23e91d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.848292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8dfe4992014ea8850773642bb50b55', 'request_id': 'req-5760a22a-0111-41c3-835e-f3db0c23e91d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.918143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] The token cache is being invalidate because project db8dfe4992014ea8850773642bb50b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:35.918143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.926775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5760a22a-0111-41c3-835e-f3db0c23e91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.940877 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1143/2276] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:35 2022] DELETE /identity/v3/projects/db8dfe4992014ea8850773642bb50b55 => generated 0 bytes in 914 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:35.942980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5439f28d6fa34298af69d396bdcbf41d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:35.948857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:35.951670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:35.957393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:36.024796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5439f28d6fa34298af69d396bdcbf41d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:36.046857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5439f28d6fa34298af69d396bdcbf41d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:36.055349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:36.058144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:36.062421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5439f28d6fa34298af69d396bdcbf41d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:36.066597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2cda8a7-0475-4f79-a434-d1d286a50024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5439f28d6fa34298af69d396bdcbf41d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:36.084621 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1134/2277] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:35 2022] DELETE /identity/v3/users/5439f28d6fa34298af69d396bdcbf41d => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:36.400309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1144/2278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:36.409595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:36.409873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:36.410171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:36.477003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:36.477003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:36.617297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1135/2279] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:36.620003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:36.688758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2c234-f20e-4566-94bc-a6753ca6198a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:36.710625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:36.722032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:36.747354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1145/2280] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:36.757030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:36.800000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f1bfe-08b2-4f39-b07b-d27381c877a4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:36.847181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:36.850144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:36.860691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:36.863360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:36.872818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:36.889851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:37.028522 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1136/2281] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:37.041229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:37.092583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:37.104717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851be1d-5568-4503-9ba1-70fea5555184 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:37.129842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:37.422526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:37.423851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:37.424622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:37.425284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:37.426618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:37.433211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:37.609656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1146/2282] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:37 2022] POST /identity/v3/users => generated 290 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:37.613497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:37.621562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:37.627995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:37.630535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f949a-7c20-429d-8f3e-d9a846035c14 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:37.659792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:37.660424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:37.660775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:37.661045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:37.661697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:37.664047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:37.710911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809989f4-692a-4b32-b6d1-1278279a693c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:37.723545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:37.724341 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1137/2283] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:37.731577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:37.732000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:37.732800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:37.733596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] PATH_INFO: `/v3/projects/50acc6150881430ebd7e9400b1646a4a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:37.736458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50acc6150881430ebd7e9400b1646a4a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:37.739448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:37.774862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600fead-8e5e-4a94-9bf5-103b400d297f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:37.803745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:37.804771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:37.805200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:37.805868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:37.807219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:37.820801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:37.837519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:37.861019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1138/2284] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:37.865989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:37.909909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4fba3b-aece-4636-9a8a-ddeac29c2440 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:37.925674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:37.933797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:37.935416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:37.935416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] PATH_INFO: `/v3/projects/352817a3262a480a8893d59d31132aa2/users/b477bc979a5543cda192677334bf0ca6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:38.016448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=352817a3262a480a8893d59d31132aa2, user_id=b477bc979a5543cda192677334bf0ca6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:38.026105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d58756-fb15-442d-a6cd-636e3614ad63 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:38.045301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50acc6150881430ebd7e9400b1646a4a', 'request_id': 'req-83799545-5a53-43e0-83c6-4c293e507f65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:38.076030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50acc6150881430ebd7e9400b1646a4a', 'request_id': 'req-83799545-5a53-43e0-83c6-4c293e507f65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:38.165717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1139/2285] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:37 2022] PUT /identity/v3/projects/352817a3262a480a8893d59d31132aa2/users/b477bc979a5543cda192677334bf0ca6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:38.177717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd261-5c76-46bc-a09e-b4df73085205 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:38.178261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd261-5c76-46bc-a09e-b4df73085205 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:38.179290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fd261-5c76-46bc-a09e-b4df73085205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:38.190512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50acc6150881430ebd7e9400b1646a4a', 'request_id': 'req-83799545-5a53-43e0-83c6-4c293e507f65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:38.237065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] The token cache is being invalidate because project 50acc6150881430ebd7e9400b1646a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:38.237851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:38.239192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83799545-5a53-43e0-83c6-4c293e507f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:38.241211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a52fd261-5c76-46bc-a09e-b4df73085205 None None] MFA Rules not processed for user `b477bc979a5543cda192677334bf0ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:38.243219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a52fd261-5c76-46bc-a09e-b4df73085205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:38.257335 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1147/2286] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:37 2022] DELETE /identity/v3/projects/50acc6150881430ebd7e9400b1646a4a => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:38.269688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:38.277651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:38.278853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:38.381340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] MFA Rules not processed for user `fa2b6dc15a41463d86d252948b613f48`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:38.384324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:38.396353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:38.557102 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1140/2287] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:38.558901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:38.561713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:38.562348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:38.611513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:38.613269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:38.681908 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1148/2288] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:38.683186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:38.691192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:38.955258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8f242-4b53-4359-94df-a52581a5db13 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:38.962726 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1141/2289] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:38.963988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:38.978636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:38.986193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:38.987071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:38.990686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:38.991608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:38.992327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:38.994455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9aedf-b26f-4315-a104-94347dcb91c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:39.166504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55127af2-cf82-4afc-aee8-a24502d7d13f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:39.175448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:39.176156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.176543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.176821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.186036 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1149/2290] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:38 2022] POST /identity/v3/projects => generated 383 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:39.188567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.189084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.189650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.208998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:39.216266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:39.241902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:39.242353 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1142/2291] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:39.243485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:39.244042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:39.271707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce927f-9b38-400a-8ce9-858abd6c3a51 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:39.421620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1150/2292] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:39.426532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:39.457408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee79d61-48a8-4353-8dd6-9b89ac5f869f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:39.469335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:39.470149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.470259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.470559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.472251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:39.473220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.477833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:39.477993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.477993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.478729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:39.479244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:39.482057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:39.485580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:39.519580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1151/2293] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:39.528057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:39.570648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b206e30-44e4-4b9a-953f-12bcc1eae71a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:39.587351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:39.591395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.594351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.594764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.598638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:39.611859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:39.746597 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1143/2294] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:39 2022] POST /identity/v3/users => generated 298 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:39.750478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:39.773493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:39.784057 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1152/2295] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:39 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:39.789669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3750ba-04b4-43c9-943d-89aa9dc49ec8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:39.790329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:39.968000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:39.969412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:39.971294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:39.971294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:39.972809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:39.976243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.000149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1144/2296] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:40.001454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.027363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ded51-5754-4935-a266-b7a0f16669f5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.030932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf24622-a22e-4555-97ec-e64a72ce98e5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.045801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.046750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.047674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.047802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.049731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.050092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] PATH_INFO: `/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f/users/1c3631b4bfe94ab6b649cc5222cd4365/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.052442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.052880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.055345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.061313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.098790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f76eda3f1ad4075b43c59dcdd59679f, user_id=1c3631b4bfe94ab6b649cc5222cd4365, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.103784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.239635 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1153/2297] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:39 2022] POST /identity/v3/users => generated 290 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:37:40.243566 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1145/2298] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:40 2022] PUT /identity/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f/users/1c3631b4bfe94ab6b649cc5222cd4365/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:40.247534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.248851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.254501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:40.303160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a167b-7384-49a8-badd-60013c07e0b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.483173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.483896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.484176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.484443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.485608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.487500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.515728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148c6de-cca0-41aa-877e-4f15b8d43a8f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.529811 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1154/2299] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:40.536385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.538961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.539597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.539879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.540247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.542100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.545058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.573877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23a3a2-8968-4632-8683-9666efa000f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.575344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1146/2300] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:40.579620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.602476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.603439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.603888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.604309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] PATH_INFO: `/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f/users/1c3631b4bfe94ab6b649cc5222cd4365/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.610877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f76eda3f1ad4075b43c59dcdd59679f, user_id=1c3631b4bfe94ab6b649cc5222cd4365, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.620739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f590f550-2033-4b90-b5be-94c78dd9bbfb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.621718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6405c0-4818-4f65-ab5d-3d0b5eaee97e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.660735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1155/2301] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:40 2022] PUT /identity/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f/users/1c3631b4bfe94ab6b649cc5222cd4365/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:40.773861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b6a7-eafa-45fd-9928-a2258fea5b11 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.774487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b6a7-eafa-45fd-9928-a2258fea5b11 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.774961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908b6a7-eafa-45fd-9928-a2258fea5b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.806904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.807799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.808084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.808356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.809049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.810685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:40.825579 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1147/2302] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:37:40.831146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:40.852799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cbbd0-a937-4348-be10-c6c8dbf888de admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:40.853684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c908b6a7-eafa-45fd-9928-a2258fea5b11 None None] MFA Rules not processed for user `1c3631b4bfe94ab6b649cc5222cd4365`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:40.857025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c908b6a7-eafa-45fd-9928-a2258fea5b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:40.862821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:40.862821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:40.862821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:40.862821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] PATH_INFO: `/v3/projects/a2dcc600abea496b91b87b0b2b8364d9/users/b573bd1cba424377adcd053a1d27a833/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:40.886479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2dcc600abea496b91b87b0b2b8364d9, user_id=b573bd1cba424377adcd053a1d27a833, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:40.891938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:41.111138 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1156/2303] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:41.372557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1148/2304] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:40 2022] PUT /identity/v3/projects/a2dcc600abea496b91b87b0b2b8364d9/users/b573bd1cba424377adcd053a1d27a833/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:37:41.383622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:41.384618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:41.385066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:41.449787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] MFA Rules not processed for user `b573bd1cba424377adcd053a1d27a833`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:41.457188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:41.682088 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1157/2305] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:42.002860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:42.005244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:42.197421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:42.285379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc65d-b412-4d68-b1ae-ec6610c1164f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:42.297280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:42.297646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:42.298151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:42.298624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:42.426895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:42.430940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:42.474346 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1149/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:42.612420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:42.635979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38bf71-c1d3-403c-a2ec-457ed6b08388 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:42.649318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:42.652180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:42.652898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:42.654753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:42.664701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:42.680532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:42.683536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ca9a9-f7e8-4945-b32b-a9e9fdd6b8c9 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:42.695362 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1158/2307] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:43.279397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:43.406840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d14f0-6b09-4153-af87-6dfaca906416 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:43.407721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d14f0-6b09-4153-af87-6dfaca906416 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:43.407721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d14f0-6b09-4153-af87-6dfaca906416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:43.432242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d10fcd-5dd8-4554-88f3-7b4a60f14111 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:43.440829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:43.442676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:43.442676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:43.442676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] PATH_INFO: `/v3/users/b477bc979a5543cda192677334bf0ca6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:43.446659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b477bc979a5543cda192677334bf0ca6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:43.452258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:43.465549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4c3d14f0-6b09-4153-af87-6dfaca906416 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:43.472856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4c3d14f0-6b09-4153-af87-6dfaca906416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:43.671496 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1159/2308] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 02 12:37:43.741657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b477bc979a5543cda192677334bf0ca6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:43.847012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b477bc979a5543cda192677334bf0ca6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:43.889899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b477bc979a5543cda192677334bf0ca6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:43.941288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b477bc979a5543cda192677334bf0ca6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:43.943906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b477bc979a5543cda192677334bf0ca6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:43.969462 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1150/2309] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:43 2022] DELETE /identity/v3/users/b477bc979a5543cda192677334bf0ca6 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:43.974198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:43.974735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:43.976350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:44.031450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:44.036955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:44.096691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:44.097112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:44.204528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:44.269090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:44.452834 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1160/2310] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:44.474107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:44.479527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:44.503808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd9c46-13d3-4548-a6ca-e1842211523d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:44.540242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:44.541250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:44.541722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:44.542085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:44.554295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:44.659288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517a523-8031-4dfd-9b4a-319d77043dc3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:44.665132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:44.666489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:44.666943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:44.667392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:44.698815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:44.707743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a9784-fc62-4cea-90ff-d30a178d5db9 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:44.743272 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1161/2311] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:44.749141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:44.752195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:44.781285 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1151/2312] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:45.144806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:45.209351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b4ef-1ebf-44f0-9056-72d38338a531 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:45.209608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b4ef-1ebf-44f0-9056-72d38338a531 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:45.209852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d460b4ef-1ebf-44f0-9056-72d38338a531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:45.275169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d460b4ef-1ebf-44f0-9056-72d38338a531 None None] MFA Rules not processed for user `b573bd1cba424377adcd053a1d27a833`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:45.291288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:45.304743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d460b4ef-1ebf-44f0-9056-72d38338a531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:45.478091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1162/2313] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:45.818169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:45.819737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:45.856459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7ecd6-79ca-424b-80b5-873ddbaf2ce1 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:45.883922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:45.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:45.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:45.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] PATH_INFO: `/v3/projects/352817a3262a480a8893d59d31132aa2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:45.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352817a3262a480a8893d59d31132aa2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:45.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:46.434745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:46.435352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:46.435530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:46.469132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:46.471391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:46.490670 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1163/2314] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:37:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:46.523036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:46.549929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d31c8e-a9a8-4d21-8a54-de58a032e672 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:46.567346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:46.570426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:46.570934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:46.575229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:46.602093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:46.603766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:46.619437 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1164/2315] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:37:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:46.846839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352817a3262a480a8893d59d31132aa2', 'request_id': 'req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:46.857672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352817a3262a480a8893d59d31132aa2', 'request_id': 'req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:46.863979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352817a3262a480a8893d59d31132aa2', 'request_id': 'req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.109964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] The token cache is being invalidate because project 352817a3262a480a8893d59d31132aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:47.110263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.115832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.120526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1152/2316] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:45 2022] DELETE /identity/v3/projects/352817a3262a480a8893d59d31132aa2 => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:47.124643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:47.133132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:47.139522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d432-da8b-4780-9417-4d65e9d1a258 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:47.244319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:47.244844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:47.245301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:47.245587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] PATH_INFO: `/v3/users/1c3631b4bfe94ab6b649cc5222cd4365` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:47.247736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3631b4bfe94ab6b649cc5222cd4365)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:47.250060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:47.685022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3631b4bfe94ab6b649cc5222cd4365'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.692659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:47.695311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:47.754491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f5ed-bb6f-48a2-ac10-c07fb52eb883 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:47.775842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:47.781314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:47.781314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:47.781314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] PATH_INFO: `/v3/users/b573bd1cba424377adcd053a1d27a833` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:47.781314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b573bd1cba424377adcd053a1d27a833)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:47.791030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:47.834018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3631b4bfe94ab6b649cc5222cd4365'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.858767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3631b4bfe94ab6b649cc5222cd4365'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.860419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3631b4bfe94ab6b649cc5222cd4365'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.862779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62ee174a-4e1d-4e6f-a2cd-98bb0f820050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3631b4bfe94ab6b649cc5222cd4365'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:47.893716 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1165/2317] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:47 2022] DELETE /identity/v3/users/1c3631b4bfe94ab6b649cc5222cd4365 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:48.177673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b573bd1cba424377adcd053a1d27a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:48.307883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b573bd1cba424377adcd053a1d27a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:48.332398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b573bd1cba424377adcd053a1d27a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:48.348135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b573bd1cba424377adcd053a1d27a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:48.353335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b573bd1cba424377adcd053a1d27a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:48.366365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1153/2318] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:47 2022] DELETE /identity/v3/users/b573bd1cba424377adcd053a1d27a833 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:48.372421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.372739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.373112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.416158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:48.418137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:48.577374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1166/2319] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:48.642753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:48.642753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:48.719789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:48.802910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d78a05-9805-4ec7-aa81-fa0d8ce699f1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:48.807785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:48.809040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:48.809760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:48.810515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:48.832075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:48.834174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92677a6e-2a54-432f-8a6c-1de52df168eb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:48.856619 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1154/2320] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:49.218772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:49.219231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:49.235749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18912f6-e61c-4199-9a57-8d29462db175 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:49.242293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:49.243228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:49.243687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:49.244391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] PATH_INFO: `/v3/users/976993a09f2342c68dab07da6a7dd236` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:49.246110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976993a09f2342c68dab07da6a7dd236)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:49.248713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:49.322820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:49.323904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:49.324417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:49.374405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:49.401539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] MFA Rules not processed for user `8287611a77514fcfb28fb30ec7b08f13`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:49.402815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:49.596777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976993a09f2342c68dab07da6a7dd236'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.620557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1155/2321] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:49 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:49.622380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:49.626968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:49.676001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76320de2-96df-4fa9-9efc-4c7f099716f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:49.684470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976993a09f2342c68dab07da6a7dd236'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.693526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:49.699192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:49.700815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:49.701496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] PATH_INFO: `/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:49.705985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f76eda3f1ad4075b43c59dcdd59679f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:49.707121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976993a09f2342c68dab07da6a7dd236'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.707872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976993a09f2342c68dab07da6a7dd236'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.711302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-acc881e1-b170-4ffd-ab5b-a4153651aca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976993a09f2342c68dab07da6a7dd236'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.713412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:49.737190 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1167/2322] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:49 2022] DELETE /identity/v3/users/976993a09f2342c68dab07da6a7dd236 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:49.741541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:49.742048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:49.742579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:49.777704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:49.781299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:49.834133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:49.976078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1168/2323] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:37:49.994682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f76eda3f1ad4075b43c59dcdd59679f', 'request_id': 'req-01444aa1-3621-4c4b-aa43-b79073c636f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:49.998569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:50.000429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:50.029003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f76eda3f1ad4075b43c59dcdd59679f', 'request_id': 'req-01444aa1-3621-4c4b-aa43-b79073c636f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.056924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f76eda3f1ad4075b43c59dcdd59679f', 'request_id': 'req-01444aa1-3621-4c4b-aa43-b79073c636f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.158343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766c8e3-7ca3-407c-986a-78730482a593 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:50.179492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] The token cache is being invalidate because project 5f76eda3f1ad4075b43c59dcdd59679f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:50.179709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.180681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01444aa1-3621-4c4b-aa43-b79073c636f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.183153 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1156/2324] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:49 2022] DELETE /identity/v3/projects/5f76eda3f1ad4075b43c59dcdd59679f => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:50.189404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916deb4-59fe-482b-ab00-43fbd539a6c5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.190324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916deb4-59fe-482b-ab00-43fbd539a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.198945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916deb4-59fe-482b-ab00-43fbd539a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.238677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3916deb4-59fe-482b-ab00-43fbd539a6c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:50.240644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3916deb4-59fe-482b-ab00-43fbd539a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:50.311935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:50.343896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.344292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.344582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.358021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:50.442014 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1157/2325] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:50.454046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.455155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.455439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.501910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:50.503777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:50.511087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:50.520461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:50.520620 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1158/2326] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:50.524959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:50.544764 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1169/2327] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:50.559747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d2ae4f-2c8b-4ee2-827f-fe7cf49e0c84 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:50.565940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:50.567328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.568748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.573010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.577148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:50.577463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:50.585874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:50.610414 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1159/2328] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:50.614630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:50.627242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dcc49-37eb-4d35-8a9a-0b3a6c054e48 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:50.635336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:50.637193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.637479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.637756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.639815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:50.642134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:50.684994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:50.687090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:50.721016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58541c5e-4ab6-47f3-92da-61bd80746fdd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:50.747402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:50.748422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:50.748929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:50.749390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] PATH_INFO: `/v3/projects/a2dcc600abea496b91b87b0b2b8364d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:50.751549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2dcc600abea496b91b87b0b2b8364d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:50.755321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:50.776979 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1170/2329] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:50 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:50.778800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:50.890440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:50.895708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd8bf5-4f73-4821-af5b-94a640766a2c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:50.919912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2dcc600abea496b91b87b0b2b8364d9', 'request_id': 'req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.938515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2dcc600abea496b91b87b0b2b8364d9', 'request_id': 'req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:50.955584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2dcc600abea496b91b87b0b2b8364d9', 'request_id': 'req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.002986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.004064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.004515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.004928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.007539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.010932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.427727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] The token cache is being invalidate because project a2dcc600abea496b91b87b0b2b8364d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:51.428512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.429379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06bfa346-85ba-4d1d-ae92-74d2489bdb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.432805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1160/2330] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:50 2022] DELETE /identity/v3/projects/a2dcc600abea496b91b87b0b2b8364d9 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:51.440477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.441051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.441755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.464624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1171/2331] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:50 2022] POST /identity/v3/users => generated 293 bytes in 686 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:51.479501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.481321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.524753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2076a-7ebb-4a0a-ab48-c89e1522269d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.524914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:51.528440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.534159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.534834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.535089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.535359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] PATH_INFO: `/v3/projects/9929679b00cb4db39002b1ae432a2539` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.536543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9929679b00cb4db39002b1ae432a2539)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.540183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.551344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1161/2332] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:51.559133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.559133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.599872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc412-f203-4bb4-b146-2ae23f2381a7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.605466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.606088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.606360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.606627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.607268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.609181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4699e27-282b-4085-8e8e-0b92f39f4ad0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.641005 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1162/2333] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:51.642424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.642701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.642966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.670696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:51.672296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.697337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1163/2334] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:51.702167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.732237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6372c-48a6-4ee1-88a4-37c3b669d192 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.751916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9929679b00cb4db39002b1ae432a2539', 'request_id': 'req-65db2037-811d-462b-80d7-5ff44ce2796d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.761205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9929679b00cb4db39002b1ae432a2539', 'request_id': 'req-65db2037-811d-462b-80d7-5ff44ce2796d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.858465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9929679b00cb4db39002b1ae432a2539', 'request_id': 'req-65db2037-811d-462b-80d7-5ff44ce2796d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.875984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] The token cache is being invalidate because project 9929679b00cb4db39002b1ae432a2539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:51.876279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.877331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:51.886876 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1172/2335] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:51 2022] DELETE /identity/v3/projects/9929679b00cb4db39002b1ae432a2539 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:51.887495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.889498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.890541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.892282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.892974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.893736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:51.895188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:51.915325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:51.951289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2037-811d-462b-80d7-5ff44ce2796d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.951454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1164/2336] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:51.952751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:51.957883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:51.980802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa723-074e-49d7-9a5b-9788705db2ed admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:51.993055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:51.995305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:51.996725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:51.997033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] PATH_INFO: `/v3/users/1f30f86e527d484fa6f592b13e4c081d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.001047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f30f86e527d484fa6f592b13e4c081d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:52.007282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:52.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:52.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:52.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:52.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:52.011835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:52.011929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:52.060735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1173/2337] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:52.063927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:52.071394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:52.090603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90f304-c263-4459-bb4b-11124ee1e5cd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:52.102647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:52.105171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:52.105503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:52.105787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] PATH_INFO: `/v3/projects/6d92c49ad87f434b9902de8857fe3932/users/0b6b9dc060de4551a67208d0f0482b60/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.139842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d92c49ad87f434b9902de8857fe3932, user_id=0b6b9dc060de4551a67208d0f0482b60, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:52.150097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:52.303995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f30f86e527d484fa6f592b13e4c081d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:52.433599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f30f86e527d484fa6f592b13e4c081d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:52.443663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1174/2338] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:52 2022] PUT /identity/v3/projects/6d92c49ad87f434b9902de8857fe3932/users/0b6b9dc060de4551a67208d0f0482b60/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:52.454295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:52.467406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f30f86e527d484fa6f592b13e4c081d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:52.493784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f30f86e527d484fa6f592b13e4c081d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:52.495172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14ba36a0-8f11-454f-8686-ea16ff78b0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f30f86e527d484fa6f592b13e4c081d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:52.506796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1165/2339] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:51 2022] DELETE /identity/v3/users/1f30f86e527d484fa6f592b13e4c081d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:52.509466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add525-dc31-4004-b301-b7975554ef95 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:52.509466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add525-dc31-4004-b301-b7975554ef95 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:52.521573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82add525-dc31-4004-b301-b7975554ef95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.575694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-82add525-dc31-4004-b301-b7975554ef95 None None] MFA Rules not processed for user `0b6b9dc060de4551a67208d0f0482b60`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:52.577594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82add525-dc31-4004-b301-b7975554ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:52.640802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:52.660736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae41f3f-3e5d-45de-b593-00c1c4a1b8c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:52.749276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1166/2340] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:52.753324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82add525-dc31-4004-b301-b7975554ef95 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:52.755367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82add525-dc31-4004-b301-b7975554ef95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:52.757701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:52.819987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:52.820988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:52.821275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:52.821544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.822196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:52.827163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:52.913655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82add525-dc31-4004-b301-b7975554ef95 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:52.928748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:52.929526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:52.930171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:52.930297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:52.931038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:52.937338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:52.955640 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1175/2341] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:52 2022] POST /identity/v3/projects => generated 413 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:52.961659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:52.963600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:53.117483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1167/2342] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:52 2022] POST /identity/v3/projects => generated 385 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:53.118649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.169011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585f761-d3c1-4574-b262-aab6eff64a03 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.278264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bd96-f0fc-4a08-bcbb-99467517c434 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.296080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.296787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.297093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.297372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.298021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.300258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:53.354800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.355740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.360266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.363831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.363831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.368357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:53.517340 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1168/2343] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:53 2022] POST /identity/v3/users => generated 299 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:53.517340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.523654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:53.548561 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1176/2344] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:52 2022] POST /identity/v3/users => generated 307 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:53.551736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.578322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02ea97-840d-4d1d-838e-bed64aeb065a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.606306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.607080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.607434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.607713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.608537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.619021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:53.669439 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1177/2345] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:53.671615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.710139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba076c-acea-4061-a583-1ffa83d22417 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.746256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8f907-d24c-42f8-b11a-79ff72c71c0c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.747813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.750078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.758460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.759115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.767671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.771206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:53.780353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.781091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.781374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.781652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.790410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:53.837127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1178/2346] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:53.838392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:53.851905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:53.898656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:53.903643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe2d1-e40b-47fc-b79c-a8d3745294db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:53.917380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:53.918297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:53.918798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:53.921703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] PATH_INFO: `/v3/projects/2046c3ec9ae24830ac6194791d986f0d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:53.925601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2046c3ec9ae24830ac6194791d986f0d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.933887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:53.953309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:53.958722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.017589 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1169/2347] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:54.018613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.043991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4e164-a899-4891-8869-dabe83b72125 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.081567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.083072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.083422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.083788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] PATH_INFO: `/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a/users/5759fc38ced94552bd35852b527eadad/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.129329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5bd0f588b0b4f8482b4bbe9473d080a, user_id=5759fc38ced94552bd35852b527eadad, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.135507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.154838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:54.272077 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1170/2348] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:54 2022] PUT /identity/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a/users/5759fc38ced94552bd35852b527eadad/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:54.274537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.293209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2046c3ec9ae24830ac6194791d986f0d', 'request_id': 'req-f259d625-c7a5-4aef-b3b3-b511ac0894cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:54.308845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2046c3ec9ae24830ac6194791d986f0d', 'request_id': 'req-f259d625-c7a5-4aef-b3b3-b511ac0894cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:54.433878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2046c3ec9ae24830ac6194791d986f0d', 'request_id': 'req-f259d625-c7a5-4aef-b3b3-b511ac0894cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:54.458152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] The token cache is being invalidate because project 2046c3ec9ae24830ac6194791d986f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:37:54.458152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:54.459584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f259d625-c7a5-4aef-b3b3-b511ac0894cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:37:54.464697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1179/2349] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:37:53 2022] DELETE /identity/v3/projects/2046c3ec9ae24830ac6194791d986f0d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:54.490248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e51da-f77d-433f-9cc5-c826f00e83f8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.490619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.492531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.498419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.526232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.527222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.528250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.528729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.529588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.531559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66981b5f-c422-4d8e-a71e-227035fc5237 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:37:54.534508 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:37:54.538741 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:37:54.543650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1180/2350] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:37:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:37:54.577494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1171/2351] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:54.578630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.579639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.582551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.583309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.603352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.640805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:54.649288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.667818 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1172/2352] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:54.667818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.667818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.677287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f13192-9161-47c2-9e9d-8b138903dee8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.711074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.711991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.712339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.712715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.713798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.715818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db643-e284-48c6-9384-da8afd6c2287 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.721628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2b1b5-0e53-42bf-a3c7-b82c65303276 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:54.731884 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1181/2353] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:54.743094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.743094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.743094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.743420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:54.743420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.743420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.743420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] PATH_INFO: `/v3/projects/b2834f9f8817473da8d55cb6420739da/users/211b46d089c04fa9a25fd61a1f95049d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.796819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] MFA Rules not processed for user `fd9a2cf92b094c54bdce2e0bf8903af3`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:54.800099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2834f9f8817473da8d55cb6420739da, user_id=211b46d089c04fa9a25fd61a1f95049d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:54.800658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.801819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f755f-6d08-4cc8-83e3-6fbe7988ca94 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:54.879240 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1173/2354] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:54 2022] PUT /identity/v3/projects/b2834f9f8817473da8d55cb6420739da/users/211b46d089c04fa9a25fd61a1f95049d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:54.882036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531340-9d25-46c8-94d8-97c0cba30ff0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:54.882455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531340-9d25-46c8-94d8-97c0cba30ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:54.882876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8531340-9d25-46c8-94d8-97c0cba30ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:54.914362 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1182/2355] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:54.914695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a8531340-9d25-46c8-94d8-97c0cba30ff0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:54.914784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:54.914861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8531340-9d25-46c8-94d8-97c0cba30ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:54.969623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499fe1c-cf02-4a16-b768-c6368d237fc7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:55.017349 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1174/2356] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:55.018834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.019123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.019401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.052661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:55.057603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:55.073131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1175/2357] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:55.078511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:55.123240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:55.123996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.125416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5803d-04ce-42f2-b305-3f6023671ce3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:55.126345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.126580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] PATH_INFO: `/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a/users/5759fc38ced94552bd35852b527eadad/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.138680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5bd0f588b0b4f8482b4bbe9473d080a, user_id=5759fc38ced94552bd35852b527eadad, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:55.149940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:55.151075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.151075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.151327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.154558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:37:55.163530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:55.163530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b38240-8805-491f-a96a-a5800452ec0f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:55.172889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:55.196628 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1183/2358] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:54 2022] PUT /identity/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a/users/5759fc38ced94552bd35852b527eadad/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:55.196628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:55.210615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:55.215370 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1176/2359] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:37:55.222216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.222216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.222625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.306485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] MFA Rules not processed for user `5759fc38ced94552bd35852b527eadad`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:55.307586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:55.366089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:55.390397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618d3b0-928c-4036-8f5d-764deec0726d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:55.419919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:55.424938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.424938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.428273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.615053 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1177/2360] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:55.616111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:55.742503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:55.744110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:55.781343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0278630-5d09-499d-b928-5de2b1875564 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:55.790292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:55.791598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:55.791878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:55.792193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:55.792917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:55.798309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:55.807272 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1184/2361] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:55.855913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:55.859473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:56.003713 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1178/2362] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:56.008052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:56.127270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c32b5f-9bb5-4e03-9925-791548423827 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:56.223459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa99feb-35fa-4bcf-a7ee-b159991d07f0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:56.238341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:56.240423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:56.241638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:56.244413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:56.245340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:56.250633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:56.306222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:56.314815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:56.315344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:56.315633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:56.486998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:56.491122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:56.536666 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1185/2363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:37:56.617161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1179/2364] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:56 2022] POST /identity/v3/users => generated 293 bytes in 606 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:56.618535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:56.652320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57faa682-ee4d-4597-856a-8ef899d2fb56 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:56.674509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:56.678622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:56.679921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:56.680384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:56.682758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:56.689167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:56.726609 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1186/2365] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:56.730434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:56.747506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee483572-4904-4509-99c7-b276d43c9846 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:56.758813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:56.759391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:56.760195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:56.760195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:56.760657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:56.768209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9a4c3-b4dd-487c-b39a-03b7ff04b366 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:56.805178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:56.805704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1180/2366] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:56.821826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa3483-7143-496f-aabb-bd16cb69d95a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:56.837613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:56.840159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:56.841959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:56.842733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] PATH_INFO: `/v3/projects/83bf130cf545475299e94f8f404975ef/users/545361cf06be4c4f97186f446da9af7d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:56.883471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bf130cf545475299e94f8f404975ef, user_id=545361cf06be4c4f97186f446da9af7d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:56.892521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:56.991705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1187/2367] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:56 2022] PUT /identity/v3/projects/83bf130cf545475299e94f8f404975ef/users/545361cf06be4c4f97186f446da9af7d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:57.003105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.007230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.008216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.023246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:57.125592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] MFA Rules not processed for user `545361cf06be4c4f97186f446da9af7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:57.130248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:57.293189 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1181/2368] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:57.298114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:57.509478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d86c-40b8-467e-93f2-526f5e48f8fe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:57.547919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:57.553221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.553221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.553618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.554454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:57.557692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:57.722482 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1188/2369] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/projects => generated 387 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:37:57.723268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:57.738008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d16732-7823-4ba0-a651-fb7a5f4a20dc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:57.765137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:57.879596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:57.881944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:57.882518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:57.883022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:57.883922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:57.893203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.116097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1182/2370] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:37:57 2022] POST /identity/v3/users => generated 300 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:37:58.119314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.153021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052da9b-d21e-42c6-b3a9-b462a4489029 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.169227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.170094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.171091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.172667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.175097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.176986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.206831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1189/2371] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:58.216937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.252740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97a1ef-870f-47f2-ad7f-f075c01f881c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.255032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.256646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.265625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.278698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] PATH_INFO: `/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c/users/7ea8caa87f83438c8ab6fbc944a3d1cd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.286821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb060904ff54d9483ab3f41fe9a3c5c, user_id=7ea8caa87f83438c8ab6fbc944a3d1cd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.290913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.392148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1183/2372] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:58 2022] PUT /identity/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c/users/7ea8caa87f83438c8ab6fbc944a3d1cd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:58.396245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.415140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b32ac-f1b9-49f7-84a9-0fd7141d5ba6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.523970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.524921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.525358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.528104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.531801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.531801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d09e5-ccae-4d11-a4a7-50da851fe81c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.555816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1190/2373] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:37:58.556781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:58.573963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7719f6-3e7a-4d01-a43c-71a4768a6bf6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:58.580741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:58.581742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.582902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.583365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] PATH_INFO: `/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c/users/7ea8caa87f83438c8ab6fbc944a3d1cd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.585871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb060904ff54d9483ab3f41fe9a3c5c, user_id=7ea8caa87f83438c8ab6fbc944a3d1cd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:58.589826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:58.617792 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1184/2374] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:37:58 2022] PUT /identity/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c/users/7ea8caa87f83438c8ab6fbc944a3d1cd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:37:58.630180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:58.630180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:58.630180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:58.682351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] MFA Rules not processed for user `7ea8caa87f83438c8ab6fbc944a3d1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:37:58.684861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:37:58.796530 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1191/2375] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:37:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:37:59.676888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.821113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20bb72-2c7f-4ddc-9852-329fa68dd887 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:37:59.827423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:37:59.828436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:37:59.829039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:37:59.829488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] PATH_INFO: `/v3/users/0b6b9dc060de4551a67208d0f0482b60` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:37:59.831356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6b9dc060de4551a67208d0f0482b60)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:37:59.841071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:37:59.951815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:37:59.953322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:00.126981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de13bf-b115-4739-8f88-cfe24a8190e9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:00.133806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6b9dc060de4551a67208d0f0482b60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:00.148639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:00.150910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:00.151213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:00.151827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:00.169767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:00.171773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e086e6-a28a-4255-92f1-6faf2c7387b9 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:00.209300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1192/2376] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:37:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:00.296026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6b9dc060de4551a67208d0f0482b60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:00.311230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6b9dc060de4551a67208d0f0482b60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:00.320115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6b9dc060de4551a67208d0f0482b60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:00.320918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6b9dc060de4551a67208d0f0482b60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:00.330074 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1185/2377] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:37:59 2022] DELETE /identity/v3/users/0b6b9dc060de4551a67208d0f0482b60 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:00.334039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:00.334266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:00.335230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:00.369456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:00.372255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:00.540400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1193/2378] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:00.587999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:00.590354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:00.667595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:00.704579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c365e4d-e6d0-4b5c-b2a1-d8b68dffbde6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:00.709299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:00.710079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:00.710364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:00.710638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:00.722249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:00.723916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:00.736366 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1186/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:02.053695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:02.557921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:02.559473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:02.572841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745b2b4-2a67-4df4-828f-878d97a8fcd4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:02.578364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:02.579029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:02.579348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:02.579593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] PATH_INFO: `/v3/projects/6d92c49ad87f434b9902de8857fe3932` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:02.580955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d92c49ad87f434b9902de8857fe3932)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:02.582879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:02.782469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d92c49ad87f434b9902de8857fe3932', 'request_id': 'req-78b120fd-a155-4703-817c-a9f6ba57f125'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:02.805148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d92c49ad87f434b9902de8857fe3932', 'request_id': 'req-78b120fd-a155-4703-817c-a9f6ba57f125'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.029970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d92c49ad87f434b9902de8857fe3932', 'request_id': 'req-78b120fd-a155-4703-817c-a9f6ba57f125'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.062277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] The token cache is being invalidate because project 6d92c49ad87f434b9902de8857fe3932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:03.062779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.065969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.073665 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1194/2380] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:02 2022] DELETE /identity/v3/projects/6d92c49ad87f434b9902de8857fe3932 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:03.087564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:03.098923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b760e8-e679-4c05-bb3a-05a3ed61f120 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:03.260697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:03.262588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:03.263092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:03.263601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] PATH_INFO: `/v3/users/5759fc38ced94552bd35852b527eadad` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:03.266412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5759fc38ced94552bd35852b527eadad)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:03.269245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:03.658148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5759fc38ced94552bd35852b527eadad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.858776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5759fc38ced94552bd35852b527eadad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.887037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5759fc38ced94552bd35852b527eadad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.904344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5759fc38ced94552bd35852b527eadad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.905644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-021e3704-73a5-45d2-87db-75ce361813d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5759fc38ced94552bd35852b527eadad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:03.915338 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1187/2381] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:03 2022] DELETE /identity/v3/users/5759fc38ced94552bd35852b527eadad => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:04.817373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:04.821671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:04.848787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b120fd-a155-4703-817c-a9f6ba57f125 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:05.012626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:05.013578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.014038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.014483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] PATH_INFO: `/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.018470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5bd0f588b0b4f8482b4bbe9473d080a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:05.020815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:05.251182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5bd0f588b0b4f8482b4bbe9473d080a', 'request_id': 'req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:05.266979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5bd0f588b0b4f8482b4bbe9473d080a', 'request_id': 'req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:05.501572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5bd0f588b0b4f8482b4bbe9473d080a', 'request_id': 'req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:05.531188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] The token cache is being invalidate because project b5bd0f588b0b4f8482b4bbe9473d080a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:05.531814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:05.533078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38b9b36a-3717-4c32-8ea4-d86865d2b1f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:05.535140 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1195/2382] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:04 2022] DELETE /identity/v3/projects/b5bd0f588b0b4f8482b4bbe9473d080a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:05.541546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.542012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.542848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.579224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:05.580988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:05.713060 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1188/2383] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:05.721347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.721635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.722084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.773706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:05.774995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:05.792704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1196/2384] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:05.797225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:05.813346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f301f-3da1-47d6-85a1-42fb70bcc070 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:05.820851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:05.821897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.822605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.823099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.824069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:05.824654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:05.829988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:05.848735 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1189/2385] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:05.853275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:05.869124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3058263-4be4-40fa-9189-96ba03304852 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:05.877642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:05.879582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:05.883866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:05.884673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:05.887909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:05.889319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:05.894072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.052540 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1197/2386] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:05 2022] POST /identity/v3/projects => generated 395 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:06.055395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.072308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb7ef6-b39b-49f7-b0cd-3db9877ad22e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:06.153840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:06.154471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.154749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.155206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.156089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:06.158414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.252132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.254464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:06.277300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b82e4b-118e-4827-bc5e-deef9292f182 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:06.284037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:06.284994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.285591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.286250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] PATH_INFO: `/v3/users/545361cf06be4c4f97186f446da9af7d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.290075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545361cf06be4c4f97186f446da9af7d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:06.293278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.368297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1190/2387] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:06 2022] POST /identity/v3/users => generated 298 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:06.372209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.383911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a82f-73f2-4de6-bb9a-95dacade21af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:06.389021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:06.390027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.390406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.390780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.391527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:06.393294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.417545 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1191/2388] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:38:06.420028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.441808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe34c4-92c0-4fe4-b565-ed419c68c3a9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:06.451276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:06.452210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.452592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.452937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.453700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:06.455425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.478432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1192/2389] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:06.486727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.509755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4f71-7809-43fb-bf1c-7e98dc8fb8fb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:06.516849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:06.518407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.518524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.518715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] PATH_INFO: `/v3/projects/4eca4631088f4e8e9b23c9070680dbee/users/ddec067445d54223aa49c8a5ec9dea6b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.540011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eca4631088f4e8e9b23c9070680dbee, user_id=ddec067445d54223aa49c8a5ec9dea6b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:06.543308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee938d-8bd8-4355-a3c4-b827c8d98731 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:06.683144 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1193/2390] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:06 2022] PUT /identity/v3/projects/4eca4631088f4e8e9b23c9070680dbee/users/ddec067445d54223aa49c8a5ec9dea6b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:06.694090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.694618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.695044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:06.739823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] MFA Rules not processed for user `ddec067445d54223aa49c8a5ec9dea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:06.742147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:06.777443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545361cf06be4c4f97186f446da9af7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:06.898575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545361cf06be4c4f97186f446da9af7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:06.940016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545361cf06be4c4f97186f446da9af7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:06.940869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1194/2391] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:06.941455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545361cf06be4c4f97186f446da9af7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:06.942548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb780f2c-a840-4cec-a2d0-c8941d5339b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545361cf06be4c4f97186f446da9af7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:06.943916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:06.976971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1198/2392] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:06 2022] DELETE /identity/v3/users/545361cf06be4c4f97186f446da9af7d => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:06.978602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3117-ecf4-4c01-b8a0-c585626f3351 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:06.979271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3117-ecf4-4c01-b8a0-c585626f3351 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:06.982306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3117-ecf4-4c01-b8a0-c585626f3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.028482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6dc3117-ecf4-4c01-b8a0-c585626f3351 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:07.031420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6dc3117-ecf4-4c01-b8a0-c585626f3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.085967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:07.094005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df3fbb-e615-4f63-8ae8-ba3e6fa0f93f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:07.182379 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1199/2393] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:07.183243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.183536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.183808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.205148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:07.206676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.207110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.207534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.209239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:07.213602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb695e-8860-4f69-a0c7-902b0c3d1896 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:07.232111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] MFA Rules not processed for user `211b46d089c04fa9a25fd61a1f95049d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:07.234062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.321283 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1200/2394] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:07.321283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:07.324039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.421598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf63c4b-fa4c-4273-90c6-c3211dbcc2bd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:07.422080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1195/2395] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:06 2022] POST /identity/v3/projects => generated 395 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:07.423388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.423772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.424067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.468994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] MFA Rules not processed for user `211b46d089c04fa9a25fd61a1f95049d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:07.468994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.530150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:07.532218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.532438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.532778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.596559 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1196/2396] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:07 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:07.598161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:07.609551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.720280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:07.728965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:07.738733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb27d7-8a42-4005-be7f-21cb78f9bb4c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:07.745736 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1201/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:07.753072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:07.755501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.756147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.756683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.758539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:07.761701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:07.818326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:07.820378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:07.903313 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1197/2398] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:07 2022] POST /identity/v3/users => generated 304 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:07.915966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:07.957369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a17301-9a35-4ab7-a253-3adc4134f7d1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:07.988180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:07.989062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:07.989451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:07.992406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:07.996155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:07.999373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:08.028430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1198/2399] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:08.041996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:08.047273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fa39a-4a0d-46ad-858e-8ac90da087d5 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:08.064198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:08.064948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.067502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.068458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.074516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01abd5f-fae3-437b-8e3d-12cc837e912d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:08.082056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:08.083112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.083630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.084724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] PATH_INFO: `/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e/users/8dfd2e823db74fa08afa6bfce904abe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.089924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:08.091879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:08.107951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746d0f899f0245c1b6b97e3ea6f0d93e, user_id=8dfd2e823db74fa08afa6bfce904abe7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:08.112320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:08.121524 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1202/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:07 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:08.247110 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1199/2401] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:08 2022] PUT /identity/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e/users/8dfd2e823db74fa08afa6bfce904abe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:08.247917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:08.266616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197aedb9-d927-49ed-8ba3-23ba65735ee6 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:08.468977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:08.469619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.469932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.470238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.471252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:08.472890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78658-b7c4-4506-ac28-a1766f9d8ec1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:08.508215 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1203/2402] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:08.509354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:08.532951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb21e7-2b43-4bb6-b717-831ed62b6882 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:08.545964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:08.546664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.546946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.547222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] PATH_INFO: `/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e/users/8dfd2e823db74fa08afa6bfce904abe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.551808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=746d0f899f0245c1b6b97e3ea6f0d93e, user_id=8dfd2e823db74fa08afa6bfce904abe7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:08.559966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769869d0-0f0d-401d-a012-033b383f3bfa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:08.594533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1200/2403] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:08 2022] PUT /identity/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e/users/8dfd2e823db74fa08afa6bfce904abe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:08.606334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.606334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.606656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.685502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] MFA Rules not processed for user `8dfd2e823db74fa08afa6bfce904abe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:08.686869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:08.790965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a88-74c7-4eef-b952-73db9a508874 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.792929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a88-74c7-4eef-b952-73db9a508874 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.793341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4161a88-74c7-4eef-b952-73db9a508874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b4161a88-74c7-4eef-b952-73db9a508874 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:08.801294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:08.802505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:38:08.803394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1201/2404] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:38:08.947867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:08.948072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:08.948356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:08.953548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1204/2405] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:08.983186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] MFA Rules not processed for user `ddec067445d54223aa49c8a5ec9dea6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:08.984515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.143453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1202/2406] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:09.631720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.634394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.767289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:09.768910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.839390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b87e-90db-4b30-87a0-48f11bc28c27 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.861119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.861119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.861119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.861119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] PATH_INFO: `/v3/projects/83bf130cf545475299e94f8f404975ef` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.861621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bf130cf545475299e94f8f404975ef)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:09.861621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:09.892890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e1add-2dfd-413f-a129-ed0fbc79e392 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:09.903036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:09.904878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:09.912295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:09.912295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:09.912295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:09.928540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:09.931100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:09.942958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1203/2407] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:09 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:10.145449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bf130cf545475299e94f8f404975ef', 'request_id': 'req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:10.162386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bf130cf545475299e94f8f404975ef', 'request_id': 'req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:10.303641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bf130cf545475299e94f8f404975ef', 'request_id': 'req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:10.323436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] The token cache is being invalidate because project 83bf130cf545475299e94f8f404975ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:10.324350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:10.325503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:10.333087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.333618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1205/2408] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:09 2022] DELETE /identity/v3/projects/83bf130cf545475299e94f8f404975ef => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:10.353051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6538cce-481a-4dc9-b2ba-c0aa88372956 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.476409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.477242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.479550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.479983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] PATH_INFO: `/v3/users/7ea8caa87f83438c8ab6fbc944a3d1cd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.481330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea8caa87f83438c8ab6fbc944a3d1cd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.485432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.615098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:10.615432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:10.636861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd04ae9-11bc-4d13-99fe-ffe02c51c09d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:10.647104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:10.648160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:10.648687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:10.649130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] PATH_INFO: `/v3/users/d8552963e6944dbebe1ab05cf249a4a6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:10.650921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8552963e6944dbebe1ab05cf249a4a6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:10.653346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:10.924886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:10.952120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea8caa87f83438c8ab6fbc944a3d1cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.059167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea8caa87f83438c8ab6fbc944a3d1cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.091071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea8caa87f83438c8ab6fbc944a3d1cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.097756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8552963e6944dbebe1ab05cf249a4a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.110081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea8caa87f83438c8ab6fbc944a3d1cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.110882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea8caa87f83438c8ab6fbc944a3d1cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.121368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1204/2409] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:10 2022] DELETE /identity/v3/users/7ea8caa87f83438c8ab6fbc944a3d1cd => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:11.195902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8552963e6944dbebe1ab05cf249a4a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.214812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8552963e6944dbebe1ab05cf249a4a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.215953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8552963e6944dbebe1ab05cf249a4a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.216799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8552963e6944dbebe1ab05cf249a4a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:11.266729 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1206/2410] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:10 2022] DELETE /identity/v3/users/d8552963e6944dbebe1ab05cf249a4a6 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:11.339594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:12.192433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:12.194306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:12.336040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:12.336040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:12.406991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58e969-5812-4525-bef5-1c54c41f18fb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:12.525744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0fb56-6fab-495f-b086-e0d66311ac0d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:12.539946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:12.539946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:12.539946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:12.539946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] PATH_INFO: `/v3/projects/4a825a5c09b94750aa1382e00bd6a956` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:12.540322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a825a5c09b94750aa1382e00bd6a956)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:12.543017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:12.572234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:12.572912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:12.573717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:12.573717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] PATH_INFO: `/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:12.577923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb060904ff54d9483ab3f41fe9a3c5c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:12.580022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:12.845622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a825a5c09b94750aa1382e00bd6a956', 'request_id': 'req-7fecfcaa-eeed-4167-9efe-10201d727b6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:12.868787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a825a5c09b94750aa1382e00bd6a956', 'request_id': 'req-7fecfcaa-eeed-4167-9efe-10201d727b6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:12.895564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb060904ff54d9483ab3f41fe9a3c5c', 'request_id': 'req-45855626-6b67-4b3d-a254-282f2f4ec038'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:12.909781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb060904ff54d9483ab3f41fe9a3c5c', 'request_id': 'req-45855626-6b67-4b3d-a254-282f2f4ec038'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:12.924025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb060904ff54d9483ab3f41fe9a3c5c', 'request_id': 'req-45855626-6b67-4b3d-a254-282f2f4ec038'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:12.995167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a825a5c09b94750aa1382e00bd6a956', 'request_id': 'req-7fecfcaa-eeed-4167-9efe-10201d727b6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:13.041806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] The token cache is being invalidate because project 4a825a5c09b94750aa1382e00bd6a956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:13.042305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:13.043188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:13.050154 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1207/2411] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:12 2022] DELETE /identity/v3/projects/4a825a5c09b94750aa1382e00bd6a956 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:13.051693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:13.053852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:13.074368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] The token cache is being invalidate because project 5eb060904ff54d9483ab3f41fe9a3c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:13.074368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:13.076817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45855626-6b67-4b3d-a254-282f2f4ec038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:13.079943 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1205/2412] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:12 2022] DELETE /identity/v3/projects/5eb060904ff54d9483ab3f41fe9a3c5c => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:13.086799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68dd2-cf24-4079-9e7c-98477189dc82 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.087221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68dd2-cf24-4079-9e7c-98477189dc82 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.087603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b68dd2-cf24-4079-9e7c-98477189dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.154734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-47b68dd2-cf24-4079-9e7c-98477189dc82 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:13.156529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47b68dd2-cf24-4079-9e7c-98477189dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:13.222091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fecfcaa-eeed-4167-9efe-10201d727b6a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:13.263808 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1206/2413] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:13.266798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.267104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.267352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.305504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:13.308067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:13.327909 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1207/2414] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:13.329823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:13.341270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de6586-8c42-43b7-bc31-3bf5446da120 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:13.350496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:13.351432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.352441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.352873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.353556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:13.353859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:13.356883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:13.400448 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1208/2415] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:13.401477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:13.415202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:13.415854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.421277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.421969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] PATH_INFO: `/v3/users/8287611a77514fcfb28fb30ec7b08f13` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.423538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8287611a77514fcfb28fb30ec7b08f13)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:13.429176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:13.444569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5784ecf-14cb-4b11-a099-5890fdb91ead admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:13.459577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:13.460410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.460742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.460999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.461835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:13.474371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:13.715177 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1209/2416] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/projects => generated 375 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:13.730232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:13.865987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa480ba-6072-4dca-8b45-4bdc25dcbd40 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:13.885052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:13.885699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:13.893370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:13.894854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:13.896372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:13.900227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.173599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8287611a77514fcfb28fb30ec7b08f13'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.248608 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1210/2417] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:13 2022] POST /identity/v3/users => generated 288 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:14.249733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.257007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:14.284652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb6dc-4abb-4efc-8cd1-6cb3812f4cfa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.290653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.291959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.292379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.292858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] PATH_INFO: `/v3/users/a0475d03f0e14972a733ba9db2d32947` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.294537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0475d03f0e14972a733ba9db2d32947)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.298737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.376215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8287611a77514fcfb28fb30ec7b08f13'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.399982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8287611a77514fcfb28fb30ec7b08f13'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.404000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8287611a77514fcfb28fb30ec7b08f13'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.405669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8287611a77514fcfb28fb30ec7b08f13'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.442132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1208/2418] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:13 2022] DELETE /identity/v3/users/8287611a77514fcfb28fb30ec7b08f13 => generated 0 bytes in 1391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:14.443077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.451325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:14.576343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0475d03f0e14972a733ba9db2d32947'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.623651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf8ff2-de8a-4491-973a-c791262f961b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.633563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.637000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.641644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.641644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.641644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.644251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.671990 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1209/2419] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:14.679382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.704680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adaa3d9-fa17-4736-872f-a212e1d03abc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.722916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.727348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.727348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.727348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.729783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.734612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.752284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0475d03f0e14972a733ba9db2d32947'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.760637 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1210/2420] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:14.764680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:14.788858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dae15-f99e-4324-87f9-649ac3aa188b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:14.789244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0475d03f0e14972a733ba9db2d32947'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.808544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:14.810340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.810744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.811229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca/users/4bf7acfa23724ceea7dbdfaf53309923/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.817324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0475d03f0e14972a733ba9db2d32947'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.818990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d9a1fa86-66be-4bf5-a1c8-0de12dc1df46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0475d03f0e14972a733ba9db2d32947'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:14.842981 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1211/2421] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:14 2022] DELETE /identity/v3/users/a0475d03f0e14972a733ba9db2d32947 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:14.844746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:14.845027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:14.845303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:14.854167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03aa3a57c2b04d8ca26d6b56f9163aca, user_id=4bf7acfa23724ceea7dbdfaf53309923, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:14.857261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f2af9c-5a49-4c80-b7b4-40e00831440e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:14.914131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:14.915845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:14.924119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:14.966567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1211/2422] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:14 2022] PUT /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca/users/4bf7acfa23724ceea7dbdfaf53309923/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:15.046070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.047445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.053273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.115211 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1212/2423] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:15.115211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.115512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.165962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609a79f-a207-48b6-8312-b1ba1586f18a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.190002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] MFA Rules not processed for user `4bf7acfa23724ceea7dbdfaf53309923`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:15.193754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.382875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.384636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.385147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.385841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] PATH_INFO: `/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.390155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f204e1d6ec04e3eb9513cecc5f951eb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.398307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.446344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1212/2424] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:15.447253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.453532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.646351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70298e7c-4fa8-4a13-97fa-ca4ca2fb5d63 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.660688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:15.661648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.663434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.663886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.697406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:15.709714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f204e1d6ec04e3eb9513cecc5f951eb', 'request_id': 'req-79971a1d-04e1-4d37-9b3d-22b2326f54bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:15.715948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:15.722705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f204e1d6ec04e3eb9513cecc5f951eb', 'request_id': 'req-79971a1d-04e1-4d37-9b3d-22b2326f54bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:15.743314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f204e1d6ec04e3eb9513cecc5f951eb', 'request_id': 'req-79971a1d-04e1-4d37-9b3d-22b2326f54bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:15.761786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1213/2425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:15.769281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:15.773057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:15.825458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462e58-2560-4b2e-b0d0-9a532ca597bb service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:15.834089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] The token cache is being invalidate because project 7f204e1d6ec04e3eb9513cecc5f951eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:15.834434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:15.835272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79971a1d-04e1-4d37-9b3d-22b2326f54bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:15.837269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1213/2426] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:15 2022] DELETE /identity/v3/projects/7f204e1d6ec04e3eb9513cecc5f951eb => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:15.847063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa4c3-dd2b-4cf5-9120-80a82e168d74 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:15.847376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa4c3-dd2b-4cf5-9120-80a82e168d74 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:15.847786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aa4c3-dd2b-4cf5-9120-80a82e168d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:15.897178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6f8aa4c3-dd2b-4cf5-9120-80a82e168d74 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:15.898738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6f8aa4c3-dd2b-4cf5-9120-80a82e168d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:16.009115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.010075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.010506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.010957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.011749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.013911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.071958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1214/2427] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:16.080284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.082287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.082720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.121063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:16.143636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:16.144933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:16.168423 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1215/2428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:16.169720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.184903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1214/2429] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:15 2022] POST /identity/v3/projects => generated 375 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:16.190973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.194818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:16.227837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5f63f-4068-4b40-8845-44d0e13596a7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.331566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.332687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.333324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.333813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.334708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:16.335343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.338265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.361958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1216/2430] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:16.367081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.396184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a86d78f-75f6-48fd-9066-5c9c7dd73c83 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.413377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.414548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.414974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.415395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.416237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.419162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.457151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b11c7-50fd-48b3-9eae-eaa01460417c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.485695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.486318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.486596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.486867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.487506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.490313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.551527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1217/2431] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:16 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:16.554933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.646336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b79e6-daac-4273-968c-bf1b367c2ed2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.654648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.654648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.654648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.654648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.655158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.655989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.740340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1215/2432] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:16 2022] POST /identity/v3/users => generated 294 bytes in 550 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:16.744254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.756466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e28ddf-254b-4431-9a64-0782812f2a4d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.762654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.763629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.764357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.764816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.765685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.767546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.781144 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1216/2433] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:38:16.785264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.803180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ead9-b6de-4eb4-8108-9d67cd6caeb6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.811969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.812951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.813405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.813888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] PATH_INFO: `/v3/projects/3c68dadbbf96429ab5573202410f2c1c/users/3e72363a33764c93824167919cfdcebd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.843667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1218/2434] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:16 2022] POST /identity/v3/users => generated 290 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:16.845016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.847013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68dadbbf96429ab5573202410f2c1c, user_id=3e72363a33764c93824167919cfdcebd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.851872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.869227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d144-6d4c-4f35-9c30-9660c84ce466 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.870966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:16.889599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.890340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.890684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.891172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.891910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.893704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.918573 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1219/2435] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:16.919815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:16.950302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076161d-0fe6-40d6-b3f4-b16505c5b5a7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:16.966048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:16.966668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:16.966948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:16.967227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:16.967873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:16.970694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:16.992244 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1217/2436] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:16 2022] PUT /identity/v3/projects/3c68dadbbf96429ab5573202410f2c1c/users/3e72363a33764c93824167919cfdcebd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:16.998955 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1220/2437] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:17.003199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.005283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.037576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fed18-2040-49a0-b9a5-4f9ccd48e29d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.172307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd9327-3fc9-4820-9e0b-3290af2363e2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.190067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.190713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.191012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.191295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.191979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.193742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.204418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.205760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.214427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.214427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] PATH_INFO: `/v3/projects/d5ea39ff6a764b3d8c3dd063e4cafef5/users/dae176f3181c4ba89c59ffb99cd7d16e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.221378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1218/2438] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:38:17.221378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.230126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:17.234352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ea39ff6a764b3d8c3dd063e4cafef5, user_id=dae176f3181c4ba89c59ffb99cd7d16e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.238597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.269025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b68010-8781-462f-a6a3-f40cad9faff6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.277455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.278100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.278378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.278649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] PATH_INFO: `/v3/projects/6e09079e89384417879f678c0a4df5c2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.283996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e09079e89384417879f678c0a4df5c2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.288315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.496929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1221/2439] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:17 2022] PUT /identity/v3/projects/d5ea39ff6a764b3d8c3dd063e4cafef5/users/dae176f3181c4ba89c59ffb99cd7d16e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:17.534584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.678820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fbf39-c5c0-4a40-b017-983e5c0ffe59 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:17.684693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:17.685285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.685491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.685888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] PATH_INFO: `/v3/projects/3c68dadbbf96429ab5573202410f2c1c/users/3e72363a33764c93824167919cfdcebd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.687850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c68dadbbf96429ab5573202410f2c1c, user_id=3e72363a33764c93824167919cfdcebd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:17.690746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74d989-bd36-4bb0-96c6-442b894212c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:17.705850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1222/2440] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:17 2022] PUT /identity/v3/projects/3c68dadbbf96429ab5573202410f2c1c/users/3e72363a33764c93824167919cfdcebd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:17.707453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282478c0-3a7a-4cb4-a01f-c177fe7a476c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.707916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282478c0-3a7a-4cb4-a01f-c177fe7a476c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.708938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282478c0-3a7a-4cb4-a01f-c177fe7a476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.756126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-282478c0-3a7a-4cb4-a01f-c177fe7a476c None None] MFA Rules not processed for user `dae176f3181c4ba89c59ffb99cd7d16e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:17.757413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-282478c0-3a7a-4cb4-a01f-c177fe7a476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:17.830986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e09079e89384417879f678c0a4df5c2', 'request_id': 'req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:17.845567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e09079e89384417879f678c0a4df5c2', 'request_id': 'req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:17.901120 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1223/2441] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:17.903104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:17.903494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:17.903920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:17.938912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] MFA Rules not processed for user `3e72363a33764c93824167919cfdcebd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:17.940566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:17.948922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e09079e89384417879f678c0a4df5c2', 'request_id': 'req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:17.966849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] The token cache is being invalidate because project 6e09079e89384417879f678c0a4df5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:17.967248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:17.970847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:17.978758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1219/2442] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:17 2022] DELETE /identity/v3/projects/6e09079e89384417879f678c0a4df5c2 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:17.978758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:17.980682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:18.127944 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1224/2443] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:18.129033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.135723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:18.139695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af773ca-8c39-4f53-bd89-d72bc8fe6d36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.157314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.158084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.158430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.158778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.159710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.163136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.169416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5051d59-474f-4e6e-9bbd-b490ae8ee1f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.183239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.184004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.184547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.185567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] PATH_INFO: `/v3/users/a2e39bbd0dc6473d9f912564957b5476` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.186452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2e39bbd0dc6473d9f912564957b5476)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.188628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.327090 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1220/2444] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:17 2022] POST /identity/v3/projects => generated 377 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:18.328878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.459871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcaa9d-e3c2-4458-8b7e-7222976cf522 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.476870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2e39bbd0dc6473d9f912564957b5476'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:18.478109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.487132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.487132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.487132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.487132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:18.487132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.488247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.507587 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1221/2445] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:18.508634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.579151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2e39bbd0dc6473d9f912564957b5476'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:18.602250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2e39bbd0dc6473d9f912564957b5476'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:18.632240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2e39bbd0dc6473d9f912564957b5476'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:18.633174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2e39bbd0dc6473d9f912564957b5476'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:18.643445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49b54-535d-4916-9d0a-d974636957e7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.654625 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1225/2446] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:18 2022] DELETE /identity/v3/users/a2e39bbd0dc6473d9f912564957b5476 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:18.654625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.654625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:18.673619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.675554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.677402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.677745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.680111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.686079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.822274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2dcb4-5ce4-4f9f-b12d-a854eee5cb02 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.832151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.832151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.832151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.832151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] PATH_INFO: `/v3/users/fa2b6dc15a41463d86d252948b613f48` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.832664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2b6dc15a41463d86d252948b613f48)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.834538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:18.864555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1222/2447] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:18 2022] POST /identity/v3/users => generated 295 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:18.866401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:18.870084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:18.906744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7365fb7-3a19-4c3e-af39-ab9553fd1fde admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:18.986439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:18.987387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:18.987691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:18.987969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:18.988835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:18.992928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1fbd0-0c98-458a-8a2e-92fe9dd8d505 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.053169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:19.131025 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1223/2448] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:19.131025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.131025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.131025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.138427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2b6dc15a41463d86d252948b613f48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:19.139362 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:19.140448 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:19.144892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:19.159939 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1224/2449] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:19.159939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.182827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.267535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.273166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.273975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.274890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.275235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.276144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.277768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.283953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2b6dc15a41463d86d252948b613f48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.307011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2b6dc15a41463d86d252948b613f48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.323186 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1225/2450] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:19.335505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.338034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.348916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2b6dc15a41463d86d252948b613f48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.350557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2b6dc15a41463d86d252948b613f48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.367299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1cda-4ad4-4c10-9b79-a1ae6944e6bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.382340 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1226/2451] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:18 2022] DELETE /identity/v3/users/fa2b6dc15a41463d86d252948b613f48 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:19.384115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.394689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.606744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b3995-9d2e-4224-be1b-ef58a8d912aa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.608463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.609217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.610851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.611412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.611718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] PATH_INFO: `/v3/projects/6d61f8d464244db0af7240cab16d8363` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.612115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.612511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.613242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.614390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:19.614806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.616953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d61f8d464244db0af7240cab16d8363)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.622253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.622648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.659968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1227/2452] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:19.661576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.664567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.686946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a78720-01fa-4be8-a01e-887ee22b996a tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.692211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:19.693586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:19.693982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:19.694234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] PATH_INFO: `/v3/projects/0e1e35190c454171b0e3f312806d4ba7/users/e451b81076cb4a8998fdc5f14d2983a6/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:19.723960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1e35190c454171b0e3f312806d4ba7, user_id=e451b81076cb4a8998fdc5f14d2983a6, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:19.723960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:19.873804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1228/2453] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:19 2022] PUT /identity/v3/projects/0e1e35190c454171b0e3f312806d4ba7/users/e451b81076cb4a8998fdc5f14d2983a6/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:19.873804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:19.876014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:19.887130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d61f8d464244db0af7240cab16d8363', 'request_id': 'req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.899057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d61f8d464244db0af7240cab16d8363', 'request_id': 'req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.983363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d61f8d464244db0af7240cab16d8363', 'request_id': 'req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:19.993783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d8f302-eebd-4c53-b7d9-fec39f19bb6a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:19.998845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] The token cache is being invalidate because project 6d61f8d464244db0af7240cab16d8363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:19.999269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.000317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.001930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1226/2454] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:19 2022] DELETE /identity/v3/projects/6d61f8d464244db0af7240cab16d8363 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:20.002999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.004366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.091355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.092331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.092743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.093372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.093827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a4d0b1-115d-4145-b6ae-b99f93b87ebe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.095874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.099546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.100203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.100478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.100805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.101440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.103089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.115717 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1227/2455] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:20.116533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.120622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.132272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84af96-3d0f-4d0b-8103-af096c7ee82f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.141072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.141782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.142069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.142348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] PATH_INFO: `/v3/users/211b46d089c04fa9a25fd61a1f95049d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.143762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211b46d089c04fa9a25fd61a1f95049d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.146408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.180361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.182001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.193769 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1229/2456] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:20.195022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.196423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.211539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea093a35-b5e0-4b0c-a3e1-0a5ad21f24ce service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.216861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.217969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.217969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.218207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] PATH_INFO: `/v3/projects/892fb03c420b40bca466510fca720571` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.224069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=892fb03c420b40bca466510fca720571)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.226115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.452376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892fb03c420b40bca466510fca720571', 'request_id': 'req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.455830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211b46d089c04fa9a25fd61a1f95049d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.459281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892fb03c420b40bca466510fca720571', 'request_id': 'req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.466202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892fb03c420b40bca466510fca720571', 'request_id': 'req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.620452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211b46d089c04fa9a25fd61a1f95049d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.639542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211b46d089c04fa9a25fd61a1f95049d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.640763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211b46d089c04fa9a25fd61a1f95049d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.641811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-716c4397-39e8-4aa1-bb78-20fb1dd8fc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211b46d089c04fa9a25fd61a1f95049d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.662286 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1228/2457] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:20 2022] DELETE /identity/v3/users/211b46d089c04fa9a25fd61a1f95049d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:20.663544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01031-ed19-493f-a954-c075eecd3b45 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.664599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01031-ed19-493f-a954-c075eecd3b45 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.664599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f01031-ed19-493f-a954-c075eecd3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.688982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-35f01031-ed19-493f-a954-c075eecd3b45 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:20.690818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-35f01031-ed19-493f-a954-c075eecd3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.749800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:20.755912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] The token cache is being invalidate because project 892fb03c420b40bca466510fca720571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:20.756592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.757996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:20.783870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1230/2458] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:20 2022] DELETE /identity/v3/projects/892fb03c420b40bca466510fca720571 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:20.788167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:20.790849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.815779 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1229/2459] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:20.829444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04535-ba7b-42e1-b065-d9e12be22f8c None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.829907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04535-ba7b-42e1-b065-d9e12be22f8c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.830364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04535-ba7b-42e1-b065-d9e12be22f8c None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.847275 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1230/2460] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:20 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:20.849871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26b6d-5a69-4622-94c4-81a12889c492 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.853848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:20.854945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26b6d-5a69-4622-94c4-81a12889c492 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.861139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb26b6d-5a69-4622-94c4-81a12889c492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.909029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fcb26b6d-5a69-4622-94c4-81a12889c492 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:20.910511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fcb26b6d-5a69-4622-94c4-81a12889c492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.928628 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1231/2461] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:20.928628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.928628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.928628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.966273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04fca-33cb-4b34-b0ce-f51dbba187cd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:20.969551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:20.971905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:20.972857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:20.973404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:20.974084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:20.974527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] PATH_INFO: `/v3/projects/0e1e35190c454171b0e3f312806d4ba7/users/e451b81076cb4a8998fdc5f14d2983a6/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:20.977168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1e35190c454171b0e3f312806d4ba7, user_id=e451b81076cb4a8998fdc5f14d2983a6, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:20.980248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e026b-73b2-4df7-9377-81af7a696992 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:20.997692 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1232/2463] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:21.000678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:21.004197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.006921 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1231/2463] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:20 2022] PUT /identity/v3/projects/0e1e35190c454171b0e3f312806d4ba7/users/e451b81076cb4a8998fdc5f14d2983a6/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:21.008734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.009139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.009535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.057684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:21.059093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.133305 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1232/2464] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:21.137884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.149657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.151505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.154235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0a6ed-5ce5-40d4-b087-db4a0aa6e368 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.159913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.160832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.161727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.162004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.162697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:21.163003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.164672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d54ba-cc53-4f65-9b71-6c6b5e6fbc58 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.188744 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1233/2465] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:21.188744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.188744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.188744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.230792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] MFA Rules not processed for user `e451b81076cb4a8998fdc5f14d2983a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:21.232429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.263176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd4e78b-f7ac-4f40-a315-6f098bdee9ce None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.343162 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1234/2466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:21.345152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.362229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47c3ab-5f33-4399-bf38-f3d6838d849d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.367938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.367938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.367938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.368461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/b511d2a2d3664660a8fcc8720322a0bb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.368854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=b511d2a2d3664660a8fcc8720322a0bb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.370626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.371009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.372109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.372601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.373152 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1233/2467] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:20 2022] GET /identity/v3/projects/b511d2a2d3664660a8fcc8720322a0bb => generated 371 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:21.373349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.374238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:21.374360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.375513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.377504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.388427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37194cf-ea3c-446d-8f02-e0c31bc97878 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.394590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1235/2468] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:21.396189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.399557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.399815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.400600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.408143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.408143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.408143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.408143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.427389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148d081-8da4-4de1-a595-61a03a1de013 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.433642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.434360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.434809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.435079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] PATH_INFO: `/v3/projects/b2834f9f8817473da8d55cb6420739da` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.436453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2834f9f8817473da8d55cb6420739da)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.438648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.649102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1234/2469] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:21 2022] POST /identity/v3/projects => generated 391 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:21.654496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.720305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2834f9f8817473da8d55cb6420739da', 'request_id': 'req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:21.728691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2834f9f8817473da8d55cb6420739da', 'request_id': 'req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:21.736427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2834f9f8817473da8d55cb6420739da', 'request_id': 'req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:21.748667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46ef56-c7c0-462d-99e5-0b9b6c92b026 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:21.810586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:21.811221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.811502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.811771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.812408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:21.814422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db18933-3f62-4536-b6e2-fedfae90e0df admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:21.975655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] The token cache is being invalidate because project b2834f9f8817473da8d55cb6420739da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:21.976235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:21.976785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:21.985952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1236/2470] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:21 2022] DELETE /identity/v3/projects/b2834f9f8817473da8d55cb6420739da => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:21.985952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.985952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:21.986360 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1235/2471] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:21 2022] POST /identity/v3/projects => generated 395 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:21.989961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:21.990506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:21.990847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:21.992470 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1236/2472] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:21.997789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:21.999655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.088619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b77dd-c89e-4b88-ad1a-2c268d7f52f7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.088901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91231003-00f9-4867-a4b4-cb864ed50976 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.093538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.094080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.094519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.094647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.095260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.097235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.155343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.156195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.156472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.156781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.158569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.198694 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1237/2473] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:21 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:22.202583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.210184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.219264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec04b7-11ba-4add-b079-678ea8437ef7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.224845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.225482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.225815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.226152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.226774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.228879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.262864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.264780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf358320-0dfe-4465-bfb9-e410ea58e34e service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.276812 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1237/2474] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:22.278288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.278672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.278951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.303369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:22.305639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.328079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1238/2475] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:22.333571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:22.333571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.352315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.353680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.431215 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1238/2476] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:22.435568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.459189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7273c8-1181-45cf-95b3-8b3e9286d4bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.478616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.479517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.479855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb738ce-1a57-4d9b-9d9d-64c5e78808d0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.485628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.486341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.486641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.487353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.488349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/b511d2a2d3664660a8fcc8720322a0bb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.490825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=b511d2a2d3664660a8fcc8720322a0bb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.493218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ffa90-8737-4162-bb07-6ba07b6bcbf4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.496767 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1239/2477] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/projects/b511d2a2d3664660a8fcc8720322a0bb => generated 371 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:22.497844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.498133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.498440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.509497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.514289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.518602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.535867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:22.538377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:22.552942 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1240/2478] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:22.552942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.553706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1239/2479] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:22.554498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.568404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae85e-1171-4106-b49d-0f78d76a4a2d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.571148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148fc68-82e8-444a-bd4b-78a448650c88 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.575171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.575942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.576235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.576540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.577469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.578721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.579530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.579662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.580068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.580523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.581715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:22.582172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.584306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.593815 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1241/2480] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:22.595835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.603482 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1240/2481] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:22.604909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.613584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c218ed-f7e7-4bdf-8640-79306c886275 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.617590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668607f3-4bad-4383-a69c-831f53823f8b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.626479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.627291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.627578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.627856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.629498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.630332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.630614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.630799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.630911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.631521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.634693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.634964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.652389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1241/2482] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:22.652389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.662771 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1242/2483] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:22.663897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.666781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2ee7-8111-459e-8434-2f1d4846c484 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.681428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.682227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.682606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.682982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.683910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.686233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.691010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a267dd-0b44-4817-a997-e6cd11a6f93b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.700305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.701591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.702025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.702199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] PATH_INFO: `/v3/projects/0303fb8fa1924311b8b0c54f77aab51e/users/469e933c7f8042e48c20972431265685/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:22.726142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0303fb8fa1924311b8b0c54f77aab51e, user_id=469e933c7f8042e48c20972431265685, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:22.730291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:22.805863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:22.811201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1242/2484] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:22.812226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1243/2485] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:22 2022] PUT /identity/v3/projects/0303fb8fa1924311b8b0c54f77aab51e/users/469e933c7f8042e48c20972431265685/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:22.815806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.816172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:22.876702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:22.942573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542419f3-2bf7-4039-9457-af16bbb9e91b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.968141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea62b11-092e-440a-8020-7baf7467bd02 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:22.977395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:22.978457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:22.984911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:22.984911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] PATH_INFO: `/v3/projects/4e0aa9b18c154964972a8c57c290dfe0/users/ebf0681a98044ce29352cc8abdaa69f1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.032897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0aa9b18c154964972a8c57c290dfe0, user_id=ebf0681a98044ce29352cc8abdaa69f1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.039325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635a738-5752-4a2f-934d-f0aa179a8888 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.063860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.064968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.065346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.065761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.066672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.069518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.143497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1243/2486] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:22 2022] PUT /identity/v3/projects/4e0aa9b18c154964972a8c57c290dfe0/users/ebf0681a98044ce29352cc8abdaa69f1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:23.148055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8200c7-0700-4145-8b6c-154a6689ab48 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.148474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8200c7-0700-4145-8b6c-154a6689ab48 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.148874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8200c7-0700-4145-8b6c-154a6689ab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.175215 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1244/2487] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:22 2022] POST /identity/v3/users => generated 291 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:23.180787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.180787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:23.195481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0d8200c7-0700-4145-8b6c-154a6689ab48 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:23.196839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d8200c7-0700-4145-8b6c-154a6689ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:23.211855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd80a7-08fb-4207-9156-def8ab175485 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.357404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.358113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.358391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.358663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] PATH_INFO: `/v3/users/dae176f3181c4ba89c59ffb99cd7d16e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.359909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae176f3181c4ba89c59ffb99cd7d16e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.362260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.387051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1244/2488] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:23.387051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a648-02ca-4bdf-a1d6-9d8fd9b302c4 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.387051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a648-02ca-4bdf-a1d6-9d8fd9b302c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.387051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0a648-02ca-4bdf-a1d6-9d8fd9b302c4 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.387051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1245/2489] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:23.388401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.388777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.389422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.472174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] MFA Rules not processed for user `ebf0681a98044ce29352cc8abdaa69f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:23.474025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:23.587592 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1246/2490] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:23.588735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.602165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60bc3d-6c03-4a59-9f59-f9d2644c4c3a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.613638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.614325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.614611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.614897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.615668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.617463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.638096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1247/2491] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:23.638096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:23.659340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae176f3181c4ba89c59ffb99cd7d16e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:23.750072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.802316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae176f3181c4ba89c59ffb99cd7d16e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:23.824080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae176f3181c4ba89c59ffb99cd7d16e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:23.835033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae176f3181c4ba89c59ffb99cd7d16e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:23.838451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae176f3181c4ba89c59ffb99cd7d16e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:23.842033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4143e-f0bb-4c6c-a7d5-b547e71a8baa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.847139 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1245/2492] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:23 2022] DELETE /identity/v3/users/dae176f3181c4ba89c59ffb99cd7d16e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:23.847630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.849171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.849500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.849933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.850526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/b511d2a2d3664660a8fcc8720322a0bb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.851599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:23.851992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=b511d2a2d3664660a8fcc8720322a0bb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:23.854486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:23.869241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1248/2493] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/projects/b511d2a2d3664660a8fcc8720322a0bb => generated 371 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:23.870414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:23.876544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:23.901778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19854c3-4cea-44d3-8ae8-e4e226559688 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.986014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d214e-739e-4948-a0c2-e76fa1c31dad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:23.993675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:23.994550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:23.994866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:23.995187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:23.997608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.004897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.005526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.005808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.006082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.006725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.008716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.080888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.083655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.100969 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1246/2494] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:24.102496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.104843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.121657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33b57-2eeb-4fe1-a055-c405fec3b885 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.128232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.130488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.130488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.130488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.130798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.133677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144857b1-ba1d-4199-a5b2-0d8a22901e75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.148890 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1247/2495] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:24.148890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.148890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.148890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.174866 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1249/2496] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:23 2022] POST /identity/v3/projects => generated 393 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:24.179900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.182896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.186875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:24.186875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.287647 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1248/2497] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:24.288387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.302071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ad9c3-86f3-4759-8f63-5b9d1320458c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.312654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.316792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.316792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.324877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] PATH_INFO: `/v3/projects/607346d5cd14420f930647ff1ecdb94d/users/63589f909a744bf1afec7d1f2e659f8a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.342276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0637194-5457-4dbd-acfb-882e837e6b57 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.357118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.364778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.364778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.364778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/b511d2a2d3664660a8fcc8720322a0bb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.364778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b511d2a2d3664660a8fcc8720322a0bb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.365457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.367389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607346d5cd14420f930647ff1ecdb94d, user_id=63589f909a744bf1afec7d1f2e659f8a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.370611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.540232 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1249/2498] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:24 2022] PUT /identity/v3/projects/607346d5cd14420f930647ff1ecdb94d/users/63589f909a744bf1afec7d1f2e659f8a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:24.541224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.618992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b511d2a2d3664660a8fcc8720322a0bb', 'request_id': 'req-710d6bb3-9f75-459c-b9dd-1808c916a77d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:24.635641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b511d2a2d3664660a8fcc8720322a0bb', 'request_id': 'req-710d6bb3-9f75-459c-b9dd-1808c916a77d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:24.656261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed488fd-db0d-4ec5-a49c-50187188c7c2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.735102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.735553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.735835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.736446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.737458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.740358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c367e1-bded-4aa9-9a6c-f03041422505 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.777481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b511d2a2d3664660a8fcc8720322a0bb', 'request_id': 'req-710d6bb3-9f75-459c-b9dd-1808c916a77d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:24.798193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] The token cache is being invalidate because project b511d2a2d3664660a8fcc8720322a0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:24.798476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:24.799880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:24.802234 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1250/2499] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:24 2022] DELETE /identity/v3/projects/b511d2a2d3664660a8fcc8720322a0bb => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:24.808122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.809727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.886361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710d6bb3-9f75-459c-b9dd-1808c916a77d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:24.891933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:24.897630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1250/2500] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:24.897790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.897790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.897790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.898063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.898063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.898063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.898323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.915350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:24.917379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e3b29-8541-494b-a6fe-41b529d606b4 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:24.933074 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1251/2501] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:24.933074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7ebf-7f82-433a-937c-b99dd399755a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.933074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7ebf-7f82-433a-937c-b99dd399755a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.933074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e7ebf-7f82-433a-937c-b99dd399755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0e7e7ebf-7f82-433a-937c-b99dd399755a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:24.940520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:24.941561 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:24.943242 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1252/2502] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1253/2503] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:24.958897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:24.999993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] MFA Rules not processed for user `63589f909a744bf1afec7d1f2e659f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:25.001608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.011566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0407c4-cb5f-4531-ae8f-b8c9ba5b6b89 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.021777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.022446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.022725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.022996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.024840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.030476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.034950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:25.055523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1254/2504] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:25.056601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:25.060104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.147425 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1251/2505] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:25.148449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.174963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147edb3-8f0e-4aa6-867f-34f52e5aa1ef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.195869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.203926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.205942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.219472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.219847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.220230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] PATH_INFO: `/v3/projects/3d5db113d0f54d428c263c1631f577cc/users/bc06d014dd654ea4bc0c11c08067f625/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.263335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5db113d0f54d428c263c1631f577cc, user_id=bc06d014dd654ea4bc0c11c08067f625, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.267709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.334221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3585-3e74-4058-830a-418aed76576f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.340018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.340844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.341197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.341586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.343168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=03aa3a57c2b04d8ca26d6b56f9163aca)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.347759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629a9ba-ce9d-48e4-9605-6fa96e0bed2b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.347759 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1255/2506] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca => generated 375 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.359031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.359273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.359551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.392700 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1252/2507] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:25 2022] PUT /identity/v3/projects/3d5db113d0f54d428c263c1631f577cc/users/bc06d014dd654ea4bc0c11c08067f625/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:25.393230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] MFA Rules not processed for user `63589f909a744bf1afec7d1f2e659f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:25.394112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.394816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.564320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1256/2508] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:25.565416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.597401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6728bb-8304-4f05-9510-4682a0349555 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.611463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.611858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.612129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.612414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.613123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:25.613433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.615876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.646176 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1253/2509] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:25.647374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.655484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.766573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303660-212c-4003-90fa-6ade1aa0b5cc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.787494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.788109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.788389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.788711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.789373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.792216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.815971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1257/2510] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:25.817163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.817398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa99c-74f2-4efc-aa59-0b0b084bb48b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.828155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.829246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.829628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.829842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85261d6a-e4b9-46e3-ab5a-ab616bb83c08 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.830361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.836715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.837330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.837692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.837991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.838649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.840814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.841395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.843080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:25.854718 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1254/2511] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:25.855513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:25.862237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:25.884526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4dec-452f-471d-ba8e-f09c5653a5da service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:25.890152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:25.890811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:25.891825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:25.891825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] PATH_INFO: `/v3/projects/d5ea39ff6a764b3d8c3dd063e4cafef5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:25.892878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ea39ff6a764b3d8c3dd063e4cafef5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:25.895097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.023204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1258/2512] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:25 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:26.024299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.088820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ea39ff6a764b3d8c3dd063e4cafef5', 'request_id': 'req-a4564642-a9c3-46b5-b53c-222fb013226a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.098406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ea39ff6a764b3d8c3dd063e4cafef5', 'request_id': 'req-a4564642-a9c3-46b5-b53c-222fb013226a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.101398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878cb68-bb01-4f99-aafa-4918ee122bd2 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.105496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ea39ff6a764b3d8c3dd063e4cafef5', 'request_id': 'req-a4564642-a9c3-46b5-b53c-222fb013226a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.195669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.199502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.200071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.200071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] PATH_INFO: `/v3/projects/3d5db113d0f54d428c263c1631f577cc/users/bc06d014dd654ea4bc0c11c08067f625/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.202117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5db113d0f54d428c263c1631f577cc, user_id=bc06d014dd654ea4bc0c11c08067f625, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.204912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] The token cache is being invalidate because project d5ea39ff6a764b3d8c3dd063e4cafef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:26.205392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.205497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.206817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.207797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1255/2513] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:25 2022] DELETE /identity/v3/projects/d5ea39ff6a764b3d8c3dd063e4cafef5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:26.209151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.211144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:26.221475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1259/2514] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:26 2022] PUT /identity/v3/projects/3d5db113d0f54d428c263c1631f577cc/users/bc06d014dd654ea4bc0c11c08067f625/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:26.222423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.224265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:26.310591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:26.352722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c865916-b98b-4d3a-a25b-cdd8f9afa450 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.363717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.365697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.365973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.366399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] PATH_INFO: `/v3/users/e451b81076cb4a8998fdc5f14d2983a6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.367659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e451b81076cb4a8998fdc5f14d2983a6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.370269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.400828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4564642-a9c3-46b5-b53c-222fb013226a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:26.514347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:26.522160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.522160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.522160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.522160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:26.522160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:26.522785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781e386-1190-43c4-8102-e4a183a6337b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:26.541970 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1256/2515] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:26.544657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2374a-d394-45d1-b215-1c66c2b8a5e9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.544657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2374a-d394-45d1-b215-1c66c2b8a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.545090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2374a-d394-45d1-b215-1c66c2b8a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.591676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8bc2374a-d394-45d1-b215-1c66c2b8a5e9 None None] MFA Rules not processed for user `bc06d014dd654ea4bc0c11c08067f625`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:26.593036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8bc2374a-d394-45d1-b215-1c66c2b8a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:26.665766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e451b81076cb4a8998fdc5f14d2983a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.694518 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1257/2516] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:26.699262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6016-6872-4db4-9580-f7bb17272c03 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.699262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6016-6872-4db4-9580-f7bb17272c03 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.699552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6016-6872-4db4-9580-f7bb17272c03 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.706733 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1258/2517] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:26.713475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:26.715468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:26.715468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:26.795825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] MFA Rules not processed for user `ebf0681a98044ce29352cc8abdaa69f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:26.801753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:26.835913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e451b81076cb4a8998fdc5f14d2983a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.856364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e451b81076cb4a8998fdc5f14d2983a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.865301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e451b81076cb4a8998fdc5f14d2983a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.868424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e451b81076cb4a8998fdc5f14d2983a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:26.905689 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1260/2518] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:26 2022] DELETE /identity/v3/users/e451b81076cb4a8998fdc5f14d2983a6 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:26.906692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:26.908168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:26.957278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1259/2519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:26.994573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:26.997455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:27.034030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:27.035463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:27.113678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1aba-f9ce-4a3b-b10a-d4d6450a9f23 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:27.137037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:27.137037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.137037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.137661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/a123ecce7cb24da7bf74256dc4847678` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.138710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=a123ecce7cb24da7bf74256dc4847678)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:27.141374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db92e4a-791b-4df7-a7a8-b7c4db54fe20 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:27.143763 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1261/2520] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/projects/a123ecce7cb24da7bf74256dc4847678 => generated 371 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:27.185641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190f75e-2e66-4cd6-8f3c-24c62c66286b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:27.200672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:27.201270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:27.201575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:27.201895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:27.206621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:27.329369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:27.331495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:27.345887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1260/2521] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:27.724808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:28.197833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165c6a-1cfa-419b-ac3d-0a91cc951dd5 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.198537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165c6a-1cfa-419b-ac3d-0a91cc951dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.199088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad165c6a-1cfa-419b-ac3d-0a91cc951dd5 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.201148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1262/2522] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:28.206477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:28.225240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.270959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c8504-30b6-4cda-a882-662c15e5a310 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.290766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.290766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.290766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.291105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/a123ecce7cb24da7bf74256dc4847678` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.294039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=a123ecce7cb24da7bf74256dc4847678)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.300924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.307210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1261/2523] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/projects/a123ecce7cb24da7bf74256dc4847678 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:28.406455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165c6a-1cfa-419b-ac3d-0a91cc951dd5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.435072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad165c6a-1cfa-419b-ac3d-0a91cc951dd5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.448049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.449844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.451683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.453112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.453921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:28.455865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.457776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.493668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.501127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1263/2524] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:28.505644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deda147-4ca4-4691-89a4-269799b431ce tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.511217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.511996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.512379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.512786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.513700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.519249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd12fb-354c-40f1-823d-8cc18a737ae5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.631384 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1262/2525] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:28 2022] POST /identity/v3/users => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:28.633354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.649399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d4ce0-f31f-4cbe-b52d-bbf06a8340a1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.679368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.680117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.680670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.681332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.683743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:28.684917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.691652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.744025 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1264/2526] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:28.793150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.793545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.793942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.796693 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1263/2527] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:28.806479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:28.850471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:28.876419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e94950-1911-4977-a464-aa6fdfd4250e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:28.888378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:28.889580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:28.890135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:28.890618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/a123ecce7cb24da7bf74256dc4847678` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:28.894781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=a123ecce7cb24da7bf74256dc4847678)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:28.898656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb3df4-134b-4c5a-901b-b7e724df4a95 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:28.904240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1265/2528] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:28 2022] GET /identity/v3/projects/a123ecce7cb24da7bf74256dc4847678 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:29.077155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:29.079020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:29.233970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305218a7-278b-4a88-b141-ec3e99fc740a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:29.254983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:29.256252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.256577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.256845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] PATH_INFO: `/v3/projects/0e1e35190c454171b0e3f312806d4ba7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.258112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1e35190c454171b0e3f312806d4ba7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:29.260518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:29.524447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1e35190c454171b0e3f312806d4ba7', 'request_id': 'req-095ce422-ac42-4dba-b6d4-93aebe9c466d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:29.533143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1e35190c454171b0e3f312806d4ba7', 'request_id': 'req-095ce422-ac42-4dba-b6d4-93aebe9c466d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:29.549676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1e35190c454171b0e3f312806d4ba7', 'request_id': 'req-095ce422-ac42-4dba-b6d4-93aebe9c466d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:29.661368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] The token cache is being invalidate because project 0e1e35190c454171b0e3f312806d4ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:29.662100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:29.663842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-095ce422-ac42-4dba-b6d4-93aebe9c466d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:29.666664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1264/2529] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:29 2022] DELETE /identity/v3/projects/0e1e35190c454171b0e3f312806d4ba7 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:29.675005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da79b-6c0e-40cf-a2d9-e91bd7f989c5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.675833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da79b-6c0e-40cf-a2d9-e91bd7f989c5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.677580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da79b-6c0e-40cf-a2d9-e91bd7f989c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.765082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5c4da79b-6c0e-40cf-a2d9-e91bd7f989c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:29.768642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5c4da79b-6c0e-40cf-a2d9-e91bd7f989c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:29.853013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.853544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.853994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.855773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1265/2530] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:29.863415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:29.866363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:29.917067 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1266/2531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:29.925925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:29.926216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:29.928735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:29.978723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:29.981460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:29.995752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1267/2532] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:30.001523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.041006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198cddc-3841-4a77-80a8-e529005a8178 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.045286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.047486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:30.050643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.052933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.056177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.056177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.056177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:30.056177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.063614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.082480 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1268/2533] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:30.087201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.099161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:30.104430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4545ac8-66fa-4dfc-9a51-f983c662d5d8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.122823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.123431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.124057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.126274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.127321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.130589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.175028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8d896-f55c-4531-a7e3-025c2f509afd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.203887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.203887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.203887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.204265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/a123ecce7cb24da7bf74256dc4847678` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.204265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=a123ecce7cb24da7bf74256dc4847678)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.204265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.204265 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1266/2534] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:29 2022] GET /identity/v3/projects/a123ecce7cb24da7bf74256dc4847678 => generated 371 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:30.260720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.280595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d659-dba6-427c-bee6-1c3333a93c45 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.289006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.289665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.289999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.290780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/users/3b7ce8dd3f39456190b984c1f3bcd934` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.310787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b7ce8dd3f39456190b984c1f3bcd934)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.312939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.371577 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1269/2535] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:30 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:30.371577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.507287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf95dd1-8e24-40dc-95ac-a67ad8b25578 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.538870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.539708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.539995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.540469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.541266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.543745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.616579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7ce8dd3f39456190b984c1f3bcd934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:30.694255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7ce8dd3f39456190b984c1f3bcd934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:30.740112 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1270/2536] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:30 2022] POST /identity/v3/users => generated 290 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:30.741237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.773006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7ce8dd3f39456190b984c1f3bcd934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:30.786437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a452f-c3c5-498d-a0a9-5b8d6e466f16 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.797976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7ce8dd3f39456190b984c1f3bcd934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:30.800170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.800170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.800170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.800743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7ce8dd3f39456190b984c1f3bcd934'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:30.801493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.804012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.806561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.814182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1267/2537] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:30 2022] DELETE /identity/v3/users/3b7ce8dd3f39456190b984c1f3bcd934 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:30.815238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.816832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:30.825030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1271/2538] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:30.830289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:30.832296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:30.871313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264fc42-9f3a-4022-95d3-67efe6f20b96 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.971715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd64659-21f1-4bee-b771-58848d65245e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:30.982101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.983241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.983742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.984417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/a123ecce7cb24da7bf74256dc4847678` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.985869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:30.986475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:30.986996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:30.987320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a123ecce7cb24da7bf74256dc4847678)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.987619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:30.988417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:30.990172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:30.991007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.006256 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1272/2539] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:31.020830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.047797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b0557-c3cd-41ef-9c71-c453941f5e29 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.054717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.055706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.056187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.056655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] PATH_INFO: `/v3/projects/2661419fee8c481faece16d1eca7f028/users/6721290bdc314f36b106d2eabdda3790/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.092829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2661419fee8c481faece16d1eca7f028, user_id=6721290bdc314f36b106d2eabdda3790, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:31.099225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e8e94-2d2f-4ff3-91ae-35a186342a93 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.246154 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1273/2540] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:31 2022] PUT /identity/v3/projects/2661419fee8c481faece16d1eca7f028/users/6721290bdc314f36b106d2eabdda3790/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:31.251902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.252340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.252753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.283018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a123ecce7cb24da7bf74256dc4847678', 'request_id': 'req-bb960fd6-cc4a-45b5-b843-342d54fbedad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:31.301443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:31.305826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.306252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a123ecce7cb24da7bf74256dc4847678', 'request_id': 'req-bb960fd6-cc4a-45b5-b843-342d54fbedad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:31.339999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a123ecce7cb24da7bf74256dc4847678', 'request_id': 'req-bb960fd6-cc4a-45b5-b843-342d54fbedad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:31.454843 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1274/2541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:31.480329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] The token cache is being invalidate because project a123ecce7cb24da7bf74256dc4847678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:31.480986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:31.481851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bb960fd6-cc4a-45b5-b843-342d54fbedad tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:31.483952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1268/2542] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:30 2022] DELETE /identity/v3/projects/a123ecce7cb24da7bf74256dc4847678 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:31.564771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.566566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.606127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.606824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.607288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.609059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1269/2543] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:38:31.631441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:31.635091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.751240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c1025-a5e4-422a-90e9-bf025d84aa55 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.758269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.759699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.760107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.761200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.765441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.786922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:31.789554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08879362-4c5f-4e69-ba37-4329e8a46582 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.814904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:31.815989 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1275/2544] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:31.816861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:31.940141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562f205-e143-4a8a-ac35-f88d2e9f5031 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:31.948361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:31.949196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:31.950398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:31.950769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:31.952270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=03aa3a57c2b04d8ca26d6b56f9163aca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:31.954590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:31.957076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1270/2545] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:31 2022] GET /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca => generated 375 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:32.352110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:32.562404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae537ba-621e-4240-ac7e-74759711c946 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.562688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae537ba-621e-4240-ac7e-74759711c946 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.562989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae537ba-621e-4240-ac7e-74759711c946 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.565132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1276/2546] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:32.570897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:32.572709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:32.603284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:32.634713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3302465-8e2a-4229-801c-0a3e2282d6a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:32.656548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:32.657189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:32.657471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:32.657745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:32.669019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=03aa3a57c2b04d8ca26d6b56f9163aca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:32.671129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:32.684591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1271/2547] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:32 2022] GET /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca => generated 375 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:35.329602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:35.358009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3deb8-e294-4d04-b991-fb23dbff3089 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.359158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3deb8-e294-4d04-b991-fb23dbff3089 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.359829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3deb8-e294-4d04-b991-fb23dbff3089 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.361441 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1277/2548] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:38:35.373134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:38:35.393460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:35.414729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa634d0a-5cdc-45bd-b17b-711ad595af9b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:35.422803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e72363a33764c93824167919cfdcebd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c68dadbbf96429ab5573202410f2c1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:35.423807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:35.424264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:35.424824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:35.426985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorizing `identity:get_project(project_id=03aa3a57c2b04d8ca26d6b56f9163aca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:35.429936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:35.433362 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1272/2549] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:38:35 2022] GET /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca => generated 375 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:37.617932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3deb8-e294-4d04-b991-fb23dbff3089 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:37.646997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3deb8-e294-4d04-b991-fb23dbff3089 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:37.660423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:37.662953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:37.663417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:37.664361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:37.669031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:37.795166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:37.797556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:37.821627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1278/2550] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:37 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:37.957756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:38.234934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:38.237880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:38.276234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c7358-9baf-4801-a229-4aaf8c89f83d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:38.282931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:38.284029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.284710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.285285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] PATH_INFO: `/v3/users/fd9a2cf92b094c54bdce2e0bf8903af3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.286803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9a2cf92b094c54bdce2e0bf8903af3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:38.291925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:38.621219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9a2cf92b094c54bdce2e0bf8903af3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:38.759369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:38.760970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:38.782654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa9bf1-a54e-4ab1-bbea-98e8c0475443 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:38.792140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:38.792140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.792140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.792140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] PATH_INFO: `/v3/users/4bf7acfa23724ceea7dbdfaf53309923` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.792545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf7acfa23724ceea7dbdfaf53309923)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:38.794144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:38.811547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9a2cf92b094c54bdce2e0bf8903af3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:38.832954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9a2cf92b094c54bdce2e0bf8903af3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:38.853583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9a2cf92b094c54bdce2e0bf8903af3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:38.854801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-03c37911-04bc-4acb-86ca-f81ef01d123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9a2cf92b094c54bdce2e0bf8903af3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:38.875389 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1273/2551] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:38 2022] DELETE /identity/v3/users/fd9a2cf92b094c54bdce2e0bf8903af3 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:38.877516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0137-eda9-45cc-b8b9-9f2ab04e163c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:38.877793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0137-eda9-45cc-b8b9-9f2ab04e163c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:38.878061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce0137-eda9-45cc-b8b9-9f2ab04e163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:38.969734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-32ce0137-eda9-45cc-b8b9-9f2ab04e163c None None] MFA Rules not processed for user `469e933c7f8042e48c20972431265685`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:38.971228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32ce0137-eda9-45cc-b8b9-9f2ab04e163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.123444 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1274/2552] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:39.125089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.126012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.127015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.154585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf7acfa23724ceea7dbdfaf53309923'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.180027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:39.184272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.248888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf7acfa23724ceea7dbdfaf53309923'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.276532 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1275/2553] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:39.277686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.280034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf7acfa23724ceea7dbdfaf53309923'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.281493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf7acfa23724ceea7dbdfaf53309923'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.282366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.283899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf7acfa23724ceea7dbdfaf53309923'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.312129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489e0f4-4811-4531-a4aa-bc7dd10bd7cb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.313411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1279/2554] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:38 2022] DELETE /identity/v3/users/4bf7acfa23724ceea7dbdfaf53309923 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:39.314661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.317172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.437740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.438596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.439523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.439523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] PATH_INFO: `/v3/users/9379cc116a1e4896b7df09dcfa75eb4f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.444822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9379cc116a1e4896b7df09dcfa75eb4f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.452383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.460966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0994-99e3-4bbf-acf5-f81c369c5552 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.468149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.469107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.469457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.469888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.471953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.595001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.597003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.640568 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1280/2555] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:39.641934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.650337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.732192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9379cc116a1e4896b7df09dcfa75eb4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.785649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49585b-933d-44b0-9ab7-8713457138ef service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:39.791880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:39.805342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.806134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.806638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.808900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.862774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:39.864596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fc9be-c9a6-46e2-9745-fc083e9127b8 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:39.877473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9379cc116a1e4896b7df09dcfa75eb4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.887727 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1281/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:39.887727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:39.887727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:39.888192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:39.900090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9379cc116a1e4896b7df09dcfa75eb4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.927387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9379cc116a1e4896b7df09dcfa75eb4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.929140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9379cc116a1e4896b7df09dcfa75eb4f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:39.936000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:39.940081 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1276/2557] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:39 2022] DELETE /identity/v3/users/9379cc116a1e4896b7df09dcfa75eb4f => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:39.942896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:39.968442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:39.969934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.090894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9493b-8ef9-498a-b1fd-d784cc890b02 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.096701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.097753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.098212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.098589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] PATH_INFO: `/v3/users/ddec067445d54223aa49c8a5ec9dea6b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.099929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddec067445d54223aa49c8a5ec9dea6b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.102868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.125132 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1282/2558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:40.137523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.139490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.232263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7a872-3eda-4a19-acef-6fe546c0c99a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.238650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.239438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.239895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.240158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.254873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.256596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe01a5c-e1cb-4c01-9a59-4ce651b3648a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.282564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1283/2559] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:40.372994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddec067445d54223aa49c8a5ec9dea6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:40.488287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddec067445d54223aa49c8a5ec9dea6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:40.516072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddec067445d54223aa49c8a5ec9dea6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:40.533823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddec067445d54223aa49c8a5ec9dea6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:40.537492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddec067445d54223aa49c8a5ec9dea6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:40.553151 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1277/2560] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:39 2022] DELETE /identity/v3/users/ddec067445d54223aa49c8a5ec9dea6b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:40.558871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788916-7e4b-4194-963f-08f637441365 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.559080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788916-7e4b-4194-963f-08f637441365 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.559247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c788916-7e4b-4194-963f-08f637441365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.599596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0c788916-7e4b-4194-963f-08f637441365 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:40.601281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0c788916-7e4b-4194-963f-08f637441365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.727753 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1284/2561] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:40.749172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.752280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.757601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788916-7e4b-4194-963f-08f637441365 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:40.759804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0c788916-7e4b-4194-963f-08f637441365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:40.786172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba70bf-f5ae-4d66-971e-1a1d085aefab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.795142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:40.809797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.810921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.811525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.812013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] PATH_INFO: `/v3/projects/57ab8b7723184d3e9eff5809eafffb20` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.822001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ab8b7723184d3e9eff5809eafffb20)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.829760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.899030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c788916-7e4b-4194-963f-08f637441365 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:40.912794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:40.913988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:40.914539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:40.915263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:40.936884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:40.942885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:40.969299 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1285/2562] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:41.058260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ab8b7723184d3e9eff5809eafffb20', 'request_id': 'req-53c12c4e-4a65-44d4-82f0-bf80041b1d85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.075931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ab8b7723184d3e9eff5809eafffb20', 'request_id': 'req-53c12c4e-4a65-44d4-82f0-bf80041b1d85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.091466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ab8b7723184d3e9eff5809eafffb20', 'request_id': 'req-53c12c4e-4a65-44d4-82f0-bf80041b1d85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.152042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:41.188358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] The token cache is being invalidate because project 57ab8b7723184d3e9eff5809eafffb20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:41.188718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.191470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.192674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1278/2563] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:40 2022] DELETE /identity/v3/projects/57ab8b7723184d3e9eff5809eafffb20 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:41.196932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.209541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf0153-ad19-4bc7-a2d6-8828ae8d0ffe service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.322867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:41.325476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:41.345388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.346043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.352417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.352417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] PATH_INFO: `/v3/users/cca7a2d46b204d7a9580267df3c8107c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.357611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca7a2d46b204d7a9580267df3c8107c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.366022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.498278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c12c4e-4a65-44d4-82f0-bf80041b1d85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:41.519909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:41.520901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:41.521363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:41.521809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] PATH_INFO: `/v3/projects/b2967018bbd64629a9a49c051c3d1e60` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:41.526373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2967018bbd64629a9a49c051c3d1e60)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:41.543993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:41.820961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca7a2d46b204d7a9580267df3c8107c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.836115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2967018bbd64629a9a49c051c3d1e60', 'request_id': 'req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.846504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2967018bbd64629a9a49c051c3d1e60', 'request_id': 'req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.854411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2967018bbd64629a9a49c051c3d1e60', 'request_id': 'req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.952049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca7a2d46b204d7a9580267df3c8107c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.991642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca7a2d46b204d7a9580267df3c8107c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.997127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca7a2d46b204d7a9580267df3c8107c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:41.999891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca7a2d46b204d7a9580267df3c8107c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.060152 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1286/2564] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:41 2022] DELETE /identity/v3/users/cca7a2d46b204d7a9580267df3c8107c => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:42.061532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.063406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.075815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] The token cache is being invalidate because project b2967018bbd64629a9a49c051c3d1e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:42.076218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.077690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.085772 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1279/2565] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:41 2022] DELETE /identity/v3/projects/b2967018bbd64629a9a49c051c3d1e60 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:42.087041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.096081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.190376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4e77d-f013-4313-bebf-3617754c15b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.200392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.201534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.202188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.205645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] PATH_INFO: `/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.205645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03aa3a57c2b04d8ca26d6b56f9163aca)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.212787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.265253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263eb22-2d96-49ac-88ea-1bd5f982d1d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.272592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.273954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.274464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.277318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] PATH_INFO: `/v3/projects/4eca4631088f4e8e9b23c9070680dbee` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.280888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eca4631088f4e8e9b23c9070680dbee)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.285819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.461708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03aa3a57c2b04d8ca26d6b56f9163aca', 'request_id': 'req-ddb20911-74fd-4180-904e-e7ead2949da6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.473102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03aa3a57c2b04d8ca26d6b56f9163aca', 'request_id': 'req-ddb20911-74fd-4180-904e-e7ead2949da6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.501319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eca4631088f4e8e9b23c9070680dbee', 'request_id': 'req-efa04469-1a7a-44fd-bc50-be30cf12c708'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.518559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eca4631088f4e8e9b23c9070680dbee', 'request_id': 'req-efa04469-1a7a-44fd-bc50-be30cf12c708'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.536819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eca4631088f4e8e9b23c9070680dbee', 'request_id': 'req-efa04469-1a7a-44fd-bc50-be30cf12c708'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.547222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03aa3a57c2b04d8ca26d6b56f9163aca', 'request_id': 'req-ddb20911-74fd-4180-904e-e7ead2949da6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.570093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] The token cache is being invalidate because project 03aa3a57c2b04d8ca26d6b56f9163aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:42.570388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.571129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.576153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1287/2566] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:42 2022] DELETE /identity/v3/projects/03aa3a57c2b04d8ca26d6b56f9163aca => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:42.584825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.585585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.639625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] The token cache is being invalidate because project 4eca4631088f4e8e9b23c9070680dbee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:42.640557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.641804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:42.647870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1280/2567] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:42 2022] DELETE /identity/v3/projects/4eca4631088f4e8e9b23c9070680dbee => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:42.647870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:42.651062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:42.809730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20911-74fd-4180-904e-e7ead2949da6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.814608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.815265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.815557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.815810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] PATH_INFO: `/v3/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.817855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7ae91cc1a34bfcab5a04fd57e8a2c2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.819998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:42.831828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa04469-1a7a-44fd-bc50-be30cf12c708 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:42.848375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:42.849059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:42.849328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:42.849595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] PATH_INFO: `/v3/users/3e72363a33764c93824167919cfdcebd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:42.850981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e72363a33764c93824167919cfdcebd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:42.858496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.063439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7ae91cc1a34bfcab5a04fd57e8a2c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.171487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7ae91cc1a34bfcab5a04fd57e8a2c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.196654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7ae91cc1a34bfcab5a04fd57e8a2c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.198693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7ae91cc1a34bfcab5a04fd57e8a2c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.201476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7ae91cc1a34bfcab5a04fd57e8a2c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.202014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e72363a33764c93824167919cfdcebd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.219969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1288/2568] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:42 2022] DELETE /identity/v3/users/8f7ae91cc1a34bfcab5a04fd57e8a2c2 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:43.225126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.225126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:43.331591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e72363a33764c93824167919cfdcebd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.345991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596950d-6882-4ffc-9c40-e66f9269068d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.359275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.360746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.365579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.365579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] PATH_INFO: `/v3/users/8dfd2e823db74fa08afa6bfce904abe7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.365579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dfd2e823db74fa08afa6bfce904abe7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.365913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.366592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e72363a33764c93824167919cfdcebd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.388736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e72363a33764c93824167919cfdcebd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.391395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e72363a33764c93824167919cfdcebd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.406521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1281/2569] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:42 2022] DELETE /identity/v3/users/3e72363a33764c93824167919cfdcebd => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:43.407901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.410649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:43.561220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4c990-9b8f-4138-9106-54711e5b5958 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:43.561220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:43.561220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:43.561220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:43.561928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] PATH_INFO: `/v3/projects/b32522c2fe384c72abb75d027338cbea` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:43.561928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32522c2fe384c72abb75d027338cbea)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:43.561928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:43.710646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dfd2e823db74fa08afa6bfce904abe7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.743446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32522c2fe384c72abb75d027338cbea', 'request_id': 'req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.750800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32522c2fe384c72abb75d027338cbea', 'request_id': 'req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.757792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32522c2fe384c72abb75d027338cbea', 'request_id': 'req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.840760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dfd2e823db74fa08afa6bfce904abe7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.868469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dfd2e823db74fa08afa6bfce904abe7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.882448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dfd2e823db74fa08afa6bfce904abe7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.882448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dfd2e823db74fa08afa6bfce904abe7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.906167 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1289/2570] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:43 2022] DELETE /identity/v3/users/8dfd2e823db74fa08afa6bfce904abe7 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:43.909733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:43.912527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:43.991251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] The token cache is being invalidate because project b32522c2fe384c72abb75d027338cbea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:43.991760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.996079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3d742306-f366-4ff9-bcb6-00bf6bbb1f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:43.999103 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1282/2571] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:43 2022] DELETE /identity/v3/projects/b32522c2fe384c72abb75d027338cbea => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:44.005721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716de0-06d1-47ca-880a-fbd7bea77a57 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.006905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716de0-06d1-47ca-880a-fbd7bea77a57 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.008722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8716de0-06d1-47ca-880a-fbd7bea77a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.052668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb8064-4b88-4ead-8d22-636ec8b559ac admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.058607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b8716de0-06d1-47ca-880a-fbd7bea77a57 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:44.060348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b8716de0-06d1-47ca-880a-fbd7bea77a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.064640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.068570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.070407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.070800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] PATH_INFO: `/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.080356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d4fa85f0fc497f96bf3533a0b98c1f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.087430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.100736 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1283/2572] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:44.114161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.114161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.114161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.163065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:44.171492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:44.180748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.194991 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1284/2573] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:44.198915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.212796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32274e-0d1f-4ee5-bfff-0da224661a44 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.218744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.219626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.220058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.220558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.221519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:44.222002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.224146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.245597 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1285/2574] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:44.250362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.282056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fedac5-08d6-4a13-b4df-5eb4eefc238c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.314038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d4fa85f0fc497f96bf3533a0b98c1f', 'request_id': 'req-09cffc17-20ca-4cac-879a-d683f8694841'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:44.330006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d4fa85f0fc497f96bf3533a0b98c1f', 'request_id': 'req-09cffc17-20ca-4cac-879a-d683f8694841'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:44.397741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.399032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.399520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.400025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.400992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.403396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.491877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d4fa85f0fc497f96bf3533a0b98c1f', 'request_id': 'req-09cffc17-20ca-4cac-879a-d683f8694841'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:44.527421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] The token cache is being invalidate because project f6d4fa85f0fc497f96bf3533a0b98c1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:44.527421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:44.528268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-09cffc17-20ca-4cac-879a-d683f8694841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:44.531384 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1290/2575] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:43 2022] DELETE /identity/v3/projects/f6d4fa85f0fc497f96bf3533a0b98c1f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:44.537153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8857-6ce5-40f3-adb9-15315ad5069e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.537809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8857-6ce5-40f3-adb9-15315ad5069e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.539643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8857-6ce5-40f3-adb9-15315ad5069e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.571475 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1286/2576] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/projects => generated 357 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:38:44.573514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.577503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.590579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a9fd8857-6ce5-40f3-adb9-15315ad5069e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:44.590579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a9fd8857-6ce5-40f3-adb9-15315ad5069e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.731082 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1291/2577] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:44.732855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.733247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.733513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.749451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143471a1-203f-4322-8703-5a16254c4f90 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.762164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:44.763036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.763884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.764441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.765144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.767288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.768377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.771959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.779555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1292/2578] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:44.781013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.799564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddf0e6-7929-4461-ae12-adb9e307ac9e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.807028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.807728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.808081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.808427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.809199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:44.809575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.811619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.831024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1293/2579] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:38:44.832190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.844252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff13c6-5fba-4d17-a59f-8e613d194fb6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.859908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.860619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.860955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.861300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.862005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.865102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.881920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1287/2580] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/users => generated 279 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:44.883196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.896533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cd5e0-26cb-4182-86d3-9714d994e102 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.904748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.905107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.905388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.905646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.907055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.908716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:44.936154 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1288/2581] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:44.937447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:44.940167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:44.970107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa425a-fa6c-4ea8-b44f-ba1c19482b29 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:44.976999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:44.977943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:44.978973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:44.979470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] PATH_INFO: `/v3/projects/3c68dadbbf96429ab5573202410f2c1c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:44.982206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c68dadbbf96429ab5573202410f2c1c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:44.985618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:45.039385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1294/2582] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:44 2022] POST /identity/v3/projects => generated 391 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:45.040085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.120528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33cdd-120b-4eb0-897d-0b81765a561d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:45.129248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:45.129715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.130095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.130603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.131951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:45.133398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:45.157766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c68dadbbf96429ab5573202410f2c1c', 'request_id': 'req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.158110 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1295/2583] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:45.159090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.168990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c68dadbbf96429ab5573202410f2c1c', 'request_id': 'req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.176790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c68dadbbf96429ab5573202410f2c1c', 'request_id': 'req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.176985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375b947-f8c4-4d92-a138-4b809cdbb8ab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:45.333922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:45.335259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.336437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.336767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.337429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:45.339543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:45.382709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] The token cache is being invalidate because project 3c68dadbbf96429ab5573202410f2c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:45.383251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.384801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.387523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1289/2584] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:44 2022] DELETE /identity/v3/projects/3c68dadbbf96429ab5573202410f2c1c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:45.389129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.392911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.412891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ce29a-f72f-4356-b531-89b9c9aad1ff admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:45.423479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:45.424318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.426547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.426547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] PATH_INFO: `/v3/projects/201931a0ea82441badea06ffb7a025aa/users/b86f4cf64ef84b79b249b83eff8a728b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.459905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=201931a0ea82441badea06ffb7a025aa, user_id=b86f4cf64ef84b79b249b83eff8a728b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:45.463654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f88ed5-3bef-4428-986e-92bf5521a0ec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:45.577509 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1296/2585] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:45 2022] POST /identity/v3/users => generated 296 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:45.578886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.586765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.603138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336554d-28f6-4aec-9969-2ce5ede84912 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:45.616220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:45.616220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.616220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.616220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] PATH_INFO: `/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.616724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=746d0f899f0245c1b6b97e3ea6f0d93e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:45.616724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:45.648966 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1290/2586] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:45 2022] PUT /identity/v3/projects/201931a0ea82441badea06ffb7a025aa/users/b86f4cf64ef84b79b249b83eff8a728b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:45.659283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.659592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.659821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:45.690641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:45.694045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.789856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746d0f899f0245c1b6b97e3ea6f0d93e', 'request_id': 'req-a6fd9143-0b10-4192-9174-a1da48c72175'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.796890 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1291/2587] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:45.797874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:45.803726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:45.808110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746d0f899f0245c1b6b97e3ea6f0d93e', 'request_id': 'req-a6fd9143-0b10-4192-9174-a1da48c72175'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.835336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4646448-aa17-4baf-8627-c85320d20253 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:45.914252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746d0f899f0245c1b6b97e3ea6f0d93e', 'request_id': 'req-a6fd9143-0b10-4192-9174-a1da48c72175'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.935812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] The token cache is being invalidate because project 746d0f899f0245c1b6b97e3ea6f0d93e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:45.938115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.942185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6fd9143-0b10-4192-9174-a1da48c72175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:45.950047 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1297/2588] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:45 2022] DELETE /identity/v3/projects/746d0f899f0245c1b6b97e3ea6f0d93e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:45.954856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:45.955314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:45.955418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.049496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.052348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.052723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.053003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.053718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.055922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23b2a-259c-4b37-bd84-7f886c3b1c3e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.059051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] MFA Rules not processed for user `b86f4cf64ef84b79b249b83eff8a728b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:46.060667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.080948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1292/2589] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:46.087161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd89a8-c3fb-4e15-acbe-e440c6b9d28b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.087616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd89a8-c3fb-4e15-acbe-e440c6b9d28b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.087752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd89a8-c3fb-4e15-acbe-e440c6b9d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.133841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-54cd89a8-c3fb-4e15-acbe-e440c6b9d28b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:46.135123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54cd89a8-c3fb-4e15-acbe-e440c6b9d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.143877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:46.182579 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1293/2590] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:46.188182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.188182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.188182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.222376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:46.223731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.229569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1298/2591] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:46.234156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.234156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.244424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1294/2592] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:46.246118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.252101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dc36f-db73-451c-b11a-699153428cc5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.265507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.266381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.266956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.267324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.268098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.270053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.274062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b14622-e992-4123-88e1-7f74f6e90e05 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.291173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.292295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.297828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.297828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.297828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:46.297828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.298388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1299/2593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:46.298388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.301943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.302358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bb964-9d2c-4f43-8768-4a617edc8411 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.329109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ca03f-aba7-47c8-b285-b1e9609dcfdc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.331545 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1295/2594] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.333631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.337099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.337548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.341769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.342640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.343197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.343713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.348297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.352731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.371977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:46.373754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:46.391876 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1296/2595] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:46.394916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.409202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583b36f-c6e1-4a0a-b452-0c341260b5fa None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.435709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.435709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.435709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.435709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] PATH_INFO: `/v3/projects/f97dff96032f4f2193acabe74c8b69bd/users/480ecf0ebd274b5aa533822f4672dd00/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.478233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97dff96032f4f2193acabe74c8b69bd, user_id=480ecf0ebd274b5aa533822f4672dd00, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.482146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.546377 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1300/2596] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:46.546377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.648838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1297/2597] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:46 2022] PUT /identity/v3/projects/f97dff96032f4f2193acabe74c8b69bd/users/480ecf0ebd274b5aa533822f4672dd00/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:46.650172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.718569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c449e74-c5d1-442f-b664-06a5139f49ad admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.834956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79ac2f-8af9-456c-99e3-fbf18c24648a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.841810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.842383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.842506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.842745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.842950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.843285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.843569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.843684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.844131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.844563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:46.844915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.845746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6a75d-6488-49bd-83bb-1598976b6099 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.854363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.897949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1298/2598] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:46.899083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:46.911902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436abeb-b959-4b5f-810e-4cd57ffe7fa8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:46.925305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:46.926505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.928669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.928669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:46.928669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:46.930509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623ee07-f062-47b5-985a-a9a5b18e5be0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:46.982566 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1301/2599] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/projects => generated 383 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:46.984099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:46.984544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:46.984679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.046285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:47.048426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.118016 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1299/2600] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:47.119610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.119894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.120164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.178285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:47.181514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.216072 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1302/2601] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:47.216986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.232591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e23a16-7905-472d-b0ca-247060f6ea8b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.258832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.259557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.259843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.261322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.262088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.275504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.376972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1300/2602] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:47.376972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.388720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9d8e1-42f4-461b-b20e-d30ccc3f39e1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.400858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.401958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.402306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.402592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.403292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.407720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.462548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1303/2603] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:47.462548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.544289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1301/2604] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:47.545307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.551467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.587322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d9504-eab3-4f11-a8d7-47a8f5198c65 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.601243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.602223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.602635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.602910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.603908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.609078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48776665-d1ef-4559-8c7f-723f3754e16b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.629216 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1304/2605] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:47.629726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:47.630821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.631111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.631382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.683189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:47.684470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:47.719589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa86edb-0299-45aa-8153-505a34760666 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.841371 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1305/2606] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:47.844112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.849846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.850557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.850931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.851559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.880818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a34bf8-7f4d-4dca-8898-21d3b277a21c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.882213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.893898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.895520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.896296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.896847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.897321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.898162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.901191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:47.924608 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1302/2607] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:47.926103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:47.947502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16aaf72-22c6-4674-aea0-8975fe8261ed service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:47.977435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:47.978221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:47.978347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:47.979055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:47.979288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:47.981104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.012533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1303/2608] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:48.015585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.030234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28bd1d-4482-4afc-9fc3-c290df13ecf7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.053211 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1306/2609] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:47 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:48.054446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.063998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.063998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.063998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.063998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] PATH_INFO: `/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd/users/5c3b56341f6147abbb62ec701bac0623/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.085823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319adf8-0216-45a9-b905-acc402255044 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.087723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac023f65a8dd4d1d8011df8a8906b2fd, user_id=5c3b56341f6147abbb62ec701bac0623, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.093149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.103801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.104457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.104772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.105584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.106274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.107948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.138413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1307/2610] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:48.141537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.143659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:48.215099 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1304/2611] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:48 2022] PUT /identity/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd/users/5c3b56341f6147abbb62ec701bac0623/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:48.216363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.371157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeea05-fa0b-40f5-a749-8f94462ebef3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.392167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14d029-8e05-4887-b755-ca91ec9c52b9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.400764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.440777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1305/2612] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:48.443268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.454081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88e81f-e4b5-47c4-9546-f52af267d917 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.493007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.493007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.493007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.493007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] PATH_INFO: `/v3/projects/cdd844366c7343be97d0911ff5c05ba4/users/7f1602f439f64597ae371c084e7faed0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.494264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd844366c7343be97d0911ff5c05ba4, user_id=7f1602f439f64597ae371c084e7faed0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.495401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52928b6c-db4f-4232-9e6e-e794a031b258 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.529042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.529737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.529919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.530226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.606062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.608404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.638767 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1308/2613] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:48.639491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.651973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40d548-3b2e-4fa0-9515-4768b7df1364 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.661973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.662091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.662560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.662879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.663532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.665435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.678845 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1309/2614] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:48.680127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.697314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc741780-5d9f-491a-8f0d-4f0644258de1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.700135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.701147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.701604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.702082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.703188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.705677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.726666 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1310/2615] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:48.728135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.742190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166349-0b1f-4bbe-a92b-4a87d0788227 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.748419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:48.749535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.750047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.750543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] PATH_INFO: `/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd/users/5c3b56341f6147abbb62ec701bac0623/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.753185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac023f65a8dd4d1d8011df8a8906b2fd, user_id=5c3b56341f6147abbb62ec701bac0623, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:48.756774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:48.792513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1311/2616] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:48 2022] PUT /identity/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd/users/5c3b56341f6147abbb62ec701bac0623/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:48.794448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:48.864776 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1306/2617] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:48 2022] PUT /identity/v3/projects/cdd844366c7343be97d0911ff5c05ba4/users/7f1602f439f64597ae371c084e7faed0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:48.885562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4693d-0a5d-4514-a4eb-72b022bb20d1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:48.891815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4693d-0a5d-4514-a4eb-72b022bb20d1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:48.892637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4693d-0a5d-4514-a4eb-72b022bb20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:48.958817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c564c870-a43a-4f45-9e48-3206159b0ca4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:48.986142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-04f4693d-0a5d-4514-a4eb-72b022bb20d1 None None] MFA Rules not processed for user `5c3b56341f6147abbb62ec701bac0623`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:48.988014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04f4693d-0a5d-4514-a4eb-72b022bb20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:49.070449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.071132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.071414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.071690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] PATH_INFO: `/v3/projects/b8ee21f74a1d415f9f42599927a503d8/users/da4d37ab3d0b40d59bdba72582fa86ad/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.107288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ee21f74a1d415f9f42599927a503d8, user_id=da4d37ab3d0b40d59bdba72582fa86ad, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.117177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe09a0b-8963-4447-ae0b-4e44bbac2592 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.117177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:49.142534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1307/2618] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:49.145288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627183-995f-4e2f-bfbe-97e0ccf9a427 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.145585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627183-995f-4e2f-bfbe-97e0ccf9a427 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.145865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d627183-995f-4e2f-bfbe-97e0ccf9a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.201106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8d627183-995f-4e2f-bfbe-97e0ccf9a427 None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:49.202430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8d627183-995f-4e2f-bfbe-97e0ccf9a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:49.216469 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1312/2619] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:48 2022] PUT /identity/v3/projects/b8ee21f74a1d415f9f42599927a503d8/users/da4d37ab3d0b40d59bdba72582fa86ad/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:49.217989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6613f-0fd2-4b10-93dd-a5925a36d133 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.220163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6613f-0fd2-4b10-93dd-a5925a36d133 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.220163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6613f-0fd2-4b10-93dd-a5925a36d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-f6e6613f-0fd2-4b10-93dd-a5925a36d133 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:49.235850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:49.237498 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:49.257947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1313/2620] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:49.263828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.263828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.263828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.331308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] MFA Rules not processed for user `da4d37ab3d0b40d59bdba72582fa86ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:49.333641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:49.373241 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1308/2621] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:49.375242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.375712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.376151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.427389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:49.429814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:49.497629 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1314/2622] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:49.498645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.614004 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1309/2623] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:49.616062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.660186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d344db7d-7c6f-422e-b9f7-5bdcafa1689c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.668818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.669675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.670229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.670642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.742826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932fb42c-12a7-431b-aec1-92fe2f529128 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.758793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.759831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.760464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.761534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.761922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.764339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.803073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.805519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.823010 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1315/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:49.823923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.836603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640f316-4d62-43ae-a0d4-2f36f333dd73 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:49.844788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:49.845424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:49.845701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:49.846307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:49.846991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:49.850159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:49.918727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1310/2625] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:49.923054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:49.930937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:49.984274 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1316/2626] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:49.986182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.104528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbe59b-a13c-419d-9442-763430e06f8e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.104923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e21a5-7bb1-4c99-823a-375e4f5dcfe7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.119638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.121388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.122123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.122617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] PATH_INFO: `/v3/users/469e933c7f8042e48c20972431265685` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.123273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.124014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.124381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.124694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=469e933c7f8042e48c20972431265685)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.125295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.126133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.129901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.130075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.276015 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1317/2627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:49 2022] POST /identity/v3/users => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:50.276877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.289847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d201-00ac-4605-8744-165bd1fe28e9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.295848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.296956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.297518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.297968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.299034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.301529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.483970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469e933c7f8042e48c20972431265685'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:50.549293 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1318/2628] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:50 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:50.550279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.563500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010894c-a0e8-4712-9d38-52f811580b73 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.577044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.577518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.577925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.578266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.579046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.580912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e519d-9d0f-4051-908d-4a40ab0ba3db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.588461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469e933c7f8042e48c20972431265685'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:50.596378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1319/2629] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:50.596378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.596378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.596378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:50.604095 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:50.605620 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:50.606996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469e933c7f8042e48c20972431265685'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:50.623176 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1320/2630] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:50.623176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.635616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469e933c7f8042e48c20972431265685'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:50.635616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469e933c7f8042e48c20972431265685'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:50.648896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.651227 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1311/2631] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:49 2022] DELETE /identity/v3/users/469e933c7f8042e48c20972431265685 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:50.652282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.658407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:50.786790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff6bd1-f78a-4515-89f5-25641cf4ec2b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.792768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.793557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.793857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.794156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] PATH_INFO: `/v3/users/b86f4cf64ef84b79b249b83eff8a728b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.795863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86f4cf64ef84b79b249b83eff8a728b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.797646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.798768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.799311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.799681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.800085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.801343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.805080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:50.824614 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1312/2632] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:50.829352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:50.833845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:50.949932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d3dd5-b9f3-4551-8b43-344158ab405c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:50.957410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:50.958192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:50.958476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:50.958809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] PATH_INFO: `/v3/projects/8d329267d391470f91c0e06b8d838ede/users/14813a5cf87b4979abafa9e8459f5d1d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:50.983293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d329267d391470f91c0e06b8d838ede, user_id=14813a5cf87b4979abafa9e8459f5d1d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:50.983293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2a3b66-87e5-4fc7-bd9e-05752ed55eb2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.058733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86f4cf64ef84b79b249b83eff8a728b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.076782 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1313/2633] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:50 2022] PUT /identity/v3/projects/8d329267d391470f91c0e06b8d838ede/users/14813a5cf87b4979abafa9e8459f5d1d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:51.078200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.078491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.078774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.101126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:51.102677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.169605 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1314/2634] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:51.171203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.195348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86f4cf64ef84b79b249b83eff8a728b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.240244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86f4cf64ef84b79b249b83eff8a728b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.241820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86f4cf64ef84b79b249b83eff8a728b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.244282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86f4cf64ef84b79b249b83eff8a728b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.265683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1321/2635] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:50 2022] DELETE /identity/v3/users/b86f4cf64ef84b79b249b83eff8a728b => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:51.267237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.269448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.295635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab630a-a53a-44a2-baea-2cc92fa6c6fe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.373468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:51.439438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.440375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.440741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.441017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] PATH_INFO: `/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8/users/43e8d04980604c4586f89b32e4c5ee1b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.464415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41ac92e9fa3441caca183e1b5e5bab8, user_id=43e8d04980604c4586f89b32e4c5ee1b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.465322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d919f-7059-44ca-8686-1d08b54a8e3b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.467466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.471388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.474917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.474917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.474917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] PATH_INFO: `/v3/projects/0303fb8fa1924311b8b0c54f77aab51e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.474917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0303fb8fa1924311b8b0c54f77aab51e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.477967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.616960 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1315/2636] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:51 2022] PUT /identity/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8/users/43e8d04980604c4586f89b32e4c5ee1b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:51.623971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.623971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.641491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0303fb8fa1924311b8b0c54f77aab51e', 'request_id': 'req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.651432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0303fb8fa1924311b8b0c54f77aab51e', 'request_id': 'req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.721481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa98e1-2482-4c87-992e-6af840bcd70f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.760780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0303fb8fa1924311b8b0c54f77aab51e', 'request_id': 'req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.777972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] The token cache is being invalidate because project 0303fb8fa1924311b8b0c54f77aab51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:51.778350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.779302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b90b87da-7d80-4e24-9cb4-74ce8a6effbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:51.783955 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1322/2637] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:51 2022] DELETE /identity/v3/projects/0303fb8fa1924311b8b0c54f77aab51e => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:51.789436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d3cc-f34c-4aa4-af5a-f4609f3cbbb0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.789876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d3cc-f34c-4aa4-af5a-f4609f3cbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.790524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d3cc-f34c-4aa4-af5a-f4609f3cbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.817567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.818210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.830819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.830819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.831653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.833341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-65b5d3cc-f34c-4aa4-af5a-f4609f3cbbb0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:51.835170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-65b5d3cc-f34c-4aa4-af5a-f4609f3cbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.838972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc50f-ac67-4084-9b2b-426abc4f68ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.845654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1323/2638] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:51.847957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.848584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.849139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:51.857823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:51.858772 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:51.874926 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1324/2639] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:51.891521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.911993 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1316/2640] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:51.912772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.913158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.913158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.913158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.919908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03b4f0-f191-4ae1-9034-d69db613def7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:51.934058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:51.934883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:51.935164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:51.935442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:51.937270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:51.942602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:51.960868 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1325/2641] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:51.960868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:51.965267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:51.985150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:51.986201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.004528 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1317/2642] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:52.005814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.009943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.037668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136e089-9cb4-46d7-96b5-0f850fccb295 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.057677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.057677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.057677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.057677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] PATH_INFO: `/v3/projects/8d329267d391470f91c0e06b8d838ede/users/14813a5cf87b4979abafa9e8459f5d1d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.059910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d329267d391470f91c0e06b8d838ede, user_id=14813a5cf87b4979abafa9e8459f5d1d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.074675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad394c3-b474-4ec8-9b47-ce30709e7a36 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.104186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1318/2643] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:52 2022] PUT /identity/v3/projects/8d329267d391470f91c0e06b8d838ede/users/14813a5cf87b4979abafa9e8459f5d1d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:52.106993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb2bff-c541-47fc-8d9d-55de7da46e97 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.108682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb2bff-c541-47fc-8d9d-55de7da46e97 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.112583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb2bff-c541-47fc-8d9d-55de7da46e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.148044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06706d1a-fe4a-48bd-aa9e-e3383ff1499d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.182960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:52.246457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.247600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.248225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.248786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.300834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bdfb2bff-c541-47fc-8d9d-55de7da46e97 None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:52.302552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdfb2bff-c541-47fc-8d9d-55de7da46e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.353852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.356385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.383305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1326/2644] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:52.384358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.415508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfef11-a5d0-4031-a39e-38612754d20b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.430836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.431522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.432728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.434650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] PATH_INFO: `/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8/users/43e8d04980604c4586f89b32e4c5ee1b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.444405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41ac92e9fa3441caca183e1b5e5bab8, user_id=43e8d04980604c4586f89b32e4c5ee1b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.448440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bd5f9-3ce0-4447-9d3c-880a6dc6ab5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.452359 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1319/2645] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:52.454737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7acc-94ad-4a09-9ed3-9a517606821d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.455220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7acc-94ad-4a09-9ed3-9a517606821d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.457567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf7acc-94ad-4a09-9ed3-9a517606821d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.501689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6dcf7acc-94ad-4a09-9ed3-9a517606821d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:52.502946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6dcf7acc-94ad-4a09-9ed3-9a517606821d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.511473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1327/2646] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:52 2022] PUT /identity/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8/users/43e8d04980604c4586f89b32e4c5ee1b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:52.528269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.528666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.528832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.635574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] MFA Rules not processed for user `14813a5cf87b4979abafa9e8459f5d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:52.640782 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1320/2647] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:52.640782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64c34-85c6-4f59-b5e1-038f55b5d799 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.640782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64c34-85c6-4f59-b5e1-038f55b5d799 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.640782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b64c34-85c6-4f59-b5e1-038f55b5d799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.645679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.709167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-40b64c34-85c6-4f59-b5e1-038f55b5d799 None None] MFA Rules not processed for user `43e8d04980604c4586f89b32e4c5ee1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:52.711752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-40b64c34-85c6-4f59-b5e1-038f55b5d799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:52.811783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:52.823791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1328/2648] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:52.839880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:52.900390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2672f0-d600-4105-bbde-3c0ba5f7c7b1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:52.904815 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1321/2649] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:52.919173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.919446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.919715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.929216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:52.934075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:52.934358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:52.937168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:52.940397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:52.940397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:52.950991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1ced9-5357-425d-9979-739b9a8d3c1c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:52.970174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:52.973902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.000023 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1329/2650] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:53.000023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eaac-4b42-4a13-9936-88c80732b069 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.000023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eaac-4b42-4a13-9936-88c80732b069 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.000444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eaac-4b42-4a13-9936-88c80732b069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.072099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f416eaac-4b42-4a13-9936-88c80732b069 None None] MFA Rules not processed for user `da4d37ab3d0b40d59bdba72582fa86ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:53.078630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f416eaac-4b42-4a13-9936-88c80732b069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.181013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1322/2651] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:53.183905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.211618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6d839-2710-41e8-82cd-455362b6eb95 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.243038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:53.244134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.254954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.255456 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1330/2652] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:53.259582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.259582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.259582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.260308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.261349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:53.265100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d9ecd-909a-41f2-9ee7-2b978646addc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:53.271894 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:53.276622 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:53.281060 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1331/2653] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:53.282892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.283183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.283455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.389673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:53.411305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.495506 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1323/2654] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/projects => generated 361 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:53.502781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.502781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.502969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.584360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:53.585823 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1332/2655] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:53.586783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.588262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.588684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.682283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:53.747029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d09b50-42e8-4e54-a3f2-ab101cb3e029 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.757415 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1324/2656] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:53.758815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:53.763440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.892860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:53.893675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.893937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.894243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.896591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:53.961305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0fdefe-d5a8-4fa6-bfcd-6836719b28ac None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:53.970127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:53.970813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:53.971140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:53.987230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:53.987230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.012683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.015026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.034657 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1333/2657] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:54.036462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.095143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.103143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.115080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1325/2658] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:38:54.116359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.118407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.247178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e176016-8bb4-4697-a34f-6dbf50ac7b51 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.249960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:54.259038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.260594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.263682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.263936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada403a-324e-4b3a-a763-76f30b63877f service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.264381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] PATH_INFO: `/v3/projects/201931a0ea82441badea06ffb7a025aa` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.271823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] RBAC: Authorizing `identity:delete_project(project_id=201931a0ea82441badea06ffb7a025aa)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.276448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.277460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.278108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.278801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.280047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.280296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.283128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.486607 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1334/2659] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:54 2022] POST /identity/v3/users => generated 281 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:54.486607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.490987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.508287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201931a0ea82441badea06ffb7a025aa', 'request_id': 'req-7f31a137-e847-41c6-8247-02eff130067d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:54.540635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201931a0ea82441badea06ffb7a025aa', 'request_id': 'req-7f31a137-e847-41c6-8247-02eff130067d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:54.549651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201931a0ea82441badea06ffb7a025aa', 'request_id': 'req-7f31a137-e847-41c6-8247-02eff130067d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:54.632429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390695f-f85e-4e70-8eac-e61dad5ea920 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.669822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] The token cache is being invalidate because project 201931a0ea82441badea06ffb7a025aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:54.670155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:54.673299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:54.678192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1326/2660] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:54 2022] DELETE /identity/v3/projects/201931a0ea82441badea06ffb7a025aa => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:54.679062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.685849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.737272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.739182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.739795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.740323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.742793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.888316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.891089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.914824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a137-e847-41c6-8247-02eff130067d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:54.918538 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1335/2661] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:54.921339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:54.926006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:54.931731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:54.946315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:54.946315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:54.946315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:54.946315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:54.946315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:54.985774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a010cb1-120d-4277-9395-bf92f35878ba service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:55.002115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1327/2662] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:55.007040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:55.007497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:55.008146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.008425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.008870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] PATH_INFO: `/v3/users/5c3b56341f6147abbb62ec701bac0623` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.011646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3b56341f6147abbb62ec701bac0623)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:55.013992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:55.079084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac43687-d4dc-42ed-a692-1773bfb1ac90 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:55.095191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:55.096123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.096399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.096699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.098525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:55.100320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:55.128368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1328/2663] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:55.131290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:55.169072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a7817-0ec9-4fc5-b39a-8e5f8c2458e1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:55.186731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:55.187865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.188150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.188425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] PATH_INFO: `/v3/projects/f997097916c44a939314da9f0ff7ed2a/users/0072f1f3084144b5b12b9b96744ad955/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.237911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f997097916c44a939314da9f0ff7ed2a, user_id=0072f1f3084144b5b12b9b96744ad955, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:55.244761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d0730-8de4-4557-8a52-104b1dbcef7d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:55.298727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3b56341f6147abbb62ec701bac0623'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:55.342444 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1329/2664] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:55 2022] PUT /identity/v3/projects/f997097916c44a939314da9f0ff7ed2a/users/0072f1f3084144b5b12b9b96744ad955/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:55.354881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.355237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.355546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.431794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] MFA Rules not processed for user `0072f1f3084144b5b12b9b96744ad955`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:55.437893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:55.447842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3b56341f6147abbb62ec701bac0623'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:55.493131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3b56341f6147abbb62ec701bac0623'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:55.495349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3b56341f6147abbb62ec701bac0623'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:55.497771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9be4bce-e3b1-4b37-8c3a-da854303af6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3b56341f6147abbb62ec701bac0623'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:55.580645 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1336/2665] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:54 2022] DELETE /identity/v3/users/5c3b56341f6147abbb62ec701bac0623 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:55.663494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:55.717289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.717569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.717844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:55.725707 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:55.726754 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:38:55.735106 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1337/2666] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:55 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:55.763892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1330/2667] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:38:55.854860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:55.855079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:55.855297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:55.893653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:55.966347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:55.967764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:56.072680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.074382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:56.243026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1338/2668] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:56.355323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfcc7c-3f82-464e-bcb0-8f2179380817 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:56.642220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:56.642877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:56.643156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:56.643426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:56.888955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:56.896280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5691a-868b-4033-801d-7c9affd64e0b service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:56.897966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:56.899721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:56.964164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1331/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 892 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:57.055811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.056256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.056721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:57.065228 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:57.066284 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:38:57.079608 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1332/2670] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:57.086411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:57.107732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:57.232919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b5b76-56e8-42ef-b53a-8c00560294d2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.244841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.245624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.245907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.247306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] PATH_INFO: `/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.252445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac023f65a8dd4d1d8011df8a8906b2fd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.256199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.345595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:57.352381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:57.353755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.354058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.354470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] PATH_INFO: `/v3/users/0072f1f3084144b5b12b9b96744ad955` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.356711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0072f1f3084144b5b12b9b96744ad955)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:57.359388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:57.536437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac023f65a8dd4d1d8011df8a8906b2fd', 'request_id': 'req-26956101-6d3e-4d16-8af3-9dd96000d5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.562336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac023f65a8dd4d1d8011df8a8906b2fd', 'request_id': 'req-26956101-6d3e-4d16-8af3-9dd96000d5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.637740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0072f1f3084144b5b12b9b96744ad955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.715524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac023f65a8dd4d1d8011df8a8906b2fd', 'request_id': 'req-26956101-6d3e-4d16-8af3-9dd96000d5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.767900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] The token cache is being invalidate because project ac023f65a8dd4d1d8011df8a8906b2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:38:57.768544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.769726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26956101-6d3e-4d16-8af3-9dd96000d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.773209 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1339/2671] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:56 2022] DELETE /identity/v3/projects/ac023f65a8dd4d1d8011df8a8906b2fd => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:38:57.774413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f31e-5574-4a01-bedc-3b9d40bc2fa2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.774642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f31e-5574-4a01-bedc-3b9d40bc2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.774913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f31e-5574-4a01-bedc-3b9d40bc2fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.785729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0072f1f3084144b5b12b9b96744ad955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.827023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0fd8f31e-5574-4a01-bedc-3b9d40bc2fa2 None None] MFA Rules not processed for user `6721290bdc314f36b106d2eabdda3790`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:57.829051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0fd8f31e-5574-4a01-bedc-3b9d40bc2fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:57.829759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0072f1f3084144b5b12b9b96744ad955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.854905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0072f1f3084144b5b12b9b96744ad955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.856090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-805c65fe-629c-4cf3-a1dc-a233fdea9fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0072f1f3084144b5b12b9b96744ad955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:38:57.875711 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1333/2672] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:38:57 2022] DELETE /identity/v3/users/0072f1f3084144b5b12b9b96744ad955 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:57.877533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b73a-0b43-4bbd-8e70-28aaa993a24b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.879481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b73a-0b43-4bbd-8e70-28aaa993a24b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.880890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5b73a-0b43-4bbd-8e70-28aaa993a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:57.905979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:57.917554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2db5b73a-0b43-4bbd-8e70-28aaa993a24b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:57.919888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2db5b73a-0b43-4bbd-8e70-28aaa993a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:57.958707 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1340/2673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:57.961330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:57.961800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:57.962459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.001675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:58.004155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:58.110467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1334/2674] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:58.120208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.120993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.121445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.182435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:58.184939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:58.212289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1335/2675] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:58.214651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.225016 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1341/2676] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:58.248167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.254374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2be53-c1a5-4de1-b1ce-859830bcbf07 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.254565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:58.262085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.267983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.268362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.268669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.269909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:38:58.270211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.277464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.303464 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1336/2677] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:38:58.305964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.326693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7a8d3-4fb2-47d9-8cde-cb0dbe99ce23 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.333267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.334011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.334425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.335003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.335724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.338654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd39b-fcc4-4807-911c-7790d2ba23c9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.356753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:58.460163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23cfb3-2aa0-49cb-a8f0-bc4c9a3f093f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.475516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.476385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.477555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.477917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.501455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.504701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:58.529731 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1337/2678] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:58.531458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.532841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.533359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.552789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1342/2679] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:38:58.561421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:38:58.561581 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:38:58.562418 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:38:58.565066 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1338/2680] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:38:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 34 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:38:58.596881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caaf42-dd09-4721-b12f-7ce83dad5e0f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:58.748056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:58.751656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:58.751843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:58.752126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:58.752905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:58.801007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.056543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1343/2681] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:38:58 2022] POST /identity/v3/users => generated 288 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:38:59.060371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.107637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63808bd7-e381-450b-9b70-13c2a87c85e9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.117833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.118796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.119321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.120942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.121751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.125156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.165072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.165297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1339/2682] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:59.179000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00189483-3fa6-4551-91ea-aea1be01e2fa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.198425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.199080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.199365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.199642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.200322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.202203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcc1b4-3fd6-45d8-a7c7-fce09d171f15 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.232092 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1344/2683] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:38:59.237048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.248154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d536-fed4-4c42-9cd2-adb1432bba3d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.256876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.257991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.258361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.258734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] PATH_INFO: `/v3/projects/287f494c255c4d53a179d907b43d017c/users/d610253efc4940c1bbb1f009a1399951/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.312116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287f494c255c4d53a179d907b43d017c, user_id=d610253efc4940c1bbb1f009a1399951, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.316852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:38:59.481143 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1340/2684] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:38:59 2022] PUT /identity/v3/projects/287f494c255c4d53a179d907b43d017c/users/d610253efc4940c1bbb1f009a1399951/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:38:59.486503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.487093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.487093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.593623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] MFA Rules not processed for user `d610253efc4940c1bbb1f009a1399951`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:38:59.594918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:38:59.600341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:59.775016 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1345/2685] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:38:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:38:59.779370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:38:59.967414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae0804-7745-4111-9bf0-f7e43c1cebf7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:38:59.986196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:38:59.987113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:38:59.987579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:38:59.989278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:38:59.991174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:38:59.998540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:00.118716 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1341/2686] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:00.123220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:00.140001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c46c54-f0fc-460f-9530-edc91b455607 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:00.239399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:00.240750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:00.242237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:00.242722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:00.246845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:00.255965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:00.363711 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1346/2687] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:00 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:00.367406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:00.384735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9577f3-16e6-4b32-97a6-b711ae257724 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:00.397377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:00.402929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:00.402929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:00.402929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:00.402929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:00.402929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:00.432214 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1342/2688] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:39:00.433598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:00.454350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b128239-74e9-4dcd-9fff-fdab9914b666 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:00.461987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:00.463384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:00.464158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:00.464861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] PATH_INFO: `/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef/users/e98f13a5458b4cfc874fe60af56fd5fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:00.501621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd0374335d5467d9bb1675f8c4bfaef, user_id=e98f13a5458b4cfc874fe60af56fd5fd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:00.506294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:00.645503 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1347/2689] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:00 2022] PUT /identity/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef/users/e98f13a5458b4cfc874fe60af56fd5fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:00.650534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:00.666304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733c8a3-84cd-44f6-9a59-eb1a89ed8f93 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:00.769311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:00.855618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:00.856253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:00.856572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:00.856838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:00.857490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:00.859106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa0f28-a341-4976-bad2-24f99ca20efb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:00.884616 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1343/2690] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:39:00.889290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:00.924012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7c3d-bb3e-4977-81c5-bb98a8e68807 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:00.960482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:00.963034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:00.964502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:00.965133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] PATH_INFO: `/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef/users/e98f13a5458b4cfc874fe60af56fd5fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:00.970850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd0374335d5467d9bb1675f8c4bfaef, user_id=e98f13a5458b4cfc874fe60af56fd5fd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:00.975572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:01.001821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1348/2691] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:00 2022] PUT /identity/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef/users/e98f13a5458b4cfc874fe60af56fd5fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:01.015038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.015939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.016582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.083242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] MFA Rules not processed for user `e98f13a5458b4cfc874fe60af56fd5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:01.086140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:01.090700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:01.093198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:01.355637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ab54e-b849-493b-83b0-d13900912e41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:01.368562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:01.371245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.379769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.380386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] PATH_INFO: `/v3/projects/f997097916c44a939314da9f0ff7ed2a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.382239 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1344/2692] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:01.384013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f997097916c44a939314da9f0ff7ed2a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:01.384269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:01.391838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:01.431189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf78b4d-d74c-4eb7-b968-44746f1e676e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:01.444827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:01.447524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.448324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.449367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.451237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:01.453910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:01.456189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:01.491438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:01.492163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1345/2693] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:01.493863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:01.520667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24261b30-4f26-4aba-9868-2f99f6ce6e04 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:01.529319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:01.530237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.530767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.532277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.533240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:01.539529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:01.619048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f997097916c44a939314da9f0ff7ed2a', 'request_id': 'req-37f51b67-d053-4a68-94e9-c625fe590f97'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:01.627123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f997097916c44a939314da9f0ff7ed2a', 'request_id': 'req-37f51b67-d053-4a68-94e9-c625fe590f97'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:01.692802 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1346/2694] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:01 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:01.694402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:01.794907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f997097916c44a939314da9f0ff7ed2a', 'request_id': 'req-37f51b67-d053-4a68-94e9-c625fe590f97'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:01.812635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] The token cache is being invalidate because project f997097916c44a939314da9f0ff7ed2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:01.812915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:01.813642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-37f51b67-d053-4a68-94e9-c625fe590f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:01.821135 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1349/2695] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:01 2022] DELETE /identity/v3/projects/f997097916c44a939314da9f0ff7ed2a => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:01.821135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.821135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.821135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.890237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] MFA Rules not processed for user `480ecf0ebd274b5aa533822f4672dd00`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:01.898344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:01.903424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14660ea9-b617-4d5a-aa00-219939179ac8 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:01.912017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:01.912686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.913023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.913509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.914187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:01.914496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:01.917378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42141d78-a406-4a8f-aedd-8430569ec542 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:01.937790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1347/2696] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:01.937790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:01.937790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:01.937790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:01.962202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:01.963758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.048169 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1350/2697] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:02.049101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.054786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.127439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1348/2698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:02.129271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.140527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.276757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba564af7-82aa-4ea4-95ab-04beb2e7ab1b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.284023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.293020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.293020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.293020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.299276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.320457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.322307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde543e1-088b-4160-9df3-bb0994335dff service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.339613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1351/2699] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:02.341700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc3131-1a15-4c96-a32c-426b6110f955 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.344791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc3131-1a15-4c96-a32c-426b6110f955 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.344791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc3131-1a15-4c96-a32c-426b6110f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.345427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83df742-848e-47a1-a4d9-435d00d5ff0e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.367877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.368705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.368993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.369269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.389399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-24dc3131-1a15-4c96-a32c-426b6110f955 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:02.391690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-24dc3131-1a15-4c96-a32c-426b6110f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:02.392127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.394928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.403030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1352/2700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:02.404789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3e99-ca6d-41a1-811d-103c9b9ecdbd None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.405309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3e99-ca6d-41a1-811d-103c9b9ecdbd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.406276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a3e99-ca6d-41a1-811d-103c9b9ecdbd None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.409305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1353/2701] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:02.411081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a3e99-ca6d-41a1-811d-103c9b9ecdbd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.422592 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1349/2702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:02.426199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:39:02.433653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a3e99-ca6d-41a1-811d-103c9b9ecdbd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.442169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.442169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.442169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.442768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.444019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:02.444644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.451496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.457290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.476442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1354/2703] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:02.480965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.491942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa40b2-d26e-4f63-9865-704201090e9f service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.500610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe34a05-502b-4283-9c49-b177b7c1c600 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.502643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.503701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.503990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.504271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects/601d393c87754946839c535642f5e064` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.505854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:get_project(project_id=601d393c87754946839c535642f5e064)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.516365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.516365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1350/2704] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:39:02 2022] GET /identity/v3/projects/601d393c87754946839c535642f5e064 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:02.516606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.516606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.516606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.516606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.516968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.519378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:02.695280 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1355/2705] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:02.705130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:02.718631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f560a1-d1f4-4aed-aa55-e12a6562218a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:02.823789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:02.824587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:02.824723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:02.824991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:02.825633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:02.832710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.001687 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1351/2706] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:02 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:03.007252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.023685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af722e0-af53-476b-80cd-909ffa08b017 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.033266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.034016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.034394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.034772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.035513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.037512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.058301 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1356/2707] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:03.058667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.077090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a2ca6-6240-4cbf-9074-2219ff9f2724 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.084906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.085544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.085826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.086099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.086750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.088367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6db82-e6ec-4cc4-8453-c785680e6baa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.114542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:03.127107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.145229 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1352/2708] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:03.147375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb7bee9-1285-4025-b243-5dd34de3d0e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.163077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.164776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.171990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.171990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] PATH_INFO: `/v3/projects/f871d4dccfa64340ae699fe84bb10a79/users/99582f1c239d4209a1909c5a849de953/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.218164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f871d4dccfa64340ae699fe84bb10a79, user_id=99582f1c239d4209a1909c5a849de953, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.221184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab135-2662-4590-b998-0b6cbc408cf9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.311906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1357/2709] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:03 2022] PUT /identity/v3/projects/f871d4dccfa64340ae699fe84bb10a79/users/99582f1c239d4209a1909c5a849de953/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:03.317814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.318424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.319014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.359490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.359781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.360059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.361505 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1358/2710] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:39:03.383636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:03.397353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:03.397736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:39:03.649242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:03.684763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1353/2711] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:03.728246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.729832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:03.761368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.872678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523db469-ba56-4715-bf86-9284adf7a335 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.879014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.879657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.880360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.880669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.894517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a265-366c-45e0-b2e6-9191a05409a5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.900653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.902377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.902662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.902953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:03.903225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects/601d393c87754946839c535642f5e064` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:03.903622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.904593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:get_project(project_id=601d393c87754946839c535642f5e064)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:03.908624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:03.912383 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1359/2712] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/projects/601d393c87754946839c535642f5e064 => generated 371 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:39:03.933413 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1354/2713] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:39:03.977533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:03.992646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a269d-eb20-4dac-aa92-2889e22eec40 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:03.998863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:03.999493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:03.999776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:04.000053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:04.000763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:04.001072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:04.002737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:04.021727 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1360/2714] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:04.025697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:04.049122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326be8af-dd4b-4644-9af2-2a3ec0462912 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:04.060029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:04.064624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:04.065152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:04.065587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:04.068084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:04.073542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402bcd0-0d0b-4f63-93b3-fe2245e98ad0 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:04.395977 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1355/2715] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:04 2022] POST /identity/v3/users => generated 383 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:04.397899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:04.424829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324922fa-5871-4da9-957c-6d311bab18cb tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:04.470561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:04.476094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:04.482253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:04.482933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:04.484250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:04.484912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:04.499055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:04.565313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1361/2716] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:05.150224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615426-b533-4909-8019-82f3ce7dcea8 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:05.151135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615426-b533-4909-8019-82f3ce7dcea8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:05.151568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5615426-b533-4909-8019-82f3ce7dcea8 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:05.153757 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1356/2717] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:05.158668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:39:05.180299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:05.219535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86038b-8694-462f-b392-4092821a1f35 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:05.235208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:05.235871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:05.236151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:05.238969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects/601d393c87754946839c535642f5e064` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:05.245140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:get_project(project_id=601d393c87754946839c535642f5e064)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:05.247920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:05.251226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1362/2718] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:39:05 2022] GET /identity/v3/projects/601d393c87754946839c535642f5e064 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:05.767412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d799f-9529-42a7-a1d4-6833eaabadf5 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:05.767693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d799f-9529-42a7-a1d4-6833eaabadf5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:05.767970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d799f-9529-42a7-a1d4-6833eaabadf5 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:05.769648 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1357/2719] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:39:05.777571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:39:05.798018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:05.821484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d6806-a6e0-4941-be86-f3d827e21a3d tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:05.830536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:05.831626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:05.832129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:05.832689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects/601d393c87754946839c535642f5e064` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:05.834478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:get_project(project_id=601d393c87754946839c535642f5e064)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:05.837232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:05.840772 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1363/2720] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:39:05 2022] GET /identity/v3/projects/601d393c87754946839c535642f5e064 => generated 371 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:05.888546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d799f-9529-42a7-a1d4-6833eaabadf5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:05.913257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d799f-9529-42a7-a1d4-6833eaabadf5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:05.925159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:05.926149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:05.926594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:05.927040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/users/1e45a631b48045f18178bd56e24c4d09` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:05.960170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1e45a631b48045f18178bd56e24c4d09)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:05.963437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:06.169876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e45a631b48045f18178bd56e24c4d09'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.194684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:06.256969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e45a631b48045f18178bd56e24c4d09'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.280435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e45a631b48045f18178bd56e24c4d09'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.301610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e45a631b48045f18178bd56e24c4d09'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.307496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e45a631b48045f18178bd56e24c4d09'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.320985 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1358/2721] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:05 2022] DELETE /identity/v3/users/1e45a631b48045f18178bd56e24c4d09 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:06.324920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.328346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:06.354624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92e98e-2f5a-42df-b413-1a8252393a93 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:06.476523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98f13a5458b4cfc874fe60af56fd5fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5dd0374335d5467d9bb1675f8c4bfaef', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:06.477448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:06.477887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:06.478403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] PATH_INFO: `/v3/projects/601d393c87754946839c535642f5e064` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:06.479799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorizing `identity:delete_project(project_id=601d393c87754946839c535642f5e064)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:06.483578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:06.728462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:06.745906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '601d393c87754946839c535642f5e064', 'request_id': 'req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.760455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '601d393c87754946839c535642f5e064', 'request_id': 'req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.860365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '601d393c87754946839c535642f5e064', 'request_id': 'req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.886807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] The token cache is being invalidate because project 601d393c87754946839c535642f5e064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:06.887412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.888619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ece8424-881b-40e7-9f7f-d55c1a68d9c1 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:06.890351 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1364/2722] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:06 2022] DELETE /identity/v3/projects/601d393c87754946839c535642f5e064 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:06.896916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:06.898776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:07.031469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0852847-fbc3-4078-b676-a95d837e150a tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:07.155679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:07.157635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.159040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.163312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] PATH_INFO: `/v3/users/d610253efc4940c1bbb1f009a1399951` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.167096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d610253efc4940c1bbb1f009a1399951)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:07.171371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:07.290267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:07.659686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd610253efc4940c1bbb1f009a1399951'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:07.837522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd610253efc4940c1bbb1f009a1399951'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:07.870911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd610253efc4940c1bbb1f009a1399951'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:07.912310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd610253efc4940c1bbb1f009a1399951'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:07.916635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd610253efc4940c1bbb1f009a1399951'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:07.933329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1359/2723] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:06 2022] DELETE /identity/v3/users/d610253efc4940c1bbb1f009a1399951 => generated 0 bytes in 1038 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:07.939833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:07.941127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:07.941127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:07.984922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:07.984922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:08.166220 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1365/2724] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:08.184533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.186620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:08.234819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:08.238168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:08.269134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824adfdb-556a-4957-b2b0-180c469d6349 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.282747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.283615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.289309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.290011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] PATH_INFO: `/v3/users/6721290bdc314f36b106d2eabdda3790` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.294674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6721290bdc314f36b106d2eabdda3790)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.301095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.323426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badcaf-cb0d-4da4-aa3e-1be4d4a37fee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:08.331819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:08.332762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:08.333277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:08.333721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:08.358884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:08.363610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:08.397921 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1360/2725] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:39:08.616308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6721290bdc314f36b106d2eabdda3790'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:08.744760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6721290bdc314f36b106d2eabdda3790'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:08.772875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6721290bdc314f36b106d2eabdda3790'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:08.774474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6721290bdc314f36b106d2eabdda3790'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:08.775203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6721290bdc314f36b106d2eabdda3790'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:08.800755 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1366/2726] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:08 2022] DELETE /identity/v3/users/6721290bdc314f36b106d2eabdda3790 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:09.841652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:09.853521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3a1c9-c6f5-4449-b970-8eb6868c3051 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:09.926127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:09.986834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:09.987697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:09.987981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:09.988260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] PATH_INFO: `/v3/projects/2661419fee8c481faece16d1eca7f028` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:09.996929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2661419fee8c481faece16d1eca7f028)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:09.999166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.047641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.050542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:10.088392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6461a3-6cdf-4ff3-a512-105f84ddac66 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.104709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.107427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.107427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.107427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] PATH_INFO: `/v3/projects/287f494c255c4d53a179d907b43d017c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.108762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=287f494c255c4d53a179d907b43d017c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.111639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.197699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2661419fee8c481faece16d1eca7f028', 'request_id': 'req-c53d1336-26ee-4c0f-be94-0cc347801860'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.216798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2661419fee8c481faece16d1eca7f028', 'request_id': 'req-c53d1336-26ee-4c0f-be94-0cc347801860'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.235420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2661419fee8c481faece16d1eca7f028', 'request_id': 'req-c53d1336-26ee-4c0f-be94-0cc347801860'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.347691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287f494c255c4d53a179d907b43d017c', 'request_id': 'req-21255430-028e-4a30-9cdf-fdcef4996e4f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.353331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] The token cache is being invalidate because project 2661419fee8c481faece16d1eca7f028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:10.354593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.356476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c53d1336-26ee-4c0f-be94-0cc347801860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.358905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1361/2727] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:09 2022] DELETE /identity/v3/projects/2661419fee8c481faece16d1eca7f028 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:10.363790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287f494c255c4d53a179d907b43d017c', 'request_id': 'req-21255430-028e-4a30-9cdf-fdcef4996e4f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.364902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e61efd-a593-4692-be74-880494a39ed4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.365404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e61efd-a593-4692-be74-880494a39ed4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.365840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e61efd-a593-4692-be74-880494a39ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.404907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b9e61efd-a593-4692-be74-880494a39ed4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:10.407300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b9e61efd-a593-4692-be74-880494a39ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:10.526082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287f494c255c4d53a179d907b43d017c', 'request_id': 'req-21255430-028e-4a30-9cdf-fdcef4996e4f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.563252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] The token cache is being invalidate because project 287f494c255c4d53a179d907b43d017c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:10.563956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.564927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:10.571395 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1367/2728] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:10 2022] DELETE /identity/v3/projects/287f494c255c4d53a179d907b43d017c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:10.572711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.577075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:10.578900 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1362/2729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:10.580447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.582689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.582970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.601431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21255430-028e-4a30-9cdf-fdcef4996e4f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.611576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.616201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.616201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.616201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] PATH_INFO: `/v3/users/e98f13a5458b4cfc874fe60af56fd5fd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.616201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e98f13a5458b4cfc874fe60af56fd5fd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.617703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.637728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:10.639031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:10.692380 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1363/2730] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:10.693606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.715916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d55d0-ab1c-4b26-af22-3256ce52f8a6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.730829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.731717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.731994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.732265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.732957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:10.733262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.741094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:10.777394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1364/2731] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:10.778953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:10.796721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02cf82-5a1a-4026-83f2-6b808eef4d6b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:10.812880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:10.813575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:10.813860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:10.814129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:10.814828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:10.816934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.039127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e98f13a5458b4cfc874fe60af56fd5fd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:11.061258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:11.070851 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1365/2732] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:10 2022] POST /identity/v3/projects => generated 391 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:11.075010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.188613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e98f13a5458b4cfc874fe60af56fd5fd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:11.213609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e98f13a5458b4cfc874fe60af56fd5fd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:11.214656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e98f13a5458b4cfc874fe60af56fd5fd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:11.215517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e98f13a5458b4cfc874fe60af56fd5fd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:11.232504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675aec80-bac2-4e2b-a056-ae77bfb423c2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.239950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.240619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.241120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.241495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.242976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.245147 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1368/2733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:10 2022] DELETE /identity/v3/users/e98f13a5458b4cfc874fe60af56fd5fd => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:11.251912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.359509 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1366/2734] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:11 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:11.364150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.366459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:11.549064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867648-8229-468e-998a-0a2a5a11c01b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.567600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.568589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.569034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.569476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.570308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.577119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.601590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1369/2735] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:11.606305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.639568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d961b-a383-40e0-b110-d291faaab1eb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.671296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.672088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.672393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.672758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.678909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.678909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92267bf-d6c9-41aa-bfd1-b233ad353154 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.700902 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1367/2736] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:11.705097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:11.723359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263044e1-2039-4a85-ad6b-e085e32d0949 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:11.737998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:11.738980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.739420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.739896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] PATH_INFO: `/v3/projects/39d655a565644746a2d466d88fa00f02/users/b276ebf583404e61b5f57e00f11caa0f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:11.773793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d655a565644746a2d466d88fa00f02, user_id=b276ebf583404e61b5f57e00f11caa0f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:11.776855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:11.946927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1370/2737] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:11 2022] PUT /identity/v3/projects/39d655a565644746a2d466d88fa00f02/users/b276ebf583404e61b5f57e00f11caa0f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:11.952881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:11.953477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:11.953941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.031205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:12.034756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:12.124850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:12.202036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:12.239554 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1368/2738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:12.335400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.338353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:12.503640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718d96c-a103-4c27-a4ee-d49b7ea3426d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.526445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.527473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.527963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.528464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.545600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.547828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654b5b6-26a7-431a-81af-5551d4c59e15 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:12.568420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1371/2739] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:12.839724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:12.841369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:12.867374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588ad24-fca1-4c8b-8132-f61dcdfc0ff7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:12.913918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:12.913918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:12.913918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:12.913918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] PATH_INFO: `/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:12.914396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd0374335d5467d9bb1675f8c4bfaef)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:12.914396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:13.114162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:13.230817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd0374335d5467d9bb1675f8c4bfaef', 'request_id': 'req-351e51a4-ad13-4c0c-ab08-dd9630fd123a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:13.270236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd0374335d5467d9bb1675f8c4bfaef', 'request_id': 'req-351e51a4-ad13-4c0c-ab08-dd9630fd123a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:13.287398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd0374335d5467d9bb1675f8c4bfaef', 'request_id': 'req-351e51a4-ad13-4c0c-ab08-dd9630fd123a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:13.664654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] The token cache is being invalidate because project 5dd0374335d5467d9bb1675f8c4bfaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:13.665231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:13.671317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-351e51a4-ad13-4c0c-ab08-dd9630fd123a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:13.671317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1369/2740] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:12 2022] DELETE /identity/v3/projects/5dd0374335d5467d9bb1675f8c4bfaef => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:39:13.674838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.676368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.677598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:13.720855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:13.726629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:13.903823 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1372/2741] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:13.982372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:13.983124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:13.983631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.029840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:14.037866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:14.064101 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1370/2742] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:14.069370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.082972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd35d2-599c-406b-9e2f-e5bf186bf2df None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.113413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.117166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.121519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.122718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.125550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:14.131945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.141943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.212998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1373/2743] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:14.214029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.229218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c305ed5-6703-4c64-871e-029ca042f116 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.239130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.241098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.242321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.242807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.244374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.248024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbff72fd-998d-4fd9-a92a-28c4e19fbc23 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.402767 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1371/2744] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:14 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:39:14.404434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.422752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e84ee-eb9e-4277-9e48-6368d2f8dfc8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.609390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.610470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.610757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.613585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.614343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.616346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.651208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:14.758337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.758836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.759378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.775167 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1374/2745] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:14 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:14.777034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.801481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86e030-71c1-4d85-8bdc-5b421bbcf8e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.822751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.822751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.822751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.822751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.823217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.823217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.860934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1375/2746] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:14.861925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.885530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b3e11-1140-485b-aeb5-1810c09aa7f0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.887806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:14.894711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:14.917487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.918126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:14.918443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:14.921207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:14.921207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:14.921207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:14.955847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1376/2747] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:14.960701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:14.983823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc5db2-619a-46eb-89a5-86e83c4a9a42 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:14.997112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:14.998187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.001424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.001424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] PATH_INFO: `/v3/projects/d4fefce7b59b4135ab03a518f381e171/users/10f57760d0b5468b91c7b9666305dba9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.051605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4fefce7b59b4135ab03a518f381e171, user_id=10f57760d0b5468b91c7b9666305dba9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.058674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9223764-0b4e-456c-ae83-41d26e80f624 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.090263 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1372/2748] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:39:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:15.131340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.131340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:15.208526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1377/2749] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:14 2022] PUT /identity/v3/projects/d4fefce7b59b4135ab03a518f381e171/users/10f57760d0b5468b91c7b9666305dba9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:15.222007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.222861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.223488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.292749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] MFA Rules not processed for user `10f57760d0b5468b91c7b9666305dba9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:15.301309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:15.395696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0cdc7-36d0-4c60-8110-3c59a2dbf866 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:15.496107 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1378/2750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:15.501780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:15.560869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:15.561532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:15.561830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:15.562102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:15.724182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:15.729924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:15.747294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1373/2751] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:15.870905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:15.986625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c095e-9c99-490d-ba42-d5ecc823d52e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.023444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.024804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.025516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.026217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.027653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.038695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.291113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1379/2752] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:15 2022] POST /identity/v3/projects => generated 393 bytes in 790 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:16.291414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.340321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d2078-e5b8-4cbe-8990-601fe93cc988 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:16.653849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:16.666559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:16.666559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:16.667471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:16.668453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:16.682342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:16.897655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1374/2753] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:16 2022] POST /identity/v3/users => generated 303 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:39:16.903712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:16.985950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605944e3-a19e-4a0c-8ffa-4cec233c8862 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.017739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.027058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.027058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.027058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.027058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.029943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.124815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1380/2754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:17.131058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.204908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e9888-b69d-4410-9c55-e9dfd7048137 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.260842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.261483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.261767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.262059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] PATH_INFO: `/v3/projects/6bd5c1f330104d60bfb991a53869a000/users/151f362ff88343c6b140c49366d88954/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.319779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd5c1f330104d60bfb991a53869a000, user_id=151f362ff88343c6b140c49366d88954, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.323463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.495979 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1375/2755] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:17 2022] PUT /identity/v3/projects/6bd5c1f330104d60bfb991a53869a000/users/151f362ff88343c6b140c49366d88954/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:17.501525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.530833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a120c3-a167-4f82-a4eb-b7c5515278c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.772654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:17.781837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.782803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.783273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.784510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.785344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.792273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30377295-2ca9-4bca-92d1-8cab50caf5ed admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.826092 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1381/2756] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:39:17.835443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:17.860738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b20b3-6525-4bfa-a333-ab9dd42bb269 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:17.876649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:17.877828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.878535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.878999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] PATH_INFO: `/v3/projects/6bd5c1f330104d60bfb991a53869a000/users/151f362ff88343c6b140c49366d88954/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:17.885249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd5c1f330104d60bfb991a53869a000, user_id=151f362ff88343c6b140c49366d88954, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:17.890517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:17.932641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1376/2757] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:17 2022] PUT /identity/v3/projects/6bd5c1f330104d60bfb991a53869a000/users/151f362ff88343c6b140c49366d88954/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:17.954245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20b6e-a57a-4e83-abd7-3897f2903bba None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:17.954245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20b6e-a57a-4e83-abd7-3897f2903bba None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:17.954245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a20b6e-a57a-4e83-abd7-3897f2903bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.050400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6a20b6e-a57a-4e83-abd7-3897f2903bba None None] MFA Rules not processed for user `151f362ff88343c6b140c49366d88954`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:18.053317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6a20b6e-a57a-4e83-abd7-3897f2903bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:18.321367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:18.323453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:18.432689 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1382/2758] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:18.446632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.447581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.448295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.524446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] MFA Rules not processed for user `10f57760d0b5468b91c7b9666305dba9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:18.530095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:18.641935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21003cbe-1415-4336-9b6b-ba262732c68a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:18.667027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:18.671848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:18.687213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:18.687213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] PATH_INFO: `/v3/users/480ecf0ebd274b5aa533822f4672dd00` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:18.687213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=480ecf0ebd274b5aa533822f4672dd00)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:18.689955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:18.885318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1383/2759] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:18.895576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:19.144331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '480ecf0ebd274b5aa533822f4672dd00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:19.699317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '480ecf0ebd274b5aa533822f4672dd00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:19.761363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '480ecf0ebd274b5aa533822f4672dd00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:19.805319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '480ecf0ebd274b5aa533822f4672dd00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:19.810176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '480ecf0ebd274b5aa533822f4672dd00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:19.845492 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1377/2760] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:18 2022] DELETE /identity/v3/users/480ecf0ebd274b5aa533822f4672dd00 => generated 0 bytes in 1524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:20.022690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:20.024449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:20.335674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b56349-b17c-4e76-b383-2cd1a60d3b30 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:20.636965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:20.638337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:20.638848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:20.640291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:20.649693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:20.777860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:20.922883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:20.926360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59bd35-b284-408e-bda9-723bad989b29 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:20.979567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1384/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 957 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:22.138323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:22.149725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:22.157571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:22.464175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:22.564226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a223e70-7ba1-4ffd-b33f-1867c34df8f9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:22.582016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:22.589574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:22.592135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:22.594611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] PATH_INFO: `/v3/projects/f97dff96032f4f2193acabe74c8b69bd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:22.621513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97dff96032f4f2193acabe74c8b69bd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:22.634415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.013350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97dff96032f4f2193acabe74c8b69bd', 'request_id': 'req-6c826fae-b391-4548-8379-26b706eb2087'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:23.026054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97dff96032f4f2193acabe74c8b69bd', 'request_id': 'req-6c826fae-b391-4548-8379-26b706eb2087'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:23.044343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97dff96032f4f2193acabe74c8b69bd', 'request_id': 'req-6c826fae-b391-4548-8379-26b706eb2087'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:23.137948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] The token cache is being invalidate because project f97dff96032f4f2193acabe74c8b69bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:23.138316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:23.140087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c826fae-b391-4548-8379-26b706eb2087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:23.147080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1378/2762] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:22 2022] DELETE /identity/v3/projects/f97dff96032f4f2193acabe74c8b69bd => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:23.152523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.152523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.153302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.226219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:23.227783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:23.438796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1385/2763] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:23.447544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.451194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.451704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.499856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:23.504299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:23.512051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1379/2764] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:23.519008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.545730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afe1fd-d031-469e-a546-f97a69447ab7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.560988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.563723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.564144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.566002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.567004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:23.567951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.573415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.607629 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1386/2765] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:23.611235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.626446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892e99-6170-4257-ba0a-40c79e8d2b09 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:23.646871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:23.647831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:23.650943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:23.651520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:23.652418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:23.660393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:23.782951 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1380/2766] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:23 2022] POST /identity/v3/projects => generated 401 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:23.788093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:23.810463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a42bd-f1f6-478b-87da-e43980356346 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.007305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.008249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.023226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.025056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.028170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.032573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.186076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:24.199367 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1387/2767] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:23 2022] POST /identity/v3/users => generated 301 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:24.200075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.218900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f61089-4490-46e8-97bc-3f5cc739cded admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.249468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.250120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.250363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.250638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.252762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.257590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.296804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1381/2768] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:24.301075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.316548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253758af-687c-46a4-8861-fe437c4c3dbf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.329844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.335963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.336950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.337449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.338404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.349049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adeb1d-b6e2-41a5-be8c-f00663130163 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.373845 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1388/2769] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:24.374114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:24.394215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496709f7-7b55-45e2-9048-aebedcacde0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:24.419084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:24.419780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.420052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.420323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] PATH_INFO: `/v3/projects/48947c2a4f894d61863e6fc08f77f410/users/7447ac1c4d694633930d75276c56b8c3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:24.447703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:24.476111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48947c2a4f894d61863e6fc08f77f410, user_id=7447ac1c4d694633930d75276c56b8c3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:24.480434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:24.986116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1382/2770] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:24 2022] PUT /identity/v3/projects/48947c2a4f894d61863e6fc08f77f410/users/7447ac1c4d694633930d75276c56b8c3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:24.991907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ba25-d4ab-4d72-8f1a-76e65553bc6b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:24.992407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ba25-d4ab-4d72-8f1a-76e65553bc6b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:24.992539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62ba25-d4ab-4d72-8f1a-76e65553bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.032709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fe62ba25-d4ab-4d72-8f1a-76e65553bc6b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:25.038219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fe62ba25-d4ab-4d72-8f1a-76e65553bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:25.211699 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1389/2771] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:25.258789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:25.261714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:25.599073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5465f0-b58e-4d99-bd6d-9ebe1cb72b7b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:25.611127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:25.612014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:25.612309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:25.613102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:25.637665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:25.639362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:25.680993 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1383/2772] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:26.138504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:26.938658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:27.031159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5388-ef9d-4d34-a0a7-b9b63597e1b8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.032104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5388-ef9d-4d34-a0a7-b9b63597e1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.032821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5388-ef9d-4d34-a0a7-b9b63597e1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.130049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-323d5388-ef9d-4d34-a0a7-b9b63597e1b8 None None] MFA Rules not processed for user `99582f1c239d4209a1909c5a849de953`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:27.131658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-323d5388-ef9d-4d34-a0a7-b9b63597e1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:27.322620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1390/2773] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:27.372670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.377915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:27.473776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.474051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.474324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.516309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:27.520748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:27.563668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fbb05-7d65-40f9-9be6-bedbfe7cae6e service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.585374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.586303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.591116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.591116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.609574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.611767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.627976 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1384/2774] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:27.662869 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1391/2775] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:27.679386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:27.682423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:27.789807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:27.869890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f3920-e1e6-4ada-90b0-f2b08ae28392 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:27.888743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:27.889385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:27.889667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:27.898373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:27.940896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:27.949210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d407cb2-d4ad-4004-90ca-711efc25f2ad service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:27.969931 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1385/2776] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:28.556520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:29.378860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:29.435615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:30.071449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:30.687756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:30.730261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c09656-4558-4158-812b-dabb09cd62be None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:30.791984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:30.793348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:30.793972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:30.795386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:30.809453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:31.091731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:31.097302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4675b7-cbf8-482e-ac31-cf7840b8b50f service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:31.134595 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1392/2777] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:32.205821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:32.972205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:33.189391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.190552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.191098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.308172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] MFA Rules not processed for user `b276ebf583404e61b5f57e00f11caa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:33.311856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:33.501971 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1386/2778] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:33.515336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43f13c-5ee4-458e-8b3e-d51a4c259411 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:33.515993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43f13c-5ee4-458e-8b3e-d51a4c259411 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:33.517092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43f13c-5ee4-458e-8b3e-d51a4c259411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:33.570142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ac43f13c-5ee4-458e-8b3e-d51a4c259411 None None] MFA Rules not processed for user `b276ebf583404e61b5f57e00f11caa0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:33.573584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac43f13c-5ee4-458e-8b3e-d51a4c259411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:33.628687 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1393/2779] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:34.316017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:34.317525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:34.369744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e59500-972d-4093-b273-3423d0453d17 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:34.379995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:34.422959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:34.424994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:34.425533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:34.426080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:34.484192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:34.489156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8a279-0e91-4fee-8d07-71f440b52054 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:34.599215 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1387/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:34.692673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:36.056097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:36.056097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:36.056097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:39:36.098234 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:39:36.099459 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:39:36.123967 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1394/2781] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:39:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 63 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:39:37.026990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1e56-6795-4dfc-ae2d-6646050e5701 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.028192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1e56-6795-4dfc-ae2d-6646050e5701 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.031557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c1e56-6795-4dfc-ae2d-6646050e5701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.119184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d82c1e56-6795-4dfc-ae2d-6646050e5701 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:37.122893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d82c1e56-6795-4dfc-ae2d-6646050e5701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:37.168299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1388/2782] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:37.214543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:37.261655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a62fb-ff1e-4369-981d-79b1eba52bdd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:37.282289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:37.283186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.284180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.284645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.306485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:37.308243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c79c-ac70-4816-bd0e-3afa568036f8 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:37.353210 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1395/2783] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:39:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:37.537044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49938-8875-43f7-b867-df8e05976448 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:37.537625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49938-8875-43f7-b867-df8e05976448 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:37.538122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d49938-8875-43f7-b867-df8e05976448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:37.588910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-54d49938-8875-43f7-b867-df8e05976448 None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:37.590625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54d49938-8875-43f7-b867-df8e05976448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:37.767938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:37.795569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1389/2784] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:38.241575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:38.740723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:38.741372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:38.741372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:38.807758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] MFA Rules not processed for user `99582f1c239d4209a1909c5a849de953`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:38.810817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:38.855793 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1396/2785] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:39:39.994236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:40.126488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:41.130254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:41.681913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:42.205388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:42.670286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:43.304381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:43.643072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:45.000652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:45.555686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:46.336984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:46.550137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:47.778281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:48.115535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:48.953849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.953849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.953849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:48.959799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:48.977138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a667bf7-7226-428f-bc97-3a0a366e5bad None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:48.983862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:48.984994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:48.985519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:48.986226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:49.016459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:49.043931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] MFA Rules not processed for user `7447ac1c4d694633930d75276c56b8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:49.050487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:49.212175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:49.214700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:49.244475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1397/2786] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:39:49.276391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1390/2787] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:48 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:49.367255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:49.709163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:50.269007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.269952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:50.291900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de234c35-87c6-4f52-bb7d-5870dc2da7c8 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.304639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.306582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.307649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.307917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] PATH_INFO: `/v3/users/b276ebf583404e61b5f57e00f11caa0f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.311053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b276ebf583404e61b5f57e00f11caa0f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.318295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.623695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:50.688769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.750440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f9db-c21a-46c7-8a21-fb2d95940cb7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.789427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.793605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.797115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.799936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.838013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b276ebf583404e61b5f57e00f11caa0f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:50.860647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:50.863430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:50.933789 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1391/2788] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:39:50.948824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b276ebf583404e61b5f57e00f11caa0f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:50.966743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:50.987672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b5913-71a9-4058-a0fa-6f877373ee68 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:50.992251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b276ebf583404e61b5f57e00f11caa0f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:50.993133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:50.993300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b276ebf583404e61b5f57e00f11caa0f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:50.994234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:50.994381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b276ebf583404e61b5f57e00f11caa0f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:50.994785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:50.995216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:50.997933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:51.020803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:51.025167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25859b-5576-4a4c-b4b1-fdfa00af780c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:51.052683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1398/2789] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:39:50 2022] DELETE /identity/v3/users/b276ebf583404e61b5f57e00f11caa0f => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:51.073222 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1392/2790] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:51.169352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:52.230323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:52.235466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:52.331712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:52.429614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:52.576406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f8a0-798a-404b-96f6-1e189c7f70a2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:52.625811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:52.630356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:52.631241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:52.631906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] PATH_INFO: `/v3/projects/39d655a565644746a2d466d88fa00f02` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:52.637300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d655a565644746a2d466d88fa00f02)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:52.647258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:52.893066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d655a565644746a2d466d88fa00f02', 'request_id': 'req-23e2e868-e8eb-478b-b97c-a094c2a0138c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:52.908778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d655a565644746a2d466d88fa00f02', 'request_id': 'req-23e2e868-e8eb-478b-b97c-a094c2a0138c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:53.012634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d655a565644746a2d466d88fa00f02', 'request_id': 'req-23e2e868-e8eb-478b-b97c-a094c2a0138c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:53.033750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] The token cache is being invalidate because project 39d655a565644746a2d466d88fa00f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:39:53.038490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:53.040568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e2e868-e8eb-478b-b97c-a094c2a0138c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:39:53.055307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1399/2791] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:52 2022] DELETE /identity/v3/projects/39d655a565644746a2d466d88fa00f02 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:53.058491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.058979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.059489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.093561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.094454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.094980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:39:53.102514 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:39:53.103535 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:39:53.126012 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1400/2792] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:39:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:39:53.251845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:53.265385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:53.551166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1393/2793] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:53.559010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.559933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.560646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.668782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:53.671734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:53.707882 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1401/2794] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:53.713872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.762551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16605a8-418b-4bbe-b690-ce6edc5e1aec None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.792480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.793597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.794078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.794542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.795658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:39:53.796198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.810268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.848993 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1394/2795] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:39:53.854666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:53.890067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fd61c-82ca-400c-8032-9f95bd60bd26 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:53.905000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:53.905643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:53.906106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:53.906323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:53.907086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:53.910983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:53.913241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:54.119950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1402/2796] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:39:53 2022] POST /identity/v3/projects => generated 391 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:54.121458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.125426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:54.137330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f20cb-7c41-4646-8848-f3b69fb2a6e6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.379804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.380892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.381394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.381876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.385676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.394271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.603239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.603898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1395/2797] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:39:54 2022] POST /identity/v3/users => generated 296 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:39:54.657930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2882d665-811c-4444-8ba0-3e7987a58d98 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.695510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.699901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.702729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.703239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.707799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.721937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.824790 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1403/2798] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:54.827598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:54.878725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516bec-923b-45c1-a604-854ab9b1eaef admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:54.904134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:54.905229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:54.905724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:54.906220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:54.907459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:54.935591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e126-2a9c-4b23-8417-07d50a44de7b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:54.963935 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1396/2799] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:39:54.969381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:55.037577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52bc1b-ae75-45c4-b136-feb4a7e2ba00 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.057413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.061756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.061756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.061756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] PATH_INFO: `/v3/projects/a37fa59604f243cabf8504bac9207c89/users/427b2bb4567545a89fc6c69bc409b5a5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.129851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37fa59604f243cabf8504bac9207c89, user_id=427b2bb4567545a89fc6c69bc409b5a5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.136628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.280600 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1404/2800] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:39:54 2022] PUT /identity/v3/projects/a37fa59604f243cabf8504bac9207c89/users/427b2bb4567545a89fc6c69bc409b5a5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:39:55.288372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.292783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.292783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.392793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:39:55.396005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:55.478433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:55.625755 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1397/2801] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:39:55.641483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:39:55.661704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:39:55.702553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:55.828819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f847dee4-a5c4-4573-a099-6e1f61f4a018 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:39:55.846780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:39:55.847916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:39:55.848680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:39:55.849183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:39:55.879360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:39:55.881580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:39:55.906084 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1405/2802] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:39:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:39:58.376898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:59.224349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:00.127586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:01.776948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:03.122180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:03.510403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:04.158528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:05.943927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:06.095300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:06.097491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:06.147201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4921b51-4de3-4e37-a439-8598426d9cd1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:06.219154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:06.225267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:06.227395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:06.229026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] PATH_INFO: `/v3/users/7447ac1c4d694633930d75276c56b8c3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:06.235142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7447ac1c4d694633930d75276c56b8c3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:06.253559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:06.360885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:06.621663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7447ac1c4d694633930d75276c56b8c3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:06.721261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7447ac1c4d694633930d75276c56b8c3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:06.765411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7447ac1c4d694633930d75276c56b8c3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:06.780950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7447ac1c4d694633930d75276c56b8c3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:06.784353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7447ac1c4d694633930d75276c56b8c3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:06.813266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1398/2803] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:06 2022] DELETE /identity/v3/users/7447ac1c4d694633930d75276c56b8c3 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:07.052637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:07.823454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:07.837511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e618485-1c16-426c-83f7-47324b0f1b64 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:07.962109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:07.963678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:07.964455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:07.965036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] PATH_INFO: `/v3/projects/48947c2a4f894d61863e6fc08f77f410` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:07.967456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48947c2a4f894d61863e6fc08f77f410)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:07.976212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.197157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.199371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.208681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48947c2a4f894d61863e6fc08f77f410', 'request_id': 'req-5095d91d-55aa-43ef-a78c-8157c7dde484'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:08.230337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48947c2a4f894d61863e6fc08f77f410', 'request_id': 'req-5095d91d-55aa-43ef-a78c-8157c7dde484'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:08.265335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:08.342754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48947c2a4f894d61863e6fc08f77f410', 'request_id': 'req-5095d91d-55aa-43ef-a78c-8157c7dde484'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:08.368648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] The token cache is being invalidate because project 48947c2a4f894d61863e6fc08f77f410 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:08.378234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:08.380121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5095d91d-55aa-43ef-a78c-8157c7dde484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:08.385834 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1406/2804] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:07 2022] DELETE /identity/v3/projects/48947c2a4f894d61863e6fc08f77f410 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:08.393746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f190ca-37b1-4b06-bb11-b12c540fb425 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.396058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60727e-96c3-42f3-add7-4ec5e18ed25d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.396582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60727e-96c3-42f3-add7-4ec5e18ed25d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.397055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60727e-96c3-42f3-add7-4ec5e18ed25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.444359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bb60727e-96c3-42f3-add7-4ec5e18ed25d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:08.447034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bb60727e-96c3-42f3-add7-4ec5e18ed25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.574346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.575768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.576879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.577596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.583845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.616547 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1407/2805] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:08.628981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.629925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.630585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.677128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:08.679636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:08.704561 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1408/2806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:08.709319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.730876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2def6-1654-4721-a587-07ac6c80a8ba None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.738364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.739301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.739631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.740086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.741266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:08.741785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.745677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.745981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:08.761368 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1409/2807] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:08.767171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:08.769753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.774480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1556b-1d7b-4b2b-98c1-840e2cf05c2c service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.785933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1399/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:08.790731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740c6a5-d1d0-41ba-b3a0-c40fb20b75f8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:08.798519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:08.799474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.799852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.800190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.801039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:08.804816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:08.917800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:08.918575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:08.919164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:08.955213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:08.957894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:09.004633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1410/2809] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/projects => generated 395 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:09.009196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.101382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1400/2810] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:40:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:09.119124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.123198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:09.146127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797255-15db-42d2-8ab9-582f9f056951 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.155493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.156618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.157696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.158228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.159457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.163606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.282352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb4b4e8-8668-45a2-b210-fceb2e3db637 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.325729 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1411/2811] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:09 2022] POST /identity/v3/users => generated 298 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:09.327405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.346515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179894f9-78ed-4329-ab40-ef7ed5a02653 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.364391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.368681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.370833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.371936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.378366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.390704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.452800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1412/2812] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:09.458783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.486792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4df99-fc8a-4f24-80ea-0c5140e6dc39 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.495572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.496694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.497173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.501869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.502959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.506159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.507360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.507908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.508380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.514630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.547268 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1413/2813] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:09.555030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:09.580511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf395a-1f7d-4e54-a844-ef79e4e74597 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:09.593592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:09.604932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.604932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.604932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] PATH_INFO: `/v3/projects/d93e3d867ed44dc4add656d02c389a4c/users/35bb14eeab0142579ede81630b7017e5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.630290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:09.651423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93e3d867ed44dc4add656d02c389a4c, user_id=35bb14eeab0142579ede81630b7017e5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.654914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:09.656671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.660512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a1b12-42b0-47b9-97b1-9a2bf046af67 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:09.678076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1401/2814] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:09.785087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1414/2815] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:09 2022] PUT /identity/v3/projects/d93e3d867ed44dc4add656d02c389a4c/users/35bb14eeab0142579ede81630b7017e5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:09.806609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:09.807080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:09.807399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:09.860020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] MFA Rules not processed for user `35bb14eeab0142579ede81630b7017e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:09.866030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:10.005577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1402/2816] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:10.513720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:10.562567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:11.334135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:12.518988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:12.530445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:12.705130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c7aff-5b7b-4ff6-909c-53aad9748790 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:12.725627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:12.726268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:12.726549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:12.726819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:12.739637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:12.778979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:12.783632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:12.814387 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1415/2817] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:12.939044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:12.974171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1c36-4d01-4971-8a67-3df1f4bb89da None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:13.004992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:13.005746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:13.006044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:13.006296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:13.043454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:13.054483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:13.119409 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1403/2818] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:12 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:13.145113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.248529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:13.270544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e573c-38a2-4c1d-b9bf-e57236f0be47 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:13.291552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:13.291552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:13.291552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:13.291552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:13.297315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:13.465508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.511392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.530373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:13.533799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:13.538946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:13.540705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c118-8d3d-491d-9f63-31079a072247 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:13.605542 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1416/2819] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:13.668780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a26872-501e-4904-b975-b473bdd303dc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:13.670444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a26872-501e-4904-b975-b473bdd303dc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:13.670782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a26872-501e-4904-b975-b473bdd303dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:13.759057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-59a26872-501e-4904-b975-b473bdd303dc None None] MFA Rules not processed for user `10f57760d0b5468b91c7b9666305dba9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:13.763298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-59a26872-501e-4904-b975-b473bdd303dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:13.852257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adfc91-615b-4e72-8298-8fbc57bf68aa service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:13.865325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:13.881912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:13.883283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:13.883503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:13.885436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] PATH_INFO: `/v3/users/ebf0681a98044ce29352cc8abdaa69f1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:13.937682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf0681a98044ce29352cc8abdaa69f1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:13.955786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:14.076956 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1417/2820] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:14.302906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf0681a98044ce29352cc8abdaa69f1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:14.377053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf0681a98044ce29352cc8abdaa69f1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:14.406161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:14.431519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf0681a98044ce29352cc8abdaa69f1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:14.469866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf0681a98044ce29352cc8abdaa69f1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:14.477225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-98907abd-a188-4828-abc5-71390d39a11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf0681a98044ce29352cc8abdaa69f1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:14.530149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1404/2821] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:13 2022] DELETE /identity/v3/users/ebf0681a98044ce29352cc8abdaa69f1 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:14.537690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76731e1-707c-4909-b68d-6260236a40ff None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.538826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76731e1-707c-4909-b68d-6260236a40ff None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.540240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76731e1-707c-4909-b68d-6260236a40ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.590644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:14.591319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:14.601377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:14.669510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a76731e1-707c-4909-b68d-6260236a40ff None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:14.673253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a76731e1-707c-4909-b68d-6260236a40ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:14.781448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] MFA Rules not processed for user `427b2bb4567545a89fc6c69bc409b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:14.796787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:14.922279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:15.046349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:15.051031 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1418/2822] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:15.115145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eaf50-4bf2-4b1f-bb72-85b033b6a927 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.115424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eaf50-4bf2-4b1f-bb72-85b033b6a927 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.115694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698eaf50-4bf2-4b1f-bb72-85b033b6a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.139727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-698eaf50-4bf2-4b1f-bb72-85b033b6a927 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:15.141506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-698eaf50-4bf2-4b1f-bb72-85b033b6a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:15.153489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1405/2823] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:15.155243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.162694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:15.388429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b73f-db9f-42dd-8981-9a7862557ed2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.405915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.406660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.407553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.407856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.426391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.427295 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1419/2824] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:15.430061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.433056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.433645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.442609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.451556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:15.459556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1406/2825] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:15.460474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:15.462179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:15.493924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] MFA Rules not processed for user `427b2bb4567545a89fc6c69bc409b5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:15.495635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:15.508913 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1420/2826] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:15.657992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73c76e-e7c8-4635-b297-7bb29a8330b7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:15.665401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:15.666677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:15.667745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:15.676085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:15.683423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:15.685926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:15.699224 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1407/2827] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:16.132594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:16.137861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:16.235143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:16.441273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:16.441273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:16.465894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fb373-dfc2-48c7-9515-337cbd3f60bb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:16.496437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:16.500284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:16.502513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:16.505478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:16.508331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:16.569936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:16.578233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:16.598936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:16.620265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1421/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:16.710404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4476fc-0836-43be-9c74-7f25b104387f service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:16.722727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3399068-217c-4170-8195-779cc061b99a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:16.724003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399068-217c-4170-8195-779cc061b99a service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:16.724657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399068-217c-4170-8195-779cc061b99a service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:16.725690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3399068-217c-4170-8195-779cc061b99a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:16.742824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3399068-217c-4170-8195-779cc061b99a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:16.746680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3399068-217c-4170-8195-779cc061b99a service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:16.769587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1408/2829] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:17.075806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:17.080018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:17.149300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694aac6-2925-4677-b377-9bd3bcdcd0bd service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:17.173642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:17.174851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:17.175416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:17.175993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] PATH_INFO: `/v3/projects/4e0aa9b18c154964972a8c57c290dfe0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:17.181195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0aa9b18c154964972a8c57c290dfe0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:17.185238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:17.603613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:17.603613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:17.603613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:40:17.604934 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:17.606593 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:40:17.626469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1409/2830] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:40:18.269229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.278020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.317334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0aa9b18c154964972a8c57c290dfe0', 'request_id': 'req-1aced7f8-946d-406e-b2ef-8240c45d46c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.344008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0aa9b18c154964972a8c57c290dfe0', 'request_id': 'req-1aced7f8-946d-406e-b2ef-8240c45d46c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.441487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04435-38b0-4555-8650-3f4a6dc33408 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.456452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.457705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.458323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.458813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] PATH_INFO: `/v3/users/35bb14eeab0142579ede81630b7017e5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.461066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bb14eeab0142579ede81630b7017e5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.464888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:18.548818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0aa9b18c154964972a8c57c290dfe0', 'request_id': 'req-1aced7f8-946d-406e-b2ef-8240c45d46c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.581053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] The token cache is being invalidate because project 4e0aa9b18c154964972a8c57c290dfe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:18.581563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.584285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.596847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1422/2831] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:17 2022] DELETE /identity/v3/projects/4e0aa9b18c154964972a8c57c290dfe0 => generated 0 bytes in 1523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:18.599105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.606656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.817911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:18.826564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aced7f8-946d-406e-b2ef-8240c45d46c5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.836631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.837615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.838202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.838760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.841356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.861357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.863700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:18.878318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1423/2832] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:18.879617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:18.881567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:18.899368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bb14eeab0142579ede81630b7017e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:18.900975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351047-1268-4507-a06b-b1f71ea72b63 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:18.908627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:18.909696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:18.910231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:18.910766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] PATH_INFO: `/v3/users/bc06d014dd654ea4bc0c11c08067f625` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:18.912670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc06d014dd654ea4bc0c11c08067f625)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:18.915334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:19.091558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bb14eeab0142579ede81630b7017e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.121649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bb14eeab0142579ede81630b7017e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.137326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bb14eeab0142579ede81630b7017e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.145046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ee9d760-1d57-429f-9b80-3813b2072303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bb14eeab0142579ede81630b7017e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.160584 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1410/2833] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:18 2022] DELETE /identity/v3/users/35bb14eeab0142579ede81630b7017e5 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:19.166703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.167142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.167615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:19.208942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:19.210644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:19.253076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc06d014dd654ea4bc0c11c08067f625'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.344071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc06d014dd654ea4bc0c11c08067f625'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.392966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc06d014dd654ea4bc0c11c08067f625'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.409347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc06d014dd654ea4bc0c11c08067f625'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.414536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc06d014dd654ea4bc0c11c08067f625'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:19.434144 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1411/2834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:19.449135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:19.451434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:19.483540 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1424/2835] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:18 2022] DELETE /identity/v3/users/bc06d014dd654ea4bc0c11c08067f625 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:19.658963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc243691-8ec6-41b3-bf72-9b4fab2aec05 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:19.826383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:19.827404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:19.828086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:19.828319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:20.081247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:20.088201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:20.130414 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1412/2836] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:20.881110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:20.937491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:20.940167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:21.007381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53577bd-f648-47fa-b0e2-76fd83e18ce7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:21.025740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:21.032600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:21.033160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:21.033676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] PATH_INFO: `/v3/projects/3d5db113d0f54d428c263c1631f577cc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:21.038788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5db113d0f54d428c263c1631f577cc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:21.048819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:21.059643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:21.435428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5db113d0f54d428c263c1631f577cc', 'request_id': 'req-fdc2ab4b-3db6-4b64-ae46-662cea3df892'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:21.449071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5db113d0f54d428c263c1631f577cc', 'request_id': 'req-fdc2ab4b-3db6-4b64-ae46-662cea3df892'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:21.641550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5db113d0f54d428c263c1631f577cc', 'request_id': 'req-fdc2ab4b-3db6-4b64-ae46-662cea3df892'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:21.650885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:21.654048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:21.697829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] The token cache is being invalidate because project 3d5db113d0f54d428c263c1631f577cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:21.698650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:21.700565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdc2ab4b-3db6-4b64-ae46-662cea3df892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:21.714441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04169ed-83f5-43b0-9e7c-68b17c403796 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:21.726527 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1425/2837] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:20 2022] DELETE /identity/v3/projects/3d5db113d0f54d428c263c1631f577cc => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:21.735295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b689f-4062-47c8-8fcf-1774056f7b8e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:21.741628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b689f-4062-47c8-8fcf-1774056f7b8e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:21.742392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b689f-4062-47c8-8fcf-1774056f7b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:21.972633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:22.073357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.074902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.075669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.077906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] PATH_INFO: `/v3/projects/d93e3d867ed44dc4add656d02c389a4c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.093621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93e3d867ed44dc4add656d02c389a4c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.101510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.345620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fb9b689f-4062-47c8-8fcf-1774056f7b8e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:22.354897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fb9b689f-4062-47c8-8fcf-1774056f7b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:22.380305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1426/2838] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 647 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:22.396255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.398470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.398470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.448083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93e3d867ed44dc4add656d02c389a4c', 'request_id': 'req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:22.480924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:22.486387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93e3d867ed44dc4add656d02c389a4c', 'request_id': 'req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:22.488428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:22.497624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93e3d867ed44dc4add656d02c389a4c', 'request_id': 'req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:22.594613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] The token cache is being invalidate because project d93e3d867ed44dc4add656d02c389a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:22.597365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:22.597365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b485f4a-0ab1-46c4-b95e-7f48536d4f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:22.598970 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1413/2839] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:21 2022] DELETE /identity/v3/projects/d93e3d867ed44dc4add656d02c389a4c => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:22.610826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6927df-3322-48e2-adb7-705b2d7d3f07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.613930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6927df-3322-48e2-adb7-705b2d7d3f07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.614481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6927df-3322-48e2-adb7-705b2d7d3f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.653161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6c6927df-3322-48e2-adb7-705b2d7d3f07 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:22.655359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6c6927df-3322-48e2-adb7-705b2d7d3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:22.729462 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1427/2840] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:22.740126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.771997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6de1ba-e3a7-4b44-9f65-0776bbb71bbb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:22.775057 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1414/2841] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:22.787391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.788837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.789115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.794179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.795029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.795302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.795562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.796228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:22.796554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.799501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.828820 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1428/2842] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:22.829044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:22.830310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:22.832886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.850270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238645d-0b6b-4676-a9dd-5996d896c679 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:22.867174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.867908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.868810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.869143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.869850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.875062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1415/2843] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:22.875215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.876187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.915424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1354ae-abdb-49d8-a83c-c9ab31c7d724 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:22.928825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:22.929962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:22.930466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:22.930983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:22.931895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:22.932435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:22.934386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:22.967875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1416/2844] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:22.972876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:22.993136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889c1f3-1e0c-46b8-ae6f-eac06ac4f12b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.030378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.032072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.033125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.033125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.038597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.041179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.067907 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1429/2845] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:23.072773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.229773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1417/2846] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:22 2022] POST /identity/v3/projects => generated 385 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:23.233864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.236430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447d8e-66f0-4ec5-9216-576eb2d0720b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.415035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.415735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.415930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.416208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.416886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.419216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.419554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b59ed8-4b43-4ed5-b42f-3b78ab8581ee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.437093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.438179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.438713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.440340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.441680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.447896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.579527 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1430/2847] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:23 2022] POST /identity/v3/users => generated 286 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:23.581492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.610412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07042aa7-ad4c-4cfd-85a4-0d233e9c412b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.620858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.621900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.622388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.622884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.624268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.628390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.647235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1418/2848] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:23 2022] POST /identity/v3/users => generated 293 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:23.653796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1431/2849] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:23.654674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.663416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.689573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15006f99-3728-48af-b1f8-a23ed63a3afd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.703325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fb6de-0bbd-4dd5-aaab-9b4d869e8ed1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.709193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.710246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.712076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.712076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.713188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.719895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.725679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.727027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.727518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.728002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.730762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.734407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.750610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1419/2850] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:23.755776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.768602 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1432/2851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:23.770001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.784222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f95061-bc20-4282-9a44-d9cbdd87c523 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.793378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e20b9-e115-476e-9593-c06c8b40e904 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.796406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.798871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.799807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.800186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.801352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.804254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.809314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.812865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.812865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.812865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] PATH_INFO: `/v3/projects/000924c5c8cc4f7ea552d0e10829e729/users/058e73add47644278652db747896b5cd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.832546 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1420/2852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:23.836279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:23.843938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=000924c5c8cc4f7ea552d0e10829e729, user_id=058e73add47644278652db747896b5cd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.847414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4170a3a-33db-4f1f-b425-26c52616e1a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:23.849558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821524-8aa5-4554-a523-83d30b19a0ef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:23.853259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:23.854189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:23.854647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:23.855193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] PATH_INFO: `/v3/projects/c0a42b724065423cb31303f3f9b55f36/users/d03db5013be642b88ea298fba0d87f20/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:23.893166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a42b724065423cb31303f3f9b55f36, user_id=d03db5013be642b88ea298fba0d87f20, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:23.896083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8749b1ec-7c9d-4995-8bbd-5e85bac42b4a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:24.052530 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1433/2853] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:23 2022] PUT /identity/v3/projects/000924c5c8cc4f7ea552d0e10829e729/users/058e73add47644278652db747896b5cd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:24.081626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.082547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.087217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.096859 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1421/2854] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:23 2022] PUT /identity/v3/projects/c0a42b724065423cb31303f3f9b55f36/users/d03db5013be642b88ea298fba0d87f20/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:24.102323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:24.112740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.113014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.113495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.223612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] MFA Rules not processed for user `d03db5013be642b88ea298fba0d87f20`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:24.246246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.248944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] MFA Rules not processed for user `058e73add47644278652db747896b5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:24.253866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.511240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1434/2855] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:24.540828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:24.550819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.582456 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1422/2856] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:24.583382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:24.591886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.766471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474eb5e-329c-467c-8d98-d3d52c96d6f3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:24.796157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:24.799656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:24.800284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.801032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.805544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.812025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.824295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:24.826106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:24.854189 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1435/2857] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:24.855919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:24.871040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:24.872550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94109be-5157-4378-97e1-00c149b1fd11 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:24.902869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:24.903350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:24.906459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:24.914479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:24.943345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:24.945059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4d7fc-ff74-4fff-917b-b8dbbdeba8c0 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:24.998772 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1423/2858] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:25.096247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:25.129485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03ca6a-b38d-4d71-b36a-c5cfdd019c0f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:25.158263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:25.159840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:25.160121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:25.160392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:25.191689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:25.194669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:25.225243 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1436/2859] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:25.785224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:26.805476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:26.806320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:26.806320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:26.865871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:26.872241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:26.922147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:27.015098 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1424/2860] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:27.030820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:27.039490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:27.245166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2639d87-3615-499c-b094-df4ae015aba8 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:27.252570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:27.253563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:27.254070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:27.257289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:27.265870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:27.268138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:27.280677 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1437/2861] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:40:27.343214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.129337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.130916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:28.282231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb88f5-c14e-4b3b-8bc5-75bd8ebff372 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.313569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.321006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.321006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.321006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] PATH_INFO: `/v3/users/63589f909a744bf1afec7d1f2e659f8a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.330963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63589f909a744bf1afec7d1f2e659f8a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.343220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:28.440220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.603896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:28.635003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b16ae-79b0-4c74-85e6-15c068aa28e7 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:28.635003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:28.635003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:28.635003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:28.635925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] PATH_INFO: `/v3/users/058e73add47644278652db747896b5cd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:28.636467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] RBAC: Authorizing `identity:delete_user(user_id=058e73add47644278652db747896b5cd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:28.639792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:29.145377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63589f909a744bf1afec7d1f2e659f8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.237886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058e73add47644278652db747896b5cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.378277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63589f909a744bf1afec7d1f2e659f8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.410032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63589f909a744bf1afec7d1f2e659f8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.428442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63589f909a744bf1afec7d1f2e659f8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.430187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cb5a23cc-c76f-4708-8e17-84e0b9aa61d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63589f909a744bf1afec7d1f2e659f8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.444173 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1425/2862] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:28 2022] DELETE /identity/v3/users/63589f909a744bf1afec7d1f2e659f8a => generated 0 bytes in 1315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:29.448114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3916db-08b2-43cb-9de9-38a55c49d39c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:29.448760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3916db-08b2-43cb-9de9-38a55c49d39c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:29.455614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3916db-08b2-43cb-9de9-38a55c49d39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:29.483854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8c3916db-08b2-43cb-9de9-38a55c49d39c None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:29.487224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8c3916db-08b2-43cb-9de9-38a55c49d39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:29.533580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058e73add47644278652db747896b5cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.557775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058e73add47644278652db747896b5cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.558908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058e73add47644278652db747896b5cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.559860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058e73add47644278652db747896b5cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:29.580100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1438/2863] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:28 2022] DELETE /identity/v3/users/058e73add47644278652db747896b5cd => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:29.598760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:29.598760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:29.616569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1426/2864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:29.619024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c344-b962-4e60-8f90-c53f65bc41d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:29.619508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c344-b962-4e60-8f90-c53f65bc41d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:29.620149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c344-b962-4e60-8f90-c53f65bc41d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:29.658598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0505c344-b962-4e60-8f90-c53f65bc41d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:29.660908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0505c344-b962-4e60-8f90-c53f65bc41d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:29.712560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3309215-5a9a-46d3-95dd-3d5cea71521e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:29.725870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:29.727783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:29.729187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:29.730147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] PATH_INFO: `/v3/users/427b2bb4567545a89fc6c69bc409b5a5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:29.732891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427b2bb4567545a89fc6c69bc409b5a5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:29.745471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:29.804365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1427/2865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:29.804365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:29.804365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:29.816606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:29.846570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:29.860633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:29.860633 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1428/2866] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:29.860633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:29.864681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:29.952813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563113a-533d-4c71-bf00-ca8bf020ae5d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:29.958010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:29.958641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:29.959040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:29.959189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:29.985049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:29.993258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:30.024361 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1429/2867] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:30.027210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:30.045082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf3d25-2071-4162-a10d-c5b61386901e service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:30.052698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:30.053488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:30.053969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:30.054444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:30.079383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:30.082083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:30.098330 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1430/2868] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:30.099353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:30.101131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:30.242131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802d251-faf8-42f2-aad7-30c6fc20fe7f service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:30.270521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:30.271582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:30.272051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:30.272527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:30.279541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:30.294054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427b2bb4567545a89fc6c69bc409b5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:30.310205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:30.311935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0db3b-b427-43fb-8f7b-b18204ee94db service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:30.330170 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1431/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:30.332212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:30.332771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:30.333219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:30.362812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:30.364183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:30.434082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427b2bb4567545a89fc6c69bc409b5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:30.453803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427b2bb4567545a89fc6c69bc409b5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:30.455249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427b2bb4567545a89fc6c69bc409b5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:30.456283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427b2bb4567545a89fc6c69bc409b5a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:30.469747 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1432/2870] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:30.473919 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1439/2871] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:29 2022] DELETE /identity/v3/users/427b2bb4567545a89fc6c69bc409b5a5 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:30.485013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:30.486569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:30.618171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:30.621128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:30.655162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514e82e-e96a-45b9-a02e-ef32b3e5a3bf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:30.717490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:30.779154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebfd0a-f01f-4872-a87f-26fadef3b428 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:30.786044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:30.787147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:30.789628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:30.790188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] PATH_INFO: `/v3/projects/607346d5cd14420f930647ff1ecdb94d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:30.791844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607346d5cd14420f930647ff1ecdb94d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:30.794469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:30.802915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:30.804037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:30.804307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:30.804609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:30.916647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:30.929691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:30.961304 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1433/2872] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:40:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:31.013256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607346d5cd14420f930647ff1ecdb94d', 'request_id': 'req-1c3c526b-c291-436f-bd18-79aae64e5497'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.028429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607346d5cd14420f930647ff1ecdb94d', 'request_id': 'req-1c3c526b-c291-436f-bd18-79aae64e5497'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.231509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:31.233626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:31.251041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf7135-62ba-4676-bd04-23fceafab4ca service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:31.301222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607346d5cd14420f930647ff1ecdb94d', 'request_id': 'req-1c3c526b-c291-436f-bd18-79aae64e5497'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.332722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] The token cache is being invalidate because project 607346d5cd14420f930647ff1ecdb94d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:31.333257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.336243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.342960 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1440/2873] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:30 2022] DELETE /identity/v3/projects/607346d5cd14420f930647ff1ecdb94d => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:31.346561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:31.352682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:31.366866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:31.367702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.368023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.368297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] PATH_INFO: `/v3/projects/000924c5c8cc4f7ea552d0e10829e729` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.370264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=000924c5c8cc4f7ea552d0e10829e729)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:31.372449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:31.386796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c526b-c291-436f-bd18-79aae64e5497 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:31.398444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:31.400238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.400945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.401406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] PATH_INFO: `/v3/projects/a37fa59604f243cabf8504bac9207c89` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.403472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37fa59604f243cabf8504bac9207c89)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:31.407724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:31.579833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '000924c5c8cc4f7ea552d0e10829e729', 'request_id': 'req-fe858f5b-9b0d-419c-8d52-588c8682c356'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.595150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '000924c5c8cc4f7ea552d0e10829e729', 'request_id': 'req-fe858f5b-9b0d-419c-8d52-588c8682c356'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.615468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '000924c5c8cc4f7ea552d0e10829e729', 'request_id': 'req-fe858f5b-9b0d-419c-8d52-588c8682c356'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.695519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37fa59604f243cabf8504bac9207c89', 'request_id': 'req-fde85ded-cb22-4948-bb82-fd43bf307b08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.713194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37fa59604f243cabf8504bac9207c89', 'request_id': 'req-fde85ded-cb22-4948-bb82-fd43bf307b08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.831811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] The token cache is being invalidate because project 000924c5c8cc4f7ea552d0e10829e729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:31.832000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.832748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe858f5b-9b0d-419c-8d52-588c8682c356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:31.841284 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1434/2874] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:31 2022] DELETE /identity/v3/projects/000924c5c8cc4f7ea552d0e10829e729 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:31.849637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf9f8-4bae-4b87-83c9-29e2167ed263 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:31.850275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf9f8-4bae-4b87-83c9-29e2167ed263 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:31.850937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2bf9f8-4bae-4b87-83c9-29e2167ed263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:31.884424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6a2bf9f8-4bae-4b87-83c9-29e2167ed263 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:31.886902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a2bf9f8-4bae-4b87-83c9-29e2167ed263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.029396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37fa59604f243cabf8504bac9207c89', 'request_id': 'req-fde85ded-cb22-4948-bb82-fd43bf307b08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:32.089320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] The token cache is being invalidate because project a37fa59604f243cabf8504bac9207c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:32.090125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:32.093314 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1435/2875] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.094817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fde85ded-cb22-4948-bb82-fd43bf307b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:32.096710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e64a6-a392-4fc2-8bdd-b0a10bbf347f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.099034 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1441/2876] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:31 2022] DELETE /identity/v3/projects/a37fa59604f243cabf8504bac9207c89 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:32.099812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e64a6-a392-4fc2-8bdd-b0a10bbf347f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.101592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e64a6-a392-4fc2-8bdd-b0a10bbf347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.104040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b2af-a2f6-44fe-b1f9-6e4bdf6c01a4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.106677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b2af-a2f6-44fe-b1f9-6e4bdf6c01a4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.107486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3b2af-a2f6-44fe-b1f9-6e4bdf6c01a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.147347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-865e64a6-a392-4fc2-8bdd-b0a10bbf347f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:32.150115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-865e64a6-a392-4fc2-8bdd-b0a10bbf347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.180754 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1436/2877] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.182891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.183284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.183708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.186436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2ff3b2af-a2f6-44fe-b1f9-6e4bdf6c01a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:32.188587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ff3b2af-a2f6-44fe-b1f9-6e4bdf6c01a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.226764 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1442/2878] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.230299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29a8-79f1-46fb-8c0a-96d1275fbfd6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.230568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29a8-79f1-46fb-8c0a-96d1275fbfd6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.230872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e29a8-79f1-46fb-8c0a-96d1275fbfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.233015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:32.236923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.266946 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1437/2879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.273005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.293829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7aec3-3879-4bba-81bc-9dbe8bd2dfe5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.294854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b07e29a8-79f1-46fb-8c0a-96d1275fbfd6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:32.297501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b07e29a8-79f1-46fb-8c0a-96d1275fbfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.307356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.309176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.313399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.313399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.313399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:32.313399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.316005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.319304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1443/2880] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.330337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.332825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.333435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.351658 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1438/2881] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:32.365781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.376293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329aae5-0ab2-4d3d-96fa-b8b0c85a8cbb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.382642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.382986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:32.383397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.383879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.384329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.385159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:32.385960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.388376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.389495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:32.405414 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1439/2882] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:32.410077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.420153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1444/2883] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:32.424311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6866e7-99f6-44cb-84c9-d2010efe43e6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.424872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.433925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.436572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.437107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.438353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.440977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.444303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.469762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf423c-385e-442a-ad79-83313944caa8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.477530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.478896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.479359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.479976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.480948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.485504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.618796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1440/2884] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:32.618796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.688950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1445/2885] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:32.690308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.718264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7a63-5add-496e-aae1-99e892e46280 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.780135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f86dd-275b-4c69-ab64-40bd8d679368 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.786229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.786849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.787148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.787437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.788089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.790289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.804906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.805682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.805870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.806177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.806919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:32.807216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.809062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.829815 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1441/2886] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:32.829815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.838397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fb7e8-cdc6-4690-9653-f7374139b2dd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.843955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.844760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.845153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.845489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.846277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.848600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.937218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1446/2887] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:32.939051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:32.956736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb688dd-704f-4194-8a0c-c7d32045007a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:32.967946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:32.967946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:32.967946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:32.967946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:32.969743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:32.970036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:32.997442 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1442/2888] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:32.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.014664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059898-ea73-4481-9cb8-dfccf4a83c4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.025282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.026553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.027290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.027678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.028945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.032677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.058176 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1443/2889] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:33.058176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.078823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846a594-31c5-4af4-a4b6-4393d6f148a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.085879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.085879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.085879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.086882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.088719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.090941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.108238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1444/2890] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:33.110207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.116777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1447/2891] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:32 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:33.134350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219810e-b255-4f10-9b11-69fc7a4aed60 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.139174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.208299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.209333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.209790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.210227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.211361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.214196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.235522 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1445/2892] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:33.235522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.237527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828817-3c9e-4ba4-90a2-1ec80b4c61ed admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.253684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.264624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.264624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.264624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.264624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.264624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.265134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a58b5-4ff3-4161-9c4f-75a127d15ed3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.272991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.275037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.275556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.276053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.277498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.281780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.308469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1446/2893] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:33.310370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.341200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699735f6-9764-4828-9f4b-d69c1cd941b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.352015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.359224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.359224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.359224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] PATH_INFO: `/v3/projects/dda732d949d0462c804ecd66ed0a9936/users/f67d20e38f1848689e13672f96a6c750/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.387566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda732d949d0462c804ecd66ed0a9936, user_id=f67d20e38f1848689e13672f96a6c750, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.393781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.396662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1448/2894] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:33 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:33.397208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.416671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2afd5-7b49-488f-8d07-d3c1875f951a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.425352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.426141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.426548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.426968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] PATH_INFO: `/v3/projects/1b371bd21fb44fc1948e03029ee437c3/users/2d4bf3d5375d4931be76850f6eb372a2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.461848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b371bd21fb44fc1948e03029ee437c3, user_id=2d4bf3d5375d4931be76850f6eb372a2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:33.471569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74336d-cb74-4eaf-af98-49c9711cc3dc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:33.591620 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1447/2895] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:33 2022] PUT /identity/v3/projects/dda732d949d0462c804ecd66ed0a9936/users/f67d20e38f1848689e13672f96a6c750/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:33.613229 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1449/2896] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:33 2022] PUT /identity/v3/projects/1b371bd21fb44fc1948e03029ee437c3/users/2d4bf3d5375d4931be76850f6eb372a2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:33.613229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308d7-ffbf-41f2-9b49-67017ea0bfc4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.613229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308d7-ffbf-41f2-9b49-67017ea0bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.613229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308d7-ffbf-41f2-9b49-67017ea0bfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.616211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:33.721200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-52f308d7-ffbf-41f2-9b49-67017ea0bfc4 None None] MFA Rules not processed for user `f67d20e38f1848689e13672f96a6c750`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:33.727101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52f308d7-ffbf-41f2-9b49-67017ea0bfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:33.849401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d4608-b177-48a1-8130-3f433b33fcec admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:33.897555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1450/2897] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:33.900207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730ea2-b585-48e9-9bd7-055a03a6e2ef None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.901043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730ea2-b585-48e9-9bd7-055a03a6e2ef None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.901320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4730ea2-b585-48e9-9bd7-055a03a6e2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.952577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e4730ea2-b585-48e9-9bd7-055a03a6e2ef None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:33.952577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4730ea2-b585-48e9-9bd7-055a03a6e2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:33.980998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:33.981928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:33.982383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:33.982827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:33.997271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.009155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.045633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1451/2898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:34.047951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.048554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.049014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.050052 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1448/2899] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:34.053273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.058738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.086081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:34.087515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.206561 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1452/2900] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:34.208274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.227388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:34.248252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1414bd2-424b-47f2-b609-a65419a3aa9d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.264760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcb260-ea7a-44e5-a3eb-8460470e20d9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.274849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.275559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.276591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.279626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.280638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.282460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.284127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.284523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.284896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.286574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.307257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.308463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1453/2901] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:34.309483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.312939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.313551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.325105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1449/2902] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:34.338950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.341953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.398058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8de117-509f-4b77-a007-18a165b74ae1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.405099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.405733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.406035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.407056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.423962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.426084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.442046 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1454/2903] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:34.443225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.456654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dcf3f-95e6-4641-920f-86766a34e5c1 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.462076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fac38b-e8ac-42ec-bd28-e29d5dca9d75 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.463075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.463941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.464408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.464972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] PATH_INFO: `/v3/projects/cc07510f94da475a8287361d97c0de06/users/bd15048680ee4daa91b3c7a10e1cd4ec/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.472641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.474048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.474674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.475231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.489210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc07510f94da475a8287361d97c0de06, user_id=bd15048680ee4daa91b3c7a10e1cd4ec, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.492272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686b36e-2c05-42d4-9713-b14cf24cb3eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.492461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.497547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.524481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1450/2904] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:34.599419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.618622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a92d4e-81fd-411d-ba74-1cee1fdf377f service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:34.627247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:34.628246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.628762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.629247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] PATH_INFO: `/v3/users/f67d20e38f1848689e13672f96a6c750` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.631684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67d20e38f1848689e13672f96a6c750)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:34.634864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:34.721653 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1455/2905] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:34 2022] PUT /identity/v3/projects/cc07510f94da475a8287361d97c0de06/users/bd15048680ee4daa91b3c7a10e1cd4ec/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:34.726902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63ecf-d673-4f13-ba26-6dd4cbb60eec None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.727143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63ecf-d673-4f13-ba26-6dd4cbb60eec None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.727616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63ecf-d673-4f13-ba26-6dd4cbb60eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.773208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9cd63ecf-d673-4f13-ba26-6dd4cbb60eec None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:34.774534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9cd63ecf-d673-4f13-ba26-6dd4cbb60eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.868328 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1456/2906] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:34.881517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133444-545e-452d-a643-9bb8883073de None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:34.881793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133444-545e-452d-a643-9bb8883073de None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:34.882056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a133444-545e-452d-a643-9bb8883073de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:34.911410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0a133444-545e-452d-a643-9bb8883073de None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:34.913109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a133444-545e-452d-a643-9bb8883073de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:34.921734 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1457/2907] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:34.927241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133444-545e-452d-a643-9bb8883073de None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:34.927241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a133444-545e-452d-a643-9bb8883073de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.077329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a133444-545e-452d-a643-9bb8883073de None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:35.088050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:35.089179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.089849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.090386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] PATH_INFO: `/v3/users/da4d37ab3d0b40d59bdba72582fa86ad` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.093940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4d37ab3d0b40d59bdba72582fa86ad)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:35.098274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:35.166468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67d20e38f1848689e13672f96a6c750'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.330835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67d20e38f1848689e13672f96a6c750'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.354798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67d20e38f1848689e13672f96a6c750'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.371655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67d20e38f1848689e13672f96a6c750'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.373066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67d20e38f1848689e13672f96a6c750'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.389867 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1451/2908] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:34 2022] DELETE /identity/v3/users/f67d20e38f1848689e13672f96a6c750 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:35.391327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:35.393054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.504056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4d37ab3d0b40d59bdba72582fa86ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.512747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96fd0b-bac0-4afc-b4a9-672b56195cb9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:35.521154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:35.522701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.523331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.523906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.526933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.647634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:35.650763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0048bdd-a3d0-4f93-9a60-b3d9bc076db1 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:35.668393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4d37ab3d0b40d59bdba72582fa86ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.676048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1452/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:35.678973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f287a-0e8b-4d25-a83c-d51f6ddcf88e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.679595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f287a-0e8b-4d25-a83c-d51f6ddcf88e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.680151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f287a-0e8b-4d25-a83c-d51f6ddcf88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.715221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4d37ab3d0b40d59bdba72582fa86ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.716538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4d37ab3d0b40d59bdba72582fa86ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.720428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e4d4f0c-8f43-41c2-9b80-f597372a48b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4d37ab3d0b40d59bdba72582fa86ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:35.730429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c06f287a-0e8b-4d25-a83c-d51f6ddcf88e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:35.730429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c06f287a-0e8b-4d25-a83c-d51f6ddcf88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.764150 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1458/2910] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:34 2022] DELETE /identity/v3/users/da4d37ab3d0b40d59bdba72582fa86ad => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:35.765952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853d71-222b-4de0-9326-f4186be08733 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.766626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853d71-222b-4de0-9326-f4186be08733 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.767235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06853d71-222b-4de0-9326-f4186be08733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.795394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-06853d71-222b-4de0-9326-f4186be08733 None None] MFA Rules not processed for user `d03db5013be642b88ea298fba0d87f20`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:35.797851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06853d71-222b-4de0-9326-f4186be08733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.955001 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1459/2911] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:35.955001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.955001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.955001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.955542 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1453/2912] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:35.955542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159345-509e-4399-ae67-24bd6a5332be None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:35.955542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159345-509e-4399-ae67-24bd6a5332be None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:35.955542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159345-509e-4399-ae67-24bd6a5332be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:35.981086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:35.981915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b9159345-509e-4399-ae67-24bd6a5332be None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:35.982735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:35.983946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b9159345-509e-4399-ae67-24bd6a5332be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:36.128682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1460/2913] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:36.128682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:36.141585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:36.240387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:36.294416 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1454/2914] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:36.296991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:36.297450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:36.297917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:36.363219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:36.366800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:36.384152 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1455/2915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:36.391659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:36.414636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7378e9c-061f-4958-a46f-3f50dbf1b73d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:36.426937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a12c713-b5bc-490c-9a18-46b138005c5c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:36.435742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:36.438071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:36.439012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:36.440538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:36.451961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:36.456362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:36.457038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:36.461906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:36.470379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:36.473924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451d6f7-9c7c-4b02-8b6b-d28b60b6d36c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:36.503024 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1456/2916] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:36.545292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:36.556979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f702c-e23b-4c63-a7ee-1f83655bf687 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:36.587602 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1461/2917] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:37.153526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1248fe-56a3-4cc0-b781-da4c04f05418 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.154039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1248fe-56a3-4cc0-b781-da4c04f05418 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.154534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1248fe-56a3-4cc0-b781-da4c04f05418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.242318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ef1248fe-56a3-4cc0-b781-da4c04f05418 None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:37.244468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ef1248fe-56a3-4cc0-b781-da4c04f05418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:37.279258 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1457/2918] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:37.647741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.647741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.647741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.729878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] MFA Rules not processed for user `bd15048680ee4daa91b3c7a10e1cd4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:37.735486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:37.772986 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1462/2919] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:37.844405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.844405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.844405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:37.863099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:37.877845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:37.881763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] MFA Rules not processed for user `d03db5013be642b88ea298fba0d87f20`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:37.883405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:37.906939 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1458/2920] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:37.949511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd243fc5-c21d-4f7d-9d65-b97d4966e11c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:37.997556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:37.998791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:37.999230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:37.999704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] PATH_INFO: `/v3/users/bd15048680ee4daa91b3c7a10e1cd4ec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:38.014819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd15048680ee4daa91b3c7a10e1cd4ec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:38.019399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:38.093185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:38.102402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:38.154477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff82e-714b-4289-ae11-2ada056edab8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:38.183129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:38.184144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:38.184578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:38.184982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] PATH_INFO: `/v3/projects/b8ee21f74a1d415f9f42599927a503d8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:38.187153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ee21f74a1d415f9f42599927a503d8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:38.192535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:38.612522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd15048680ee4daa91b3c7a10e1cd4ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.615013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ee21f74a1d415f9f42599927a503d8', 'request_id': 'req-7cad8cff-5c03-4ee6-b858-a602356be44c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.647941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ee21f74a1d415f9f42599927a503d8', 'request_id': 'req-7cad8cff-5c03-4ee6-b858-a602356be44c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.673077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ee21f74a1d415f9f42599927a503d8', 'request_id': 'req-7cad8cff-5c03-4ee6-b858-a602356be44c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.820935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd15048680ee4daa91b3c7a10e1cd4ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.868845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd15048680ee4daa91b3c7a10e1cd4ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.872757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd15048680ee4daa91b3c7a10e1cd4ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.874675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3550c125-5694-473b-90c0-0eb38d163c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd15048680ee4daa91b3c7a10e1cd4ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:38.936841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1463/2921] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:37 2022] DELETE /identity/v3/users/bd15048680ee4daa91b3c7a10e1cd4ec => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:38.940385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:38.941448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:38.942085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:38.992342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:38.994787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:39.094677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] The token cache is being invalidate because project b8ee21f74a1d415f9f42599927a503d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:39.095321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.097105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.099066 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1459/2922] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:38 2022] DELETE /identity/v3/projects/b8ee21f74a1d415f9f42599927a503d8 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:39.099955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:39.103737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:39.220433 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1464/2923] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:39.222068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:39.222634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:39.225556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:39.250369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982580b-72ed-4c8d-bcfd-d5cf5330d382 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:39.262196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:39.266500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:39.267284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:39.268118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] PATH_INFO: `/v3/users/43e8d04980604c4586f89b32e4c5ee1b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:39.272539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e8d04980604c4586f89b32e4c5ee1b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:39.277688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:39.310222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8cff-5c03-4ee6-b858-a602356be44c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:39.331856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:39.332399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:39.332705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:39.332980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] PATH_INFO: `/v3/projects/dda732d949d0462c804ecd66ed0a9936` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:39.334604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda732d949d0462c804ecd66ed0a9936)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:39.337623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:39.610346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda732d949d0462c804ecd66ed0a9936', 'request_id': 'req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.619830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda732d949d0462c804ecd66ed0a9936', 'request_id': 'req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.638544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda732d949d0462c804ecd66ed0a9936', 'request_id': 'req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.794440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:39.803346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e8d04980604c4586f89b32e4c5ee1b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.808176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] The token cache is being invalidate because project dda732d949d0462c804ecd66ed0a9936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:39.808459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.811765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.815541 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1460/2924] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:39 2022] DELETE /identity/v3/projects/dda732d949d0462c804ecd66ed0a9936 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:39.816804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:39.821203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:39.942549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e8d04980604c4586f89b32e4c5ee1b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.973177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e8d04980604c4586f89b32e4c5ee1b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.974555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e8d04980604c4586f89b32e4c5ee1b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.976949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f3db283-11f8-4e90-931d-f1361b7a8d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e8d04980604c4586f89b32e4c5ee1b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:39.995552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e54c2-9d56-4c21-875d-362f36f8d1a2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:39.995552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:39.995552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:39.995552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:39.996027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:39.996027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:40.021325 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1465/2925] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:39 2022] DELETE /identity/v3/users/43e8d04980604c4586f89b32e4c5ee1b => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:40.026247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.044874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.044874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.108467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:40.112116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:40.169589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:40.173533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9808c22-f4fb-49aa-aca1-ed808ffcd852 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:40.192822 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1461/2926] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:40.244771 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1466/2927] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:40.255928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.256194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.256781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.313748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:40.316026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:40.345976 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1462/2928] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:40.353540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.369827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81642e0-4efc-4014-9200-b8b52a05c4a1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.379463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.380710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.382861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.383211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.385208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:40.385769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:40.387831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:40.405294 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1467/2929] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:40.412742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.427008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6b008-ef84-4a6f-b638-383ac34b2855 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.433458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.434614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.435051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.435596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.436960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:40.442137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:40.716538 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1463/2930] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:40 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:40.721828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:40.747001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e43aa-d92a-4ede-b445-fed02b169ce6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:40.993430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:40.995495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:40.996087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:40.996670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:40.997812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.004011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.241212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.244963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:41.280300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1468/2931] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:40 2022] POST /identity/v3/users => generated 287 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:41.285575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.310020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c670a0-432f-4f47-a6c8-87d539db3153 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.336461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.337230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.338617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.339196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.341976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.345774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.430506 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1469/2932] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:40:41.444338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.462731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980bf8b7-52f4-4fd1-9b60-619109b859b7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.478858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3b187-cadd-4cea-9893-34a1b885fbd5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.489520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.490643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.491151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.491639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.495190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:41.498608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.499782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.500069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.501314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.513636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.513636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.524036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.529837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.551087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1464/2933] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:41.553565 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1470/2934] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:40:41.563808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.589993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41503f08-4509-4635-8fdb-e3ba15a8d84c service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.604753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:41.606999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.607878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.608738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] PATH_INFO: `/v3/projects/feda62220be34c3ba9917176fb75f95f/users/6e170406c98d4785bcf2b7aad09d87ad/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.652207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feda62220be34c3ba9917176fb75f95f, user_id=6e170406c98d4785bcf2b7aad09d87ad, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:41.655361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b505709-a1d2-463e-a22f-e0bccfc7ef43 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:41.777725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:41.780268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:41.787835 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1465/2935] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:41 2022] PUT /identity/v3/projects/feda62220be34c3ba9917176fb75f95f/users/6e170406c98d4785bcf2b7aad09d87ad/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:41.802677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:41.803355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:41.804128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:41.824169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0e387-b230-44a7-8d7e-84d5f4453564 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:41.871515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] MFA Rules not processed for user `6e170406c98d4785bcf2b7aad09d87ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:41.876898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:42.008545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:42.009418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:42.009701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:42.009981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] PATH_INFO: `/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:42.014323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41ac92e9fa3441caca183e1b5e5bab8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:42.031103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:42.230587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1466/2936] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:42.241101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41ac92e9fa3441caca183e1b5e5bab8', 'request_id': 'req-7076192a-f5cb-4e7f-b15e-55d3a7176964'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:42.252893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41ac92e9fa3441caca183e1b5e5bab8', 'request_id': 'req-7076192a-f5cb-4e7f-b15e-55d3a7176964'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:42.317232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:42.318842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:42.578621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbb05c-39e9-4766-ad77-0d1784cbf31a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:42.592891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41ac92e9fa3441caca183e1b5e5bab8', 'request_id': 'req-7076192a-f5cb-4e7f-b15e-55d3a7176964'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:42.619122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] The token cache is being invalidate because project f41ac92e9fa3441caca183e1b5e5bab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:42.619482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:42.622820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7076192a-f5cb-4e7f-b15e-55d3a7176964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:42.633622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1471/2937] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:41 2022] DELETE /identity/v3/projects/f41ac92e9fa3441caca183e1b5e5bab8 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:42.636557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc1e4-292e-4d60-8011-70f3b0adfe7e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:42.636849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc1e4-292e-4d60-8011-70f3b0adfe7e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:42.637123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc1e4-292e-4d60-8011-70f3b0adfe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:42.726134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5f6cc1e4-292e-4d60-8011-70f3b0adfe7e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:42.727597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f6cc1e4-292e-4d60-8011-70f3b0adfe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:42.928932 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1472/2938] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:42.931118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:42.931642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:42.932293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:42.933748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:42.934814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:42.934814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:42.935201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:42.939267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:42.963903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:42.965773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:42.976270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1473/2939] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:42.986377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:43.019148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647460d5-11f1-475c-806c-ca60d2057b69 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:43.035279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:43.037449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.037957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.038432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.039766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:43.040481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:43.045323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:43.061120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:43.063580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:43.085365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1467/2940] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 769 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:40:43.090219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1474/2941] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:43.110928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:43.158213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1250e1c-5581-4cfb-ace6-c8dd36d01b70 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:43.182124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:43.184660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.184660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.184660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.184660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:43.187037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:43.337667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1468/2942] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:43 2022] POST /identity/v3/projects => generated 391 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:43.346542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:43.355484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:43.362942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:43.441181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089a80-63ca-4db4-b925-c2df5ccd64bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:43.613894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de4b20-3c52-4216-b860-7686825e9fcf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:43.628708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:43.629348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.633003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.633332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.634017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:43.646877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:43.651355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:43.655720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:43.655720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:43.657621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] PATH_INFO: `/v3/projects/cc07510f94da475a8287361d97c0de06` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:43.662984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc07510f94da475a8287361d97c0de06)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:43.665034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:43.878846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1469/2943] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:43 2022] POST /identity/v3/users => generated 296 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:43.888113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:43.951138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc07510f94da475a8287361d97c0de06', 'request_id': 'req-108abb7b-5a28-425f-a551-bc64e7c21fd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:43.951758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222085-c333-4f9f-ad18-9f50758d7ef2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:43.967818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc07510f94da475a8287361d97c0de06', 'request_id': 'req-108abb7b-5a28-425f-a551-bc64e7c21fd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:44.125440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc07510f94da475a8287361d97c0de06', 'request_id': 'req-108abb7b-5a28-425f-a551-bc64e7c21fd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:44.152091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] The token cache is being invalidate because project cc07510f94da475a8287361d97c0de06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:44.153089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:44.155065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-108abb7b-5a28-425f-a551-bc64e7c21fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:44.158787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1475/2944] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:43 2022] DELETE /identity/v3/projects/cc07510f94da475a8287361d97c0de06 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:44.164622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f56cd1-69bb-4c6d-ad95-ff6873c11ac1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.165156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f56cd1-69bb-4c6d-ad95-ff6873c11ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.167718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f56cd1-69bb-4c6d-ad95-ff6873c11ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.265280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-65f56cd1-69bb-4c6d-ad95-ff6873c11ac1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:44.276726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-65f56cd1-69bb-4c6d-ad95-ff6873c11ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:44.295209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.296243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.301887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.301887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.302746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.319591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.323796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1476/2945] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:44.328426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.333744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.335358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.370658 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1470/2946] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:44.378214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.398333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:44.414831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:44.425654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:44.436172 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1477/2947] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:44.438062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.457579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6460d1c-4214-4c1e-98e3-14edca836536 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.472296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610bf21-8996-46d5-8f17-f1b510ab5112 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.481136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.482312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.483104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.483622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.485167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:44.486081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.488382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.495127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.496253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.501653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.501653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.501653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.504366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1478/2948] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:44.509042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.529560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.543223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e34782-ce9d-4a43-a291-3069545f6ee8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.554621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.556251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.556994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.557633 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1471/2949] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:44.558523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.559788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.562387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.578203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.616560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a835a01-a429-426d-b13c-bced7987d435 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.632076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:44.633136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.633576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.634002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] PATH_INFO: `/v3/projects/271f7632e1bc4beaa12b86a4a7c945ac/users/68c5007e674247d3bcf3015ce7555262/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.686395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271f7632e1bc4beaa12b86a4a7c945ac, user_id=68c5007e674247d3bcf3015ce7555262, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:44.692127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740e61b-ce12-4ec0-86d3-3cc2ea186cf9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:44.751656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1479/2950] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:44 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:44.753202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:44.851482 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1472/2951] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:44 2022] PUT /identity/v3/projects/271f7632e1bc4beaa12b86a4a7c945ac/users/68c5007e674247d3bcf3015ce7555262/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:44.875906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:44.877311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:44.877311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:44.904994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b0157-9507-4612-9f38-340143b47ca8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:44.910160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:44.995556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] MFA Rules not processed for user `68c5007e674247d3bcf3015ce7555262`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:44.997835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:45.031848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.033602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.034136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.036888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.039821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.042656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.198571 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1480/2952] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:44 2022] POST /identity/v3/users => generated 288 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:45.201523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.201843 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1473/2953] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:45.238392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.241180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8685698-ae85-4aab-908e-e71e08c631c3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.247993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.249070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.249618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.251006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.251891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.256188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.257480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e80925-ae6c-496c-b00f-df52ec2cd54f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.275726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.276613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.284625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.285363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.295116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.307667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.334110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:45.342768 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1481/2954] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:45.346460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.376927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed293df4-2859-4733-8c1b-3b675be632dc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.392782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.410860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1474/2955] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:45 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:45.411837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.415733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.416532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.417901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.421051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.430713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.485009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1482/2956] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:45.485009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.548418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92db7c-6457-4159-8de6-b245fa011191 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.658878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2497-28f0-4d17-a60c-f33eb66ab962 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.670870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.673135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.674731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.675547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.676677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.679705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.738626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.750546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.750546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.750546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] PATH_INFO: `/v3/projects/f3fd137af33941589ef15699c4d59ffc/users/5ad02f7d8d7d43fb82270c0541c2343b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.779925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fd137af33941589ef15699c4d59ffc, user_id=5ad02f7d8d7d43fb82270c0541c2343b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.802608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c8ecd-faeb-4c72-aa5e-4a824820ec57 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.870112 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1475/2957] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:45 2022] POST /identity/v3/users => generated 302 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:45.872620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.898677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c501e-a9e3-4740-8285-db6ddd1d77db admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:45.910784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:45.912932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.914256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.914884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:45.916355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:45.920211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:45.949079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1476/2958] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:40:45.954639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:45.979100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1483/2959] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:45 2022] PUT /identity/v3/projects/f3fd137af33941589ef15699c4d59ffc/users/5ad02f7d8d7d43fb82270c0541c2343b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:45.988895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:45.989431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:45.991085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.027241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f2810-1d44-4f8a-82a7-ac59b11fd9f8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:46.085849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:46.089310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:46.167302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:46.168083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:46.168375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:46.169685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] PATH_INFO: `/v3/projects/b4fbf34d98834a2ba93963a2f06ca483/users/bb467af767924fb988534fa6d84e65ca/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.201136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fbf34d98834a2ba93963a2f06ca483, user_id=bb467af767924fb988534fa6d84e65ca, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:46.204709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:46.231830 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1484/2960] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:46.301148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:46.302777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:46.353878 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1477/2961] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:45 2022] PUT /identity/v3/projects/b4fbf34d98834a2ba93963a2f06ca483/users/bb467af767924fb988534fa6d84e65ca/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:46.360105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:46.480318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecee2-5bc6-4a8d-9158-9a9602b631b1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:46.632672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:46.633476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:46.633661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:46.633968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.636310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aa839-00d1-4959-bfa5-839c2ce375a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:46.643894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:46.645987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:46.645987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:46.646327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:46.646490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.648358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:46.648615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:46.650564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02531511-1bc8-419f-86ea-06a3768b3902 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:46.660441 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1485/2962] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:40:46.673071 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1478/2963] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:46.678041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:46.697595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba415a7b-35da-4c76-bd95-8baac0dd3539 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:46.707839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:46.712874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:46.712874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:46.712874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] PATH_INFO: `/v3/projects/b4fbf34d98834a2ba93963a2f06ca483/users/bb467af767924fb988534fa6d84e65ca/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.714415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fbf34d98834a2ba93963a2f06ca483, user_id=bb467af767924fb988534fa6d84e65ca, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:46.720294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:46.734201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1486/2964] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:46 2022] PUT /identity/v3/projects/b4fbf34d98834a2ba93963a2f06ca483/users/bb467af767924fb988534fa6d84e65ca/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:46.754045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713fac0-6a76-4775-9adb-eec21005aa72 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:46.760909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713fac0-6a76-4775-9adb-eec21005aa72 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:46.760909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713fac0-6a76-4775-9adb-eec21005aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:46.808581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6713fac0-6a76-4775-9adb-eec21005aa72 None None] MFA Rules not processed for user `bb467af767924fb988534fa6d84e65ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:46.822520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6713fac0-6a76-4775-9adb-eec21005aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:46.964906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1479/2965] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:47.490845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:47.494244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:47.629371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed32c-9b0d-4c31-a4c5-8947f7589611 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:47.636867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:47.638650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.638939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.639738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.650367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:47.652949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:47.665250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1487/2966] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:47.973792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:47.974314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:47.974314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:40:47.980972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:47.982144 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:40:47.986987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1480/2967] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:40:48.358985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:48.698983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:48.716955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5f847-ee82-4d75-88f2-73e1ab6cd1c0 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:48.727550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:48.729174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:48.729614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:48.729944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:48.832419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:48.834594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347366d3-98be-496f-ac26-68f24c7285dd service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:48.846996 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1488/2968] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:48.910798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:49.041110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:49.042494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:49.043259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:40:49.077661 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:40:49.079742 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:40:49.080806 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1489/2969] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:40:49 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:40:49.139402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:49.175835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58021ae-1caa-4778-bedb-37d1901980c1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:49.197199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:49.198696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:49.198988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:49.199443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] PATH_INFO: `/v3/users/68c5007e674247d3bcf3015ce7555262` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:49.201272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68c5007e674247d3bcf3015ce7555262)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:49.205356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:49.511715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68c5007e674247d3bcf3015ce7555262'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:49.640800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68c5007e674247d3bcf3015ce7555262'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:49.672892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68c5007e674247d3bcf3015ce7555262'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:49.686220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68c5007e674247d3bcf3015ce7555262'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:49.687873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68c5007e674247d3bcf3015ce7555262'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:49.701018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1481/2970] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:48 2022] DELETE /identity/v3/users/68c5007e674247d3bcf3015ce7555262 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:49.705178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:49.706899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:49.707413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:49.745506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:49.747634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:49.844195 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1490/2971] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:49.855338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:49.858102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:49.955809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e0fe3-64f0-4178-8747-936c7ffc747f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:49.961498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:49.962890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:49.963414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:49.964091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:49.976915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:49.979080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8e86a-3e74-4fb3-bd31-96bda1b05462 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:49.999207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1482/2972] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:40:50.366173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:50.371868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:50.426734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e48347-52c1-43b1-b23f-9de78f50eff6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:50.446622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:50.447850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:50.448931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:50.449711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] PATH_INFO: `/v3/users/6e170406c98d4785bcf2b7aad09d87ad` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:50.453311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e170406c98d4785bcf2b7aad09d87ad)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:50.459221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:50.829135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e170406c98d4785bcf2b7aad09d87ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:50.924962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e170406c98d4785bcf2b7aad09d87ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:50.949854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e170406c98d4785bcf2b7aad09d87ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:50.950510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e170406c98d4785bcf2b7aad09d87ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:50.951527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e170406c98d4785bcf2b7aad09d87ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:50.981865 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1491/2973] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:50 2022] DELETE /identity/v3/users/6e170406c98d4785bcf2b7aad09d87ad => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:50.987149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:50.987800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:50.987800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:51.056316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:51.058528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:51.193107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:51.315123 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1483/2974] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:51.424575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:51.426694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:51.625273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb986-ba55-44ff-9925-5d2d7a44092f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:51.649573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:51.653422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:51.654154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:51.654915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:51.730801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:51.743023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:51.772858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1492/2975] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:52.541881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:53.036116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:53.041292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:53.061404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f78ea-ccde-4591-beb2-134af20e53dc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:53.068130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:53.069264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:53.069786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:53.070274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] PATH_INFO: `/v3/projects/271f7632e1bc4beaa12b86a4a7c945ac` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:53.072088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271f7632e1bc4beaa12b86a4a7c945ac)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:53.074950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:53.210127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:53.287251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271f7632e1bc4beaa12b86a4a7c945ac', 'request_id': 'req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:53.298466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271f7632e1bc4beaa12b86a4a7c945ac', 'request_id': 'req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:53.309102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271f7632e1bc4beaa12b86a4a7c945ac', 'request_id': 'req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:53.392071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] The token cache is being invalidate because project 271f7632e1bc4beaa12b86a4a7c945ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:53.392071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:53.392580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:53.398238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1484/2976] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:53 2022] DELETE /identity/v3/projects/271f7632e1bc4beaa12b86a4a7c945ac => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:53.402273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:53.422450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab38c6-f922-40a5-98db-7871ccd50faf service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:53.591035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:53.592172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:53.593582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:53.603438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] PATH_INFO: `/v3/users/bb467af767924fb988534fa6d84e65ca` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:53.603438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb467af767924fb988534fa6d84e65ca)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:53.607787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:53.993433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb467af767924fb988534fa6d84e65ca'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.119888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb467af767924fb988534fa6d84e65ca'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.142838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:54.144409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:54.161689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb467af767924fb988534fa6d84e65ca'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.162946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb467af767924fb988534fa6d84e65ca'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.163673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c244e246-9604-4133-90c2-e585d6e42584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb467af767924fb988534fa6d84e65ca'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.166695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8b4c7-0db0-431d-9ed5-d24a4c9048c8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:54.182328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:54.183262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.183741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.184208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] PATH_INFO: `/v3/projects/feda62220be34c3ba9917176fb75f95f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.186418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=feda62220be34c3ba9917176fb75f95f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:54.189211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:54.197468 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1493/2977] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:40:53 2022] DELETE /identity/v3/users/bb467af767924fb988534fa6d84e65ca => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:54.414540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feda62220be34c3ba9917176fb75f95f', 'request_id': 'req-42316cd2-6b96-4aae-97a8-ee79804d6a1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.425978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feda62220be34c3ba9917176fb75f95f', 'request_id': 'req-42316cd2-6b96-4aae-97a8-ee79804d6a1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.445136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feda62220be34c3ba9917176fb75f95f', 'request_id': 'req-42316cd2-6b96-4aae-97a8-ee79804d6a1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.537291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] The token cache is being invalidate because project feda62220be34c3ba9917176fb75f95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:54.538123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.539236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42316cd2-6b96-4aae-97a8-ee79804d6a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:54.543678 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1485/2978] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:54 2022] DELETE /identity/v3/projects/feda62220be34c3ba9917176fb75f95f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:54.553675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.554715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.555261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.581154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:54.582784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:54.707400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1494/2979] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:54.717385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.718136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.719194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.758275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:54.780435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:54.818477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:54.819606 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1486/2980] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:54.842244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65471e6-43d7-4f29-aaa9-797a48f7a2c7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:54.858144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:54.861349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.863034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.863566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.865440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:54.866226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:54.877825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:54.907609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:54.923603 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1495/2981] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:40:54.952209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74874fd-9561-48a3-afd0-ab23e7f62a5e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:54.973462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:54.974202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:54.976026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:54.976026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:54.976026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:54.978300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:55.084474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:55.151897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:55.152045 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1487/2982] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:54 2022] POST /identity/v3/projects => generated 399 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:55.173154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317df0-8270-46ff-94ea-233ea7bbeba7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:55.319181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:55.320269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:55.320852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:55.321393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:55.323022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:55.325484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:55.391616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:55.538450 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1496/2983] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:55 2022] POST /identity/v3/users => generated 300 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:55.541676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:55.563132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a12f-1570-4488-b1b1-89e3c4be806b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:55.578994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:55.579977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:55.580274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:55.585729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:55.585729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:55.585729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:55.605564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1488/2984] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:55.611119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:55.624887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa460eb-0d9d-45ee-a555-2b96b52a42b5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:55.647183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:55.652620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:55.653924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:55.654476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:55.657486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:55.665503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863d7a7-a6a6-49f6-8411-eeb57d6772b6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:55.686838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1497/2985] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:55.692192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:55.708559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fa9af-7f98-4b36-9e69-8c74129e763e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:55.723599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:55.724972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:55.725542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:55.729274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] PATH_INFO: `/v3/projects/c7ac1379307745cebba3fb9757ca990b/users/131bac915e2f483ebd6c54464431f8a3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:55.754398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ac1379307745cebba3fb9757ca990b, user_id=131bac915e2f483ebd6c54464431f8a3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:55.760294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:55.884637 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1489/2986] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:55 2022] PUT /identity/v3/projects/c7ac1379307745cebba3fb9757ca990b/users/131bac915e2f483ebd6c54464431f8a3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:55.890904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:55.891470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:55.891735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:55.934177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:55.936273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:56.118719 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1498/2987] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:56.140756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:56.144014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:56.147948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:56.160175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:56.229069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3dcd-db1f-4863-8f72-a663afc60239 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:56.250451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:56.251817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.252696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.253348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] PATH_INFO: `/v3/projects/b4fbf34d98834a2ba93963a2f06ca483` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.293310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fbf34d98834a2ba93963a2f06ca483)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:56.308449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:56.452975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f85da-4d55-4508-8bee-4e62be14b84e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:56.461834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:56.463072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.463535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.464282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.490535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:56.494153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920bd6e5-3398-4271-8271-63aec459a4c6 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:56.527686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1490/2988] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:40:56.605456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fbf34d98834a2ba93963a2f06ca483', 'request_id': 'req-961b202f-6470-4e26-b3e9-97eb0d06721b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:56.627201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fbf34d98834a2ba93963a2f06ca483', 'request_id': 'req-961b202f-6470-4e26-b3e9-97eb0d06721b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:56.804121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fbf34d98834a2ba93963a2f06ca483', 'request_id': 'req-961b202f-6470-4e26-b3e9-97eb0d06721b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:56.840684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] The token cache is being invalidate because project b4fbf34d98834a2ba93963a2f06ca483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:40:56.845280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:56.853360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-961b202f-6470-4e26-b3e9-97eb0d06721b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:40:56.868751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1499/2989] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:56 2022] DELETE /identity/v3/projects/b4fbf34d98834a2ba93963a2f06ca483 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:40:56.870550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:56.871211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:56.871915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:56.928721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:56.932324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:57.092194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:57.148634 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1491/2990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:40:57.152368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:57.153192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:57.153858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:57.199811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:57.201106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:57.220751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1500/2991] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:57.227495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:57.255480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114f7e7-e289-4508-8342-79a88a8e5cbf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:57.267345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:57.279844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:57.281251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:57.285161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:57.290557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:40:57.291738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:57.309192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde81158-9884-4bdf-9a08-db1992e78d37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:57.353361 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1492/2992] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:40:57.354442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:57.371252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599fd03-5231-435b-8ad1-0fcc9f9d228d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:57.426719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:57.427859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:57.429685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:57.432897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:57.436945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:57.444403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:57.588788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6d6-6c5b-4a74-bc93-feb739c6fbf1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:57.589620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1501/2993] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:40:57 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:40:57.594672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6d6-6c5b-4a74-bc93-feb739c6fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:57.594672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7f6d6-6c5b-4a74-bc93-feb739c6fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:57.599516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:57.622883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:57.743036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cda7f6d6-6c5b-4a74-bc93-feb739c6fbf1 None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:57.753026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cda7f6d6-6c5b-4a74-bc93-feb739c6fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:57.915454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf74440-e626-4fde-b71b-ec67dccb2de3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:57.923628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:57.924266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:57.924751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:57.925213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:57.927271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:57.931450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:58.067580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1502/2994] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:40:57 2022] POST /identity/v3/users => generated 293 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:40:58.071588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:58.094478 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1493/2995] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:58.105325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af5a1c-36b2-4884-8c17-87ca8351e27f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:58.120391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682c747-f317-4437-af61-5f81ee4c7322 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:58.123181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:58.123971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:58.126081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:58.126405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:58.127148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682c747-f317-4437-af61-5f81ee4c7322 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:58.127351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:58.129076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:58.133772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682c747-f317-4437-af61-5f81ee4c7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:58.159317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1503/2996] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:58.164926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:58.191781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a060901-3aeb-4281-9ac4-febbe1cd837c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:58.205079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:58.205685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:58.205960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:58.206228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:58.206899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:58.210987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:58.239645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6682c747-f317-4437-af61-5f81ee4c7322 None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:58.242074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6682c747-f317-4437-af61-5f81ee4c7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:58.251831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1504/2997] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:40:58.256012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:58.273814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1494/2998] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:58.279226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28382b12-4da5-4a86-8398-65d563f040d1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:58.293741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:58.294426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:58.294699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:58.294970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] PATH_INFO: `/v3/projects/47284988ba214419947db6506b8f8552/users/8b0cc8b23d7c43bba9c404d381f2a1bd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:58.340194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47284988ba214419947db6506b8f8552, user_id=8b0cc8b23d7c43bba9c404d381f2a1bd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:58.347155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:58.543738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1505/2999] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:40:58 2022] PUT /identity/v3/projects/47284988ba214419947db6506b8f8552/users/8b0cc8b23d7c43bba9c404d381f2a1bd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:40:58.547381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:58.548136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:58.548895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:58.602480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:40:58.606131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:58.661772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:58.771131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1495/3000] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:40:58.821734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:58.826959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:58.998406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee9c30-1e9d-49fb-ac53-cf688e41568d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:59.005470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:59.005470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.006101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.006781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.031701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:59.033215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e2d62-16a1-4d1f-922c-dc8a8aa87e13 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:59.069688 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1506/3001] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:40:59.144045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:40:59.146341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:40:59.349446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:59.395972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5f4b6-c23e-422c-8551-a53d40bf64e2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:40:59.412138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:40:59.413042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:40:59.413549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:40:59.414334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:40:59.576054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:40:59.579354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62755658-ddd6-4a3e-b04e-81f781b40b7b service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:40:59.608446 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1496/3002] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:40:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:41:00.377142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:00.377765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:00.378107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:00.403263 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:00.404466 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:41:00.405856 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1507/3003] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:41:00.470817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315185-2fa9-4c36-b3db-fb33905eb057 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:00.470817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315185-2fa9-4c36-b3db-fb33905eb057 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:00.470817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f315185-2fa9-4c36-b3db-fb33905eb057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:00.545540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0f315185-2fa9-4c36-b3db-fb33905eb057 None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:00.552155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0f315185-2fa9-4c36-b3db-fb33905eb057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:00.591531 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1497/3004] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:01.364416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:01.555042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:02.051028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.051308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.051836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:02.060067 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:02.066171 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:41:02.069211 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1508/3005] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:41:02.097661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ae1-d544-4af7-a8ac-8cdae59cb5ae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:02.103160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ae1-d544-4af7-a8ac-8cdae59cb5ae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:02.103160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77803ae1-d544-4af7-a8ac-8cdae59cb5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:02.138849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-77803ae1-d544-4af7-a8ac-8cdae59cb5ae None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:02.140774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-77803ae1-d544-4af7-a8ac-8cdae59cb5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:02.156051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1498/3006] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:02.495571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:02.971093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:04.090611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:04.091507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:04.091940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:04.099952 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:04.101111 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:41:04.110033 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1509/3007] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:41:04.149872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88329-58aa-42ab-874b-609db19a8619 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:04.153765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:04.153955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88329-58aa-42ab-874b-609db19a8619 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:04.153955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd88329-58aa-42ab-874b-609db19a8619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:04.185810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2bd88329-58aa-42ab-874b-609db19a8619 None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:04.187681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2bd88329-58aa-42ab-874b-609db19a8619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:04.214896 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1499/3008] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:05.173007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:05.544620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:05.973117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eaa8-d24b-4bab-9a28-3586685b230d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:05.973254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eaa8-d24b-4bab-9a28-3586685b230d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:05.973678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122eaa8-d24b-4bab-9a28-3586685b230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.035780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9122eaa8-d24b-4bab-9a28-3586685b230d None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:06.041194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9122eaa8-d24b-4bab-9a28-3586685b230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:06.286399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.287514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.288013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:06.295435 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:06.297443 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:41:06.302241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1510/3009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:06.304061 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1500/3010] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:41:06.370957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1f91-6e49-424a-8f7a-ceefa2d47801 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:06.370957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1f91-6e49-424a-8f7a-ceefa2d47801 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:06.371355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1f91-6e49-424a-8f7a-ceefa2d47801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:06.429921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3b0b1f91-6e49-424a-8f7a-ceefa2d47801 None None] MFA Rules not processed for user `2d4bf3d5375d4931be76850f6eb372a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:06.431283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3b0b1f91-6e49-424a-8f7a-ceefa2d47801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:06.445431 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1511/3011] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:07.039925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:07.661826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:08.256482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:08.576116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:08.576406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:08.576935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:08.595893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:08.598429 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:41:08.633700 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1501/3012] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 52 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:41:08.667163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:08.667796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:08.668299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:08.768119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] MFA Rules not processed for user `5ad02f7d8d7d43fb82270c0541c2343b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:08.769840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:09.008786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1512/3013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:09.445339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:09.970204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:10.380349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:10.431960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a05fd9-cf13-4df2-b524-fd32f4312c12 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:10.448638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:10.450183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:10.451259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:10.452369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:10.498598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:10.501621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:10.524359 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1502/3014] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:10.786374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:10.786374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:10.831009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ad94b-29d3-4d8d-a590-9c965d734c28 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:10.851604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:10.861305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:10.861792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:10.862901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] PATH_INFO: `/v3/users/99582f1c239d4209a1909c5a849de953` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:10.864687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] RBAC: Authorizing `identity:delete_user(user_id=99582f1c239d4209a1909c5a849de953)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:10.868386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:11.221886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:11.227014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:11.313265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8252b-eab3-4979-bc75-cbb391187d5b service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:11.340588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99582f1c239d4209a1909c5a849de953'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:11.344430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:11.345610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:11.346103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:11.346601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] PATH_INFO: `/v3/users/10f57760d0b5468b91c7b9666305dba9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:11.376325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f57760d0b5468b91c7b9666305dba9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:11.377843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:11.449996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99582f1c239d4209a1909c5a849de953'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:11.463075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:11.483544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99582f1c239d4209a1909c5a849de953'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:11.484403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99582f1c239d4209a1909c5a849de953'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:11.485084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd0372b9-3fe2-4a5b-bf4d-339f4355953a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99582f1c239d4209a1909c5a849de953'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:11.559532 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1513/3015] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:10 2022] DELETE /identity/v3/users/99582f1c239d4209a1909c5a849de953 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:11.844953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f57760d0b5468b91c7b9666305dba9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.015440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f57760d0b5468b91c7b9666305dba9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.047413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f57760d0b5468b91c7b9666305dba9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.088079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f57760d0b5468b91c7b9666305dba9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.089223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f57760d0b5468b91c7b9666305dba9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.105116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1503/3016] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:11 2022] DELETE /identity/v3/users/10f57760d0b5468b91c7b9666305dba9 => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:12.107185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:12.115457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:12.115457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:12.142777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:12.144310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:12.287766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1514/3017] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:12.299115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:12.303943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:12.432730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:12.447159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137e2e0-8cc6-4b46-82ab-1a293ad32422 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:12.473525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:12.476155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:12.478436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:12.478941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:12.495752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:12.502681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec607de-4689-4ad9-8ce4-e1cc39b6a1b3 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:12.553613 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1504/3018] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:12.673940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:12.676035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:12.703096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595020e-e014-4671-8b62-f6b6d68d6975 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:12.728264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:12.730870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:12.733165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:12.736668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] PATH_INFO: `/v3/projects/f871d4dccfa64340ae699fe84bb10a79` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:12.741991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f871d4dccfa64340ae699fe84bb10a79)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:12.748636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:12.962806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f871d4dccfa64340ae699fe84bb10a79', 'request_id': 'req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:12.973412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f871d4dccfa64340ae699fe84bb10a79', 'request_id': 'req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:13.072806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f871d4dccfa64340ae699fe84bb10a79', 'request_id': 'req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:13.111408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] The token cache is being invalidate because project f871d4dccfa64340ae699fe84bb10a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:13.112953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:13.119129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56fdf5c0-f07c-4d73-9c3e-e9cc839577bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:13.126181 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1515/3019] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:12 2022] DELETE /identity/v3/projects/f871d4dccfa64340ae699fe84bb10a79 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:13.140270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.140656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.140935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.202167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:13.203975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:13.300281 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1505/3020] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:13.308362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.308962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.309292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.360234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:13.365961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:13.394785 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1516/3021] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:13.399365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:13.412791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778e45-ecd1-449a-a7b7-4a17a142075d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:13.420061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:13.424849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.424849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.424849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.424849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:13.424849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:13.428529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:13.452892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:13.457271 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1506/3022] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:13.470012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582f231-fd79-4bf8-b571-f1592e1e939e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:13.478527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:13.479548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.481310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.482613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.484371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:13.489581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:13.692091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1517/3023] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:13 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:41:13.702978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:13.722033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57a12-d427-403e-ba39-67a8cbcd6261 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:13.912754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:13.914268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.917820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.917820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.917820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:13.918871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:13.920461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:13.921404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:13.947387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c6d-598d-4f11-8fc5-cb5bcd603562 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:13.962485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:13.963227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:13.963544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:13.963915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] PATH_INFO: `/v3/projects/d4fefce7b59b4135ab03a518f381e171` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:13.966493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4fefce7b59b4135ab03a518f381e171)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:13.975565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:14.137608 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1507/3024] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:13 2022] POST /identity/v3/users => generated 292 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:14.144266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:14.170444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46037d4-82cc-4693-9a4b-a15496d6f87c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:14.181829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:14.183350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:14.184191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:14.184958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:14.193346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:14.200877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:14.246246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4fefce7b59b4135ab03a518f381e171', 'request_id': 'req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.254015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4fefce7b59b4135ab03a518f381e171', 'request_id': 'req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.277643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1508/3025] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:14.284322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:14.299993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b3288-60f6-42ea-a35a-0449ed64ab85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:14.386885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4fefce7b59b4135ab03a518f381e171', 'request_id': 'req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.422611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] The token cache is being invalidate because project d4fefce7b59b4135ab03a518f381e171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:14.431335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.431335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.431335 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1518/3026] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:13 2022] DELETE /identity/v3/projects/d4fefce7b59b4135ab03a518f381e171 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:14.441354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:14.442254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:14.442451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:14.442640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:14.443020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:14.443278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:14.445002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564576bd-f687-49c0-a9bd-9e759b3a02e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:14.446031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:14.475935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18b68d-9a72-4f40-9d23-13f35d5e6ddd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:14.484234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:14.486311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:14.486589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:14.487037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] PATH_INFO: `/v3/users/151f362ff88343c6b140c49366d88954` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:14.490487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151f362ff88343c6b140c49366d88954)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:14.493013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:14.494923 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1509/3027] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:14.504288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:14.507232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:14.507232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:14.568855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] MFA Rules not processed for user `5ad02f7d8d7d43fb82270c0541c2343b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:14.570549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:14.738880 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1510/3028] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:14.738880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:14.789960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:14.868036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69cc2-5497-4da0-a8a3-e27019e5b5e8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:14.908830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:14.910726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:14.911984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:14.911984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] PATH_INFO: `/v3/projects/a62e260bcc524f18b03a968bb631891d/users/a826e2ebcf3a416ebbd0b2f00b314887/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:14.934522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151f362ff88343c6b140c49366d88954'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:14.951068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62e260bcc524f18b03a968bb631891d, user_id=a826e2ebcf3a416ebbd0b2f00b314887, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:14.954689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30084e3c-dcd3-4c12-a13b-bdf779e88225 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:15.021206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151f362ff88343c6b140c49366d88954'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:15.050361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151f362ff88343c6b140c49366d88954'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:15.055004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151f362ff88343c6b140c49366d88954'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:15.056952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151f362ff88343c6b140c49366d88954'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:15.062539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:15.072226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1511/3029] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:14 2022] PUT /identity/v3/projects/a62e260bcc524f18b03a968bb631891d/users/a826e2ebcf3a416ebbd0b2f00b314887/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:15.084687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33fcf-3adb-408e-8fb3-f4ed84f025da None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:15.089019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33fcf-3adb-408e-8fb3-f4ed84f025da None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:15.089929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a33fcf-3adb-408e-8fb3-f4ed84f025da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:15.117314 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1519/3030] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:14 2022] DELETE /identity/v3/users/151f362ff88343c6b140c49366d88954 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:15.158725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-83a33fcf-3adb-408e-8fb3-f4ed84f025da None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:15.166126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-83a33fcf-3adb-408e-8fb3-f4ed84f025da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:15.467186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1512/3031] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:15.541553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:15.543216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:15.554485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:15.717952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28030953-9bda-4573-850c-af63f4b9cc99 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:15.736437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:15.739166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:15.740262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:15.741131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:15.787433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:15.791012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:15.828868 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1520/3032] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:16.074590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c81128-56f0-48c6-bb91-df7be54d20a5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:16.075939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c81128-56f0-48c6-bb91-df7be54d20a5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:16.075939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c81128-56f0-48c6-bb91-df7be54d20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c3c81128-56f0-48c6-bb91-df7be54d20a5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:16.099468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:16.100914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:41:16.102164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1513/3033] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:41:16.628639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:16.630218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:16.664014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd900b-a55c-46b6-ba6a-668520ca4d22 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:16.694498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:16.695337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:16.695621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:16.695910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] PATH_INFO: `/v3/projects/6bd5c1f330104d60bfb991a53869a000` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:16.711786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd5c1f330104d60bfb991a53869a000)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:16.724836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:16.878985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:17.250074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd5c1f330104d60bfb991a53869a000', 'request_id': 'req-7b2506d7-819d-44be-a26d-c600dee4902e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:17.283381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd5c1f330104d60bfb991a53869a000', 'request_id': 'req-7b2506d7-819d-44be-a26d-c600dee4902e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:17.434612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd5c1f330104d60bfb991a53869a000', 'request_id': 'req-7b2506d7-819d-44be-a26d-c600dee4902e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:17.459851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] The token cache is being invalidate because project 6bd5c1f330104d60bfb991a53869a000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:17.460351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:17.461234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b2506d7-819d-44be-a26d-c600dee4902e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:17.465254 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1521/3034] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:16 2022] DELETE /identity/v3/projects/6bd5c1f330104d60bfb991a53869a000 => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:17.475400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:17.489717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:17.489717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:17.547131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:17.554164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:17.586465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:17.790362 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1514/3035] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:17.804051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:17.807129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:17.807129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:17.855309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:17.861935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:17.883717 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1522/3036] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:17.891019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:17.909926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141eab-4918-44ef-a3a0-d998b609aa35 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:17.924753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:17.926873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:17.927526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:17.930785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:17.931829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:17.932397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:17.935333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:17.981452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1515/3037] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:17.987433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:18.020238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb0a1-2983-4819-bcd0-42713a6bfb73 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:18.059648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:18.061399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:18.073283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:18.076627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:18.076627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:18.083454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:18.262130 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1523/3038] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:17 2022] POST /identity/v3/projects => generated 391 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:18.268792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:18.283841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d705d-c42c-41fb-a479-0c5e190917aa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:18.559182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:18.559810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:18.559810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:18.560068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:18.560957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:18.564015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:18.757596 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1516/3039] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:18 2022] POST /identity/v3/users => generated 296 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:18.764953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:18.807783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f63c8-cd83-4770-8c7b-ed7d2ce690d5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:18.818363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:18.823486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:18.824021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:18.824526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:18.825897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:18.829639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:18.861954 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1524/3040] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:41:18.868049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:18.891492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74092808-a850-4e22-9c50-a2e817b73289 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:18.907975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:18.909452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:18.909930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:18.910466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:18.911494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:18.914454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac0905-9668-4e81-8fee-d11ff6f2345b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:18.931542 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1517/3041] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:41:18.938719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:18.968324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953514ea-cc57-4bf0-a70a-32f8afd0c73a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:18.982041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:18.984535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:18.985085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:18.985542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] PATH_INFO: `/v3/projects/149e020732344f539f974bd3fb3d4f41/users/069ee22251c74cfa86cbe02fbcf03346/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:19.034430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=149e020732344f539f974bd3fb3d4f41, user_id=069ee22251c74cfa86cbe02fbcf03346, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:19.039728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:19.167988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1525/3042] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:18 2022] PUT /identity/v3/projects/149e020732344f539f974bd3fb3d4f41/users/069ee22251c74cfa86cbe02fbcf03346/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:19.195184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:19.195733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:19.196026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:19.196307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:19.287879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] MFA Rules not processed for user `069ee22251c74cfa86cbe02fbcf03346`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:19.291014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:19.489709 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1518/3043] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:19.497267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:19.576696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:19.720147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b903f-875b-4ccf-a778-5af44de52dbe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:19.741014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:19.741014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:19.741014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:19.741014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:19.747096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:19.752636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:19.945775 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1526/3044] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:19 2022] POST /identity/v3/projects => generated 395 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:41:19.952609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:19.976698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b61077-bcdd-4be0-8a5f-a9a17f929c6d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:20.217908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:20.219331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:20.219787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:20.220246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:20.221269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:20.224229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:20.355059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1519/3045] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:19 2022] POST /identity/v3/users => generated 304 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:20.362947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:20.399953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2598a73-0423-49b9-945b-99b4775acfff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:20.427396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:20.428027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:20.428341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:20.428713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:20.431510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:20.437170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:20.473127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1527/3046] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:41:20.480337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:20.544089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef1cfa-5d0c-493b-b246-19bad31d470d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:20.573957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:20.576247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:20.577683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:20.578589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:20.579409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] PATH_INFO: `/v3/projects/749f872e4c774e84be14d212132e1aa1/users/da5aabd3c9c146b885fcfe724262debe/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:20.711545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749f872e4c774e84be14d212132e1aa1, user_id=da5aabd3c9c146b885fcfe724262debe, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:20.731098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:20.780793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:20.900960 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1520/3047] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:20 2022] PUT /identity/v3/projects/749f872e4c774e84be14d212132e1aa1/users/da5aabd3c9c146b885fcfe724262debe/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:20.902252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:20.918876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478bcb-bd60-46d3-a4da-3219b612bb49 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:21.174407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:21.176560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:21.177546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:21.178215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:21.179559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:21.182341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34595ba1-afdb-4610-a280-b674a54a4a27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:21.266568 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1528/3048] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:41:21.274631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:21.347766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabcd1f-639d-4874-970c-abe3714b01a3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:21.383223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:21.392869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:21.393822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:21.398954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] PATH_INFO: `/v3/projects/749f872e4c774e84be14d212132e1aa1/users/da5aabd3c9c146b885fcfe724262debe/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:21.421774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749f872e4c774e84be14d212132e1aa1, user_id=da5aabd3c9c146b885fcfe724262debe, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:21.434020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:21.476046 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1521/3049] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:21 2022] PUT /identity/v3/projects/749f872e4c774e84be14d212132e1aa1/users/da5aabd3c9c146b885fcfe724262debe/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:21.494683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:21.501114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:21.501114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:21.625281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] MFA Rules not processed for user `da5aabd3c9c146b885fcfe724262debe`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:21.627965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:21.956063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1529/3050] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:22.003161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:22.006999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:22.366997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aa209-8050-456b-b680-2e30459a6859 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:22.393750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:22.397686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:22.403665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:22.409756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:22.409756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:22.427299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:22.430584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:22.473905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1522/3051] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:22.891378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:22.991678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:23.301647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:23.304308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:23.345225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e66c1-6b2b-456e-8f4f-c617565906b7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:23.368940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1176263-874b-4787-9635-1706b2513933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:23.373743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176263-874b-4787-9635-1706b2513933 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:23.375265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176263-874b-4787-9635-1706b2513933 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:23.375784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1176263-874b-4787-9635-1706b2513933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:23.598290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176263-874b-4787-9635-1706b2513933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:23.600261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1176263-874b-4787-9635-1706b2513933 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:23.622646 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1530/3052] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:23.664363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:23.839445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638e907-4b55-450e-b85f-1268e6c13ad2 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:23.852932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:23.854331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:23.854955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:23.855574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] PATH_INFO: `/v3/users/069ee22251c74cfa86cbe02fbcf03346` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:23.866851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069ee22251c74cfa86cbe02fbcf03346)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:23.870355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:24.313071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069ee22251c74cfa86cbe02fbcf03346'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:24.456378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069ee22251c74cfa86cbe02fbcf03346'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:24.502467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069ee22251c74cfa86cbe02fbcf03346'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:24.539029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069ee22251c74cfa86cbe02fbcf03346'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:24.541502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069ee22251c74cfa86cbe02fbcf03346'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:24.555776 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1523/3053] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:23 2022] DELETE /identity/v3/users/069ee22251c74cfa86cbe02fbcf03346 => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:24.560078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef46e-380a-4fe8-928f-20ab86357917 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:24.560670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef46e-380a-4fe8-928f-20ab86357917 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:24.560776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ef46e-380a-4fe8-928f-20ab86357917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:24.650525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d74ef46e-380a-4fe8-928f-20ab86357917 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:24.651792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d74ef46e-380a-4fe8-928f-20ab86357917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:24.838655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:24.859560 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1531/3054] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:24.887293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:24.889579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:25.115325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1ad47-58aa-40c4-9568-fd110dafb722 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:25.142228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:25.145338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:25.145338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:25.145338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:25.201513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:25.209506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab267e6-55cb-4bce-b340-929f4b12be0d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:25.248111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1524/3055] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:25.493804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e565c-2d80-4473-b391-904135d43c3b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:25.494348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e565c-2d80-4473-b391-904135d43c3b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:25.494773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e565c-2d80-4473-b391-904135d43c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:25.627659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-328e565c-2d80-4473-b391-904135d43c3b None None] MFA Rules not processed for user `8b0cc8b23d7c43bba9c404d381f2a1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:25.631013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-328e565c-2d80-4473-b391-904135d43c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:25.810675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:25.812791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:25.812791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:25.832001 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1532/3056] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:25.845123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:25.846660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:25.847137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e565c-2d80-4473-b391-904135d43c3b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:25.851226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-328e565c-2d80-4473-b391-904135d43c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:25.963190 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1525/3057] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:26.018958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:26.020735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:26.106188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e565c-2d80-4473-b391-904135d43c3b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:26.120046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:26.121218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:26.121702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:26.122230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:26.138397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:26.143325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:26.147262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:26.147494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f6284-34f2-47d2-8510-c1228f1ef5f0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:26.163299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:26.164436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:26.165209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:26.165755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:26.168119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1533/3058] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:26.180354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:26.182561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:26.208051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1526/3059] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:41:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:41:26.577933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:27.186742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:27.513736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:27.651125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:28.676697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:28.930705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:29.462271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:29.545521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:31.187470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:31.256081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:31.657935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:31.659640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:31.685441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc177603-4a4d-4a1c-858b-21087fa73fcd service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:31.706625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:31.707521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:31.707810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:31.708091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] PATH_INFO: `/v3/projects/149e020732344f539f974bd3fb3d4f41` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:31.713056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149e020732344f539f974bd3fb3d4f41)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:31.715076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:32.007094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149e020732344f539f974bd3fb3d4f41', 'request_id': 'req-c2fa37f6-944d-4271-b123-10e41fadc369'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:32.027764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149e020732344f539f974bd3fb3d4f41', 'request_id': 'req-c2fa37f6-944d-4271-b123-10e41fadc369'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:32.058694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:32.150120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149e020732344f539f974bd3fb3d4f41', 'request_id': 'req-c2fa37f6-944d-4271-b123-10e41fadc369'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:32.208940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] The token cache is being invalidate because project 149e020732344f539f974bd3fb3d4f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:32.218732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:32.221795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c2fa37f6-944d-4271-b123-10e41fadc369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:32.247780 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1534/3060] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:31 2022] DELETE /identity/v3/projects/149e020732344f539f974bd3fb3d4f41 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:32.248798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:32.272707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57154e6-6bc4-4f6b-8c09-a7b85e030075 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:32.476804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:32.564856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:32.566048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:32.566618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:32.567568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] PATH_INFO: `/v3/users/da5aabd3c9c146b885fcfe724262debe` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:32.572055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da5aabd3c9c146b885fcfe724262debe)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:32.582313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:32.946008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd89a9-53c2-4ece-a149-45a93cbc2c7b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:32.947887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd89a9-53c2-4ece-a149-45a93cbc2c7b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:32.949048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd89a9-53c2-4ece-a149-45a93cbc2c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:33.016542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da5aabd3c9c146b885fcfe724262debe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:33.045376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3ecd89a9-53c2-4ece-a149-45a93cbc2c7b None None] MFA Rules not processed for user `131bac915e2f483ebd6c54464431f8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:33.046765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3ecd89a9-53c2-4ece-a149-45a93cbc2c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:33.147601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da5aabd3c9c146b885fcfe724262debe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:33.201974 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1535/3061] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:33.219844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da5aabd3c9c146b885fcfe724262debe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:33.229225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:33.230455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:33.230455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:33.270129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da5aabd3c9c146b885fcfe724262debe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:33.272141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da5aabd3c9c146b885fcfe724262debe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:33.275811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] MFA Rules not processed for user `131bac915e2f483ebd6c54464431f8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:33.283252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:33.296554 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1527/3062] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:32 2022] DELETE /identity/v3/users/da5aabd3c9c146b885fcfe724262debe => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:33.421921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:33.423545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:33.556374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1536/3063] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:33.818581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ee61c-d750-4378-8184-7874b4472c48 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:33.858476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:33.859471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:33.859902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:33.860264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] PATH_INFO: `/v3/users/2d4bf3d5375d4931be76850f6eb372a2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:33.878918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4bf3d5375d4931be76850f6eb372a2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:33.883841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:33.888442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:33.901531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:33.925574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:34.058050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:34.352322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4bf3d5375d4931be76850f6eb372a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:34.360387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11de63-0818-4b81-999f-ce2ce408034b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:34.391095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:34.392632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:34.393139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:34.393953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:34.401388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:34.454797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:34.471214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:34.484975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4bf3d5375d4931be76850f6eb372a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:34.503259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1537/3064] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:34.549494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4bf3d5375d4931be76850f6eb372a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:34.585689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4bf3d5375d4931be76850f6eb372a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:34.595566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4bf3d5375d4931be76850f6eb372a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:34.604438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:34.620955 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1528/3065] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:33 2022] DELETE /identity/v3/users/2d4bf3d5375d4931be76850f6eb372a2 => generated 0 bytes in 1200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:34.631617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:34.755044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0a608-103e-49b4-98cc-b8e60ec7b88b service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:34.760421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:35.114764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:35.122030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:35.129207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:35.133093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] PATH_INFO: `/v3/projects/749f872e4c774e84be14d212132e1aa1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:35.142772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=749f872e4c774e84be14d212132e1aa1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:35.164316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:35.359636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:36.327509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:36.327509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:36.334314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749f872e4c774e84be14d212132e1aa1', 'request_id': 'req-e25bab4a-e5ba-48e2-89d4-b728a1004887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.334314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749f872e4c774e84be14d212132e1aa1', 'request_id': 'req-e25bab4a-e5ba-48e2-89d4-b728a1004887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.340617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddac4e-58e9-4771-84da-fd36d9583ab2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:36.340617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:36.340617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:36.340617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:36.343960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] PATH_INFO: `/v3/projects/1b371bd21fb44fc1948e03029ee437c3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:36.343960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b371bd21fb44fc1948e03029ee437c3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:36.343960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:36.479785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749f872e4c774e84be14d212132e1aa1', 'request_id': 'req-e25bab4a-e5ba-48e2-89d4-b728a1004887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.504275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] The token cache is being invalidate because project 749f872e4c774e84be14d212132e1aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:36.504832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.506001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e25bab4a-e5ba-48e2-89d4-b728a1004887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.509580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1538/3066] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:34 2022] DELETE /identity/v3/projects/749f872e4c774e84be14d212132e1aa1 => generated 0 bytes in 1907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:36.513065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:36.513556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:36.514084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:41:36.559041 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:41:36.572456 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:41:36.574897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1539/3067] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:41:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 55 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:41:36.574897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b668a7-f4a0-4aea-aac9-569a971677ac None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:36.574897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b668a7-f4a0-4aea-aac9-569a971677ac None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:36.574897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b668a7-f4a0-4aea-aac9-569a971677ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:36.659354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a6b668a7-f4a0-4aea-aac9-569a971677ac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:36.665199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6b668a7-f4a0-4aea-aac9-569a971677ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:36.727101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b371bd21fb44fc1948e03029ee437c3', 'request_id': 'req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.756265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b371bd21fb44fc1948e03029ee437c3', 'request_id': 'req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.777727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b371bd21fb44fc1948e03029ee437c3', 'request_id': 'req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.943758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] The token cache is being invalidate because project 1b371bd21fb44fc1948e03029ee437c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:36.945130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.949026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-59059c5e-43e5-4f0a-80e4-4e37d2a7a13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:36.956452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1529/3068] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:35 2022] DELETE /identity/v3/projects/1b371bd21fb44fc1948e03029ee437c3 => generated 0 bytes in 1460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:36.964323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac054ff9-b1f7-4e45-b325-ac17ec1bd1d1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:36.968647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac054ff9-b1f7-4e45-b325-ac17ec1bd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:36.970638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac054ff9-b1f7-4e45-b325-ac17ec1bd1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:36.976728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:36.982292 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1540/3069] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:36.994570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:36.995032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:36.995563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.050673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ac054ff9-b1f7-4e45-b325-ac17ec1bd1d1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:37.058770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac054ff9-b1f7-4e45-b325-ac17ec1bd1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:37.080262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:37.085489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:37.098851 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1530/3070] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:37.113503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:37.114195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:37.115363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.121919 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1541/3071] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:37.129577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.163724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:37.166710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967e9e9-9e06-47b8-a40c-26118b169a95 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:37.186937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:37.188719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:37.189440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:37.190055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.192994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:37.197268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:37.198163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:37.201012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:37.218935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:37.263454 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1542/3072] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:41:37.268469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.270963 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1531/3073] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:37.273747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.311637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009f352-6286-4ed5-ba2c-01a2c4c14229 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:37.339179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b8f71-167e-45a2-b7f3-269add44d3b3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:37.341580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:37.343113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:37.343873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:37.345835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.347671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:37.348245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:37.351727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:37.362860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:37.364098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:37.364394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:37.364904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.366121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:37.377837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:37.421690 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1543/3074] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:37.423211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.457524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a599b-fd9c-4cff-938c-16b61098ff37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:37.464604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:37.466085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:37.466840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:37.468399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:37.470297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:37.474464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:37.593226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1532/3075] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:37 2022] POST /identity/v3/projects => generated 403 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:37.597048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.672358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1544/3076] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:37 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:41:37.682231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:37.865853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.088319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394023c-624c-4916-8a58-ec5d637fbb59 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.104080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.106591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.107171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.108170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.109140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.125369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.148644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff261d-0518-450f-96ad-9c335346a723 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.175579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.177465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.178287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.179000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.182264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.193978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.263237 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1545/3077] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:37 2022] POST /identity/v3/users => generated 291 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:38.272065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:38.304221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef93ec-21cc-468d-8d4b-dfef1ea78c7b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.316260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.317510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.318001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.318486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.319362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.323409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.361388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1546/3078] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:38.363235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:38.393102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790296e-86da-4312-bd84-db7626e5e314 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.404101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.404816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.405306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.405306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.409231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1533/3079] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:37 2022] POST /identity/v3/users => generated 302 bytes in 813 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:41:38.413679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.415457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.416518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:38.447677 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1547/3080] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:38.456541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:38.470356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2dca9-34dd-4b96-80fd-b2e685887543 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.484482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980b2ce2-efa8-403c-9df0-2083fd6bff93 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.495782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.497660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.499145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.505040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.505310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.505496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.505666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.505826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] PATH_INFO: `/v3/projects/f48fdbeb9a604c66b66780387e3af4de/users/d475a7c95ae7405db2483fc26ea0a8c5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.505983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.505983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.519663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.550565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48fdbeb9a604c66b66780387e3af4de, user_id=d475a7c95ae7405db2483fc26ea0a8c5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:38.558051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5448b-44b8-4107-96d1-6f07ddab7386 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:38.599840 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1534/3081] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:38.612710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:38.669227 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1548/3082] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:38 2022] PUT /identity/v3/projects/f48fdbeb9a604c66b66780387e3af4de/users/d475a7c95ae7405db2483fc26ea0a8c5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:38.675729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.680792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef2380-138b-4dfc-9559-4bf828a8a0f1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:38.681062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:38.681455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:38.771835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:38.781867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:38.881465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.997794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:38.998942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:38.999482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:39.000012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:39.001483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:39.008293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:39.054987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1535/3083] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:39.058574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:39.059664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:39.078563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e1abb-dbfd-4764-b7f1-0b58ba5a010e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:39.099159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:39.103874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:39.104177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:39.104686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] PATH_INFO: `/v3/projects/0cecc7764f614cfa908d27412a113160/users/8bfaec7c926044ecba6fe31152467ec8/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:39.135832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1549/3084] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:39.184835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:39.187437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:39.220613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cecc7764f614cfa908d27412a113160, user_id=8bfaec7c926044ecba6fe31152467ec8, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:39.239598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922948a-937d-4ad1-9a23-dd44c649be3d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:39.316959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:39.425774 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1536/3085] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:39 2022] PUT /identity/v3/projects/0cecc7764f614cfa908d27412a113160/users/8bfaec7c926044ecba6fe31152467ec8/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:39.444297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:39.444297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:39.444297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:39.530552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] MFA Rules not processed for user `8bfaec7c926044ecba6fe31152467ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:39.532326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:39.571551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c23322-bb45-4fbc-ab40-458841244f12 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:39.728098 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1537/3086] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:39.733661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:39.765364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:39.798707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:39.803206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:39.805660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:39.807821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:39.918323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:39.981908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e95f41-8c54-44f4-9a2c-3fd8b7735733 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:39.995903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:39.997068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:39.997540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:39.998100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:39.999336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:40.007040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:40.120297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:40.123304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:40.145263 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1550/3087] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 962 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:40.182390 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1538/3088] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:39 2022] POST /identity/v3/projects => generated 401 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:41:40.187195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:40.203320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b9d5c-84cc-4edb-a228-9818184fa076 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:40.553245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:40.562112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:40.563213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:40.563705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:40.570894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:40.592561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:40.763554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:40.765836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1551/3089] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:40 2022] POST /identity/v3/users => generated 307 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:40.780029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224f0e5-c8e6-46b8-a57d-bd0e21dacca6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:40.809480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:40.810665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:40.811176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:40.811737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:40.812729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:40.814809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:40.867468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:40.882686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1539/3090] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:40.905313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991c82c-98b6-4e63-ad15-d32ee6abb460 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:40.921560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:40.943792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:40.943792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:40.943792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] PATH_INFO: `/v3/projects/a6ed628773db4cc6acbec7035f929a64/users/7db8a54125ff468da190be72312c8a3e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:40.995784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ed628773db4cc6acbec7035f929a64, user_id=7db8a54125ff468da190be72312c8a3e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:41.004809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:41.155701 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1552/3091] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:40 2022] PUT /identity/v3/projects/a6ed628773db4cc6acbec7035f929a64/users/7db8a54125ff468da190be72312c8a3e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:41.159557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:41.205267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa198f8c-1ebe-47de-9ef1-9fe9f8b1cf8b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:41.422611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:41.422958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:41.423218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:41.423640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:41.424383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:41.426451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd58f06-e51e-4cd7-b6e4-0159e46259c6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:41.459289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1540/3092] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:41.465509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:41.487999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6503d-a862-4d4b-ae96-e01bce576660 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:41.499853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:41.500640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:41.500969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:41.501316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] PATH_INFO: `/v3/projects/a6ed628773db4cc6acbec7035f929a64/users/7db8a54125ff468da190be72312c8a3e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:41.508012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ed628773db4cc6acbec7035f929a64, user_id=7db8a54125ff468da190be72312c8a3e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:41.511459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:41.565008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:41.571761 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1553/3093] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:41 2022] PUT /identity/v3/projects/a6ed628773db4cc6acbec7035f929a64/users/7db8a54125ff468da190be72312c8a3e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:41.577919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:41.577919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:41.577919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:41.718416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:41.722458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] MFA Rules not processed for user `7db8a54125ff468da190be72312c8a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:41.727718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:42.011490 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1541/3094] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:42.095157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:42.418168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:42.439549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:42.607519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f76d3-2231-4876-a01d-a8f173f66329 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:42.623848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:42.624804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:42.625099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:42.625374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:42.653252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:42.658742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:42.678351 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1554/3095] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:43.640215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:44.080754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:44.431062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:44.918928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:45.005185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:45.067468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a67932-91f1-4496-bb46-73ee0747c47e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:45.098224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:45.098224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:45.101285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:45.101990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:45.264966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:45.267876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:45.286981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:45.291960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:45.336637 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1542/3096] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:45 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:45.397554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:45.399496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:45.446676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:45.541803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ce4f6-649d-4cc3-8783-8e7e141cf8ca service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:45.570828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:45.577814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:45.582216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:45.582216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:45.588856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:45.632525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:45.635151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:45.657786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1555/3097] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:45.661256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:45.710172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21781d32-eb81-4340-883e-3af35bc01f68 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:45.720347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:45.723585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:45.724210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:45.724794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] PATH_INFO: `/v3/users/5ad02f7d8d7d43fb82270c0541c2343b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:45.729587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ad02f7d8d7d43fb82270c0541c2343b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:45.734617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:45.840504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c068e-1b50-41fb-bd98-a0909661d866 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:45.851375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:45.852292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:45.852661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:45.853543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] PATH_INFO: `/v3/users/8bfaec7c926044ecba6fe31152467ec8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:45.855783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bfaec7c926044ecba6fe31152467ec8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:45.859733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:45.960793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.156620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ad02f7d8d7d43fb82270c0541c2343b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.277667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ad02f7d8d7d43fb82270c0541c2343b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.291669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bfaec7c926044ecba6fe31152467ec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.321593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ad02f7d8d7d43fb82270c0541c2343b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.350379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ad02f7d8d7d43fb82270c0541c2343b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.363812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7a6b7979-eef9-4db8-8d09-f511afbd7289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ad02f7d8d7d43fb82270c0541c2343b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.394666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1543/3098] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:45 2022] DELETE /identity/v3/users/5ad02f7d8d7d43fb82270c0541c2343b => generated 0 bytes in 1002 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:46.560027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bfaec7c926044ecba6fe31152467ec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.583231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bfaec7c926044ecba6fe31152467ec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.584308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bfaec7c926044ecba6fe31152467ec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.585265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bfaec7c926044ecba6fe31152467ec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:46.605704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1556/3099] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:45 2022] DELETE /identity/v3/users/8bfaec7c926044ecba6fe31152467ec8 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:46.611203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce0b-dd80-43ae-95ee-e0c507a09eea None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:46.611573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce0b-dd80-43ae-95ee-e0c507a09eea None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:46.611789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bce0b-dd80-43ae-95ee-e0c507a09eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:46.668535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-495bce0b-dd80-43ae-95ee-e0c507a09eea None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:46.671486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-495bce0b-dd80-43ae-95ee-e0c507a09eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:46.805423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.936565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1544/3100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:46.993916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:46.996347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:47.177621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0811d-3e77-48d8-a0d3-ccac695ff0b5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:47.187891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:47.188720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:47.191802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:47.192252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:47.218262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:47.221253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:47.250722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1557/3101] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:47.278108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:48.306259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:48.307055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:48.307829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:48.377364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:48.385284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:48.621120 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1545/3102] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:48.972667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:49.348690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:49.351213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:49.391353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d90f1-a286-407c-9571-0c7835108e3a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:49.398982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:49.399773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:49.400143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:49.401042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] PATH_INFO: `/v3/projects/f3fd137af33941589ef15699c4d59ffc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:49.403054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fd137af33941589ef15699c4d59ffc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:49.406809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:49.567140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:49.569882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:49.617076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16b44b-61a3-43ea-b059-4514e232cda5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:49.624529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fd137af33941589ef15699c4d59ffc', 'request_id': 'req-2dc51497-a3b0-42f5-acb1-a292a4058166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:49.651411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fd137af33941589ef15699c4d59ffc', 'request_id': 'req-2dc51497-a3b0-42f5-acb1-a292a4058166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:49.786753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fd137af33941589ef15699c4d59ffc', 'request_id': 'req-2dc51497-a3b0-42f5-acb1-a292a4058166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:49.835119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] The token cache is being invalidate because project f3fd137af33941589ef15699c4d59ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:49.835724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:49.841241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2dc51497-a3b0-42f5-acb1-a292a4058166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:49.865828 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1558/3103] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:49 2022] DELETE /identity/v3/projects/f3fd137af33941589ef15699c4d59ffc => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:49.877014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd37f-4b4b-4cb4-b2e0-c5aa48e73d1b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:49.877396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd37f-4b4b-4cb4-b2e0-c5aa48e73d1b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:49.877667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd37f-4b4b-4cb4-b2e0-c5aa48e73d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:49.960200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-10bdd37f-4b4b-4cb4-b2e0-c5aa48e73d1b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:49.962617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10bdd37f-4b4b-4cb4-b2e0-c5aa48e73d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:49.986981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:50.003920 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1559/3104] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:50.005333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:50.008417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:50.012114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:50.012448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:50.012757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:50.013631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:50.014298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] PATH_INFO: `/v3/projects/0cecc7764f614cfa908d27412a113160` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:50.024543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cecc7764f614cfa908d27412a113160)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:50.030211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:50.034577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:50.089654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:50.093388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:50.132543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1560/3105] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:50.139238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:50.172866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d8cf-4dd4-4604-9da7-8181f3714bc5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:50.190126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:50.190818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:50.191095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:50.191365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:50.192166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:50.192501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:50.194565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:50.234725 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1561/3106] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:50.236038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:50.273560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848d461-3809-423a-b0f3-bac893af5c96 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:50.314898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cecc7764f614cfa908d27412a113160', 'request_id': 'req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:50.334888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cecc7764f614cfa908d27412a113160', 'request_id': 'req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:50.352437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cecc7764f614cfa908d27412a113160', 'request_id': 'req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:50.502175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:50.503516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:50.506826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:50.507410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:50.508020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:50.512268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:50.515325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:50.528773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] The token cache is being invalidate because project 0cecc7764f614cfa908d27412a113160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:50.530180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:50.531338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:50.535378 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1546/3107] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:49 2022] DELETE /identity/v3/projects/0cecc7764f614cfa908d27412a113160 => generated 0 bytes in 970 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:41:50.541046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:50.545871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:50.595143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3567c6d-fa7a-4a79-bd49-df9aed03a2f5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:50.611529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:50.614234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:50.617108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:50.617683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] PATH_INFO: `/v3/users/7db8a54125ff468da190be72312c8a3e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:50.620691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db8a54125ff468da190be72312c8a3e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:50.628793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:50.695442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1562/3108] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:50 2022] POST /identity/v3/projects => generated 377 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:50.708422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:50.719243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:51.112710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db8a54125ff468da190be72312c8a3e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:51.134831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f71303-ea47-4417-b0bb-1e47ac1a6fef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:51.151539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:51.153372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:51.153924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:51.155274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:51.156228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:51.158633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:51.272266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db8a54125ff468da190be72312c8a3e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:51.317684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db8a54125ff468da190be72312c8a3e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:51.334389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db8a54125ff468da190be72312c8a3e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:51.338531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db8a54125ff468da190be72312c8a3e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:51.343202 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1563/3109] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:50 2022] POST /identity/v3/users => generated 289 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:51.348708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:51.352989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:51.373692 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1547/3110] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:50 2022] DELETE /identity/v3/users/7db8a54125ff468da190be72312c8a3e => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:51.387426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabef137-6861-4703-989f-cc58a21fc41f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:51.573702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:51.580221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:51.584177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:51.585600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:51.599588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:51.601715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:51.693559 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1564/3111] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:51.694949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:51.726817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e45dac-7e6c-4dd4-9955-5777b99639fa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:51.748176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:51.756028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:51.764826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:51.764826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:51.764826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:51.764826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc2dfb-353c-4c63-9232-42d98b856cbb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:51.798465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1548/3112] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:51.805393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:51.841211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ea064-998c-4c03-8859-4c76b73a765f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:51.870295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:51.871664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:51.872179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:51.872831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] PATH_INFO: `/v3/projects/e1824edba1954bc49c70a63cedd89d53/users/ac27c842f7b64080b644fff53f294c65/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:51.968692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1824edba1954bc49c70a63cedd89d53, user_id=ac27c842f7b64080b644fff53f294c65, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:51.987733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:52.147087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1565/3113] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:51 2022] PUT /identity/v3/projects/e1824edba1954bc49c70a63cedd89d53/users/ac27c842f7b64080b644fff53f294c65/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:52.155874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:52.156704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:52.157373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:52.157673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:52.303442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:52.315058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:52.547235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1549/3114] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:52.646896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:52.650217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:52.834596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d82f13-1024-4691-8772-106512bb5ac1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:52.865692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:52.868352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:52.869358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:52.869798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:52.870250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:52.882922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:52.895370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:52.957129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87320f93-b823-4aaa-9a6d-f601569ac52d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:52.997917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:53.002215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:53.005215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:53.005959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] PATH_INFO: `/v3/projects/a6ed628773db4cc6acbec7035f929a64` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:53.006436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:53.014921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ed628773db4cc6acbec7035f929a64)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:53.031071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5b5d-9900-4c29-ba86-66d35e467b2d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:53.038610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:53.112156 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1566/3115] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:53.392391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ed628773db4cc6acbec7035f929a64', 'request_id': 'req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:53.425368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ed628773db4cc6acbec7035f929a64', 'request_id': 'req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:53.457055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ed628773db4cc6acbec7035f929a64', 'request_id': 'req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:53.633301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] The token cache is being invalidate because project a6ed628773db4cc6acbec7035f929a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:53.635958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:53.639339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffc8681b-6a15-4923-93c7-13b9bf8f12bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:53.649455 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1550/3116] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:52 2022] DELETE /identity/v3/projects/a6ed628773db4cc6acbec7035f929a64 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:53.655445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:53.656028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:53.656302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:53.728313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:53.731000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:54.003091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1567/3117] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:54.013801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:54.014583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:54.016445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:54.149648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:54.152704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:54.193045 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1551/3118] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:54.197262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:54.223802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea1caae-71d7-4eb0-9a7e-d0efd29d9e06 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:54.234761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:54.235737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:54.237164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:54.238934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:54.240746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:54.241816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:54.245836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:54.298726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1568/3119] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:54.303983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:54.366564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78399c0b-7078-4db4-a1da-be1ea5e54edf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:54.412265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:54.413286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:54.413573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:54.415983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:54.417120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:54.419609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:54.573954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1552/3120] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:54 2022] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:54.578631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:54.592426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba4221-319c-46c0-be44-ac9fed2c14fe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:54.821263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:54.823293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:54.826796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:54.828524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:54.834942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:54.852477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:55.013051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:55.069805 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1569/3121] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:54 2022] POST /identity/v3/users => generated 293 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:55.074702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:55.090041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:55.096986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:55.101733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:55.106061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cde92-4a52-4cdc-a15d-9ff52a1db2c2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:55.127553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:55.131152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:55.132170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:55.135537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:55.136929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:55.143087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:55.150067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d3c54-c538-4918-96ca-21ead60cd081 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:55.162986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:55.165589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:55.166101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:55.166552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] PATH_INFO: `/v3/users/131bac915e2f483ebd6c54464431f8a3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:55.168106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=131bac915e2f483ebd6c54464431f8a3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:55.170617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:55.180431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1553/3122] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:55.186729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:55.220669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356d110-d501-4fb0-969f-8095010b5000 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:55.242185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:55.246092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:55.246092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:55.246092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:55.246092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:55.248659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:55.280386 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1554/3123] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:41:55.287656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:55.316388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e0fc0-4445-44bf-8194-9545cecd6e58 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:55.328183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:55.329172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:55.329301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:55.329544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] PATH_INFO: `/v3/projects/0ff598bce6e74831be9e50484b4075d2/users/d3f905a0f01e4ad191eb456ea9aec7ca/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:55.409537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff598bce6e74831be9e50484b4075d2, user_id=d3f905a0f01e4ad191eb456ea9aec7ca, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:55.415419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8313-5e3a-46c1-8f45-3cab8e994679 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:55.539578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131bac915e2f483ebd6c54464431f8a3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:55.572431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1555/3124] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:41:55 2022] PUT /identity/v3/projects/0ff598bce6e74831be9e50484b4075d2/users/d3f905a0f01e4ad191eb456ea9aec7ca/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:55.582206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd589-b5d3-4c69-9ee4-f295135e8e65 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:55.585433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd589-b5d3-4c69-9ee4-f295135e8e65 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:55.587479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd589-b5d3-4c69-9ee4-f295135e8e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:55.649357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131bac915e2f483ebd6c54464431f8a3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:55.673856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2e4fd589-b5d3-4c69-9ee4-f295135e8e65 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:55.677182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131bac915e2f483ebd6c54464431f8a3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:55.678909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131bac915e2f483ebd6c54464431f8a3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:55.681124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131bac915e2f483ebd6c54464431f8a3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:55.681410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e4fd589-b5d3-4c69-9ee4-f295135e8e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:55.719290 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1570/3125] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:41:55 2022] DELETE /identity/v3/users/131bac915e2f483ebd6c54464431f8a3 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:55.910569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1556/3126] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:41:55.983530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:55.985918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:56.194215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:56.304120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcf67f-7f9c-4880-bdab-e42c651860ee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:56.314040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:56.314778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:56.315139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:56.315582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:56.394992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:56.441001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:56.446709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:56.490716 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1571/3127] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:56.666424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:56.668436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:56.669084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:56.826689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] MFA Rules not processed for user `a826e2ebcf3a416ebbd0b2f00b314887`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:56.833073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:57.219944 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1557/3128] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 544 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:57.234253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:57.241680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:57.500647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1361032-7a12-4aed-acbc-96dbd15d7b5f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:57.532945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:57.533814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:57.536446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:57.536817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:57.572153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:57.573835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d629-6976-498b-8dcb-0f8913ec1e5f service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:57.599839 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1572/3129] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:41:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:41:58.245941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:58.247757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:58.283707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57177a9-8cca-4d8b-9c0a-d3ce17644e47 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:58.297522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:58.298158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:58.299118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:58.299403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] PATH_INFO: `/v3/projects/c7ac1379307745cebba3fb9757ca990b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:58.303566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:58.305509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ac1379307745cebba3fb9757ca990b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:58.309366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:58.489458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:58.601680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ac1379307745cebba3fb9757ca990b', 'request_id': 'req-844a1a10-6613-4751-8d56-02227a30fd1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:58.620527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ac1379307745cebba3fb9757ca990b', 'request_id': 'req-844a1a10-6613-4751-8d56-02227a30fd1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:58.639078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ac1379307745cebba3fb9757ca990b', 'request_id': 'req-844a1a10-6613-4751-8d56-02227a30fd1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:58.783106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] The token cache is being invalidate because project c7ac1379307745cebba3fb9757ca990b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:41:58.783908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:58.786305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-844a1a10-6613-4751-8d56-02227a30fd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:41:58.789405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1558/3130] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:58 2022] DELETE /identity/v3/projects/c7ac1379307745cebba3fb9757ca990b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:41:58.797775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:58.798071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:58.798303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:58.874259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:58.875895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:59.162783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda58376-8221-4f79-849c-910117ecae3c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:59.163336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda58376-8221-4f79-849c-910117ecae3c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:59.163789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda58376-8221-4f79-849c-910117ecae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:59.166785 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1573/3131] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:59.244944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fda58376-8221-4f79-849c-910117ecae3c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:41:59.261375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fda58376-8221-4f79-849c-910117ecae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:41:59.334020 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1559/3132] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:41:59.338906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:59.392335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909a02c-abee-4e36-8abc-126e00ffe0b3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:59.420650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:59.429187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:59.430011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:59.430411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:59.431139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:41:59.431444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:59.445475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:59.503330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda58376-8221-4f79-849c-910117ecae3c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:59.514023 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1574/3133] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:41:59.519657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda58376-8221-4f79-849c-910117ecae3c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:41:59.547149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:41:59.549406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:41:59.550687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:41:59.551281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:41:59.552306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:41:59.556907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:41:59.569624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:59.755336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:41:59.762798 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1560/3134] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:41:59 2022] POST /identity/v3/projects => generated 381 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:41:59.792805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2eb726-38e8-4368-bb6b-1a876100af8a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:00.046830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:00.050807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:00.051395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:00.051928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:00.052863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:00.058309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:00.246490 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1575/3135] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:41:59 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:00.250490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:00.279547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57625c39-2e91-4e1b-a227-da7ff1d44e25 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:00.323913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:00.324554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:00.328936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:00.331917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:00.334791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:00.339647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:00.407742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:00.413005 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1561/3136] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:00.441424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32283d3-a93a-4338-9565-800f3281e24b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:00.471758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:00.478284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:00.481831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:00.485210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:00.490964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:00.498914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0f5d-ad5f-45af-a3a0-d3584250aeaf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:00.534945 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1576/3137] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:42:00.539073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:00.558602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec702b38-4925-419d-b1af-240324067ae5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:00.583954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:00.586962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:00.587814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:00.589786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] PATH_INFO: `/v3/projects/8e13ff7300624e8fa370352995786a37/users/bdf89c77e6324917bcce6b192344ff8b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:00.665390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e13ff7300624e8fa370352995786a37, user_id=bdf89c77e6324917bcce6b192344ff8b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:00.680095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:00.685358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:00.843681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1562/3138] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:42:00 2022] PUT /identity/v3/projects/8e13ff7300624e8fa370352995786a37/users/bdf89c77e6324917bcce6b192344ff8b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:00.864985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480bc-3145-4283-a517-471f9601ac0b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:00.864985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480bc-3145-4283-a517-471f9601ac0b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:00.864985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317480bc-3145-4283-a517-471f9601ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:00.932261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-317480bc-3145-4283-a517-471f9601ac0b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:00.933939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-317480bc-3145-4283-a517-471f9601ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:01.134317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1577/3139] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:01.182448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:01.184530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:01.363333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea9e4b-522c-4850-86dd-cdfabd61c1f3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:01.376313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:01.388279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:01.388279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:01.388279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:01.445357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:01.448545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c85c9b-ed86-438a-a0f8-b1fbd8f09f7f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:01.479335 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1563/3140] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:02.312409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:02.603944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:04.953977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:05.588987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:06.533277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:08.382736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:09.118012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:10.751974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:10.903146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:11.689859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:12.115107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:13.038921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:13.238308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:14.136383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:14.137209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:14.138376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:14.178579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] MFA Rules not processed for user `a826e2ebcf3a416ebbd0b2f00b314887`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:14.183065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:14.530395 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1578/3141] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:14.561146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:14.792305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:15.253804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642027-116f-4dd1-9921-9146cee6a4f9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:15.258760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642027-116f-4dd1-9921-9146cee6a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:15.258760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae642027-116f-4dd1-9921-9146cee6a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:15.298648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ae642027-116f-4dd1-9921-9146cee6a4f9 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:15.298648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae642027-116f-4dd1-9921-9146cee6a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:15.473265 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1564/3142] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:15.490900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:15.493551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:15.514517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:15.689878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b27181-8e26-4cb6-92d1-b3eca6fc04c4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:15.705660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:15.706314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:15.706843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:15.707123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:15.728434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:15.730145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df646d-7e25-42c8-aad3-23c292e83682 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:15.762225 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1579/3143] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:16.039824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:16.061724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.203189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.375288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.729802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.868180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.966733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:17.998361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:17.998711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:17.998915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:42:18.007132 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:18.009668 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:42:18.037922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1565/3144] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:42:18.846588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.015020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:20.777331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef036a-6330-474c-897f-347d10de2b78 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:20.779188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef036a-6330-474c-897f-347d10de2b78 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:20.779824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef036a-6330-474c-897f-347d10de2b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:20.881908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dbef036a-6330-474c-897f-347d10de2b78 None None] MFA Rules not processed for user `d475a7c95ae7405db2483fc26ea0a8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:20.888945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dbef036a-6330-474c-897f-347d10de2b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:20.975391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:21.118986 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1580/3145] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:21.775355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:22.530371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:22.560515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:22.907070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:22.911239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:23.039732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:23.102375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:23.358137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:23.396378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:23.397455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:23.398478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:23.399245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:23.453423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:23.460415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:23.513670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:23.530050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1566/3146] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:24.026054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:24.790037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:24.897536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:24.898178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:24.898792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:25.084270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] MFA Rules not processed for user `ac27c842f7b64080b644fff53f294c65`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:25.085886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:25.176519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:25.179340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:25.287735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:25.366661 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1581/3147] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:25.533269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ffdb1f-d198-432c-bf74-31293a927e2a service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:25.554484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:25.555295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:25.555740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:25.556102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:25.558368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:25.603257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:25.607311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e264ed-aeef-49b9-ab61-3c34989e2405 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:25.640726 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1567/3148] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:26.015314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:26.094779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:26.703721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:26.747490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:26.837358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:26.848549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dda1-a1af-43e8-8188-7838f6e1362d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.848549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dda1-a1af-43e8-8188-7838f6e1362d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.848549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843dda1-a1af-43e8-8188-7838f6e1362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.867521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5628-4a2e-4167-8250-1fdeeac58e3a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:26.908673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:26.909807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:26.910290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:26.917049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:26.943952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d843dda1-a1af-43e8-8188-7838f6e1362d None None] MFA Rules not processed for user `d475a7c95ae7405db2483fc26ea0a8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:26.945677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d843dda1-a1af-43e8-8188-7838f6e1362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:26.954035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:26.956085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.006563 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1568/3149] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:27.025541 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1582/3150] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:27.140198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:27.217726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:27.238520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.238815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.239093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.277142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:27.340903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] MFA Rules not processed for user `d3f905a0f01e4ad191eb456ea9aec7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:27.342470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:27.624618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1569/3151] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:27.629059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.630672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:27.675443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266f575-1295-4ecf-a6bb-e4cd0a4c3c29 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:27.710411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:27.711059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:27.711342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:27.711617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:27.712329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:27.726783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:27.924752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1583/3152] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:42:27 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:27.929052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:27.958544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdbd8b-96be-4c9a-8711-8d52b8b7d3dc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:28.248187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:28.257159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:28.261107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:28.263786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:28.265832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:28.273493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53835f49-734d-45f6-a04a-b0742d24c692 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:28.937906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1570/3153] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:42:27 2022] POST /identity/v3/users => generated 299 bytes in 1009 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:28.942788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:28.987172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0965c-bf72-4f41-9bc5-78ecce027193 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:29.034140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:29.034140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.034140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.034140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.034900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:29.035802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:29.078009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df5882-deb5-4d0d-8bce-16fac0b2127c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.078009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df5882-deb5-4d0d-8bce-16fac0b2127c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.078009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df5882-deb5-4d0d-8bce-16fac0b2127c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.102621 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1584/3154] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:29.109451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:29.157770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873f0a2-2117-4bb0-ab0f-b40310d2f095 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:29.182667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:29.183764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.186823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.187539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] PATH_INFO: `/v3/projects/dea95d540b3a493abceeafe170c11c4b/users/0e9cda2739ba4361beccbaebed076602/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.213856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e3df5882-deb5-4d0d-8bce-16fac0b2127c None None] MFA Rules not processed for user `bdf89c77e6324917bcce6b192344ff8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:29.215132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e3df5882-deb5-4d0d-8bce-16fac0b2127c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:29.323203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea95d540b3a493abceeafe170c11c4b, user_id=0e9cda2739ba4361beccbaebed076602, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:29.331689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:29.444066 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1585/3155] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:42:29 2022] PUT /identity/v3/projects/dea95d540b3a493abceeafe170c11c4b/users/0e9cda2739ba4361beccbaebed076602/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:29.450764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:29.467333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:29.499987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:29.566418 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1571/3156] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:29.586407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e7ea-e5df-49a3-9cb6-68fe8cf28434 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.587004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e7ea-e5df-49a3-9cb6-68fe8cf28434 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.587472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e7ea-e5df-49a3-9cb6-68fe8cf28434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.621806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1793e7ea-e5df-49a3-9cb6-68fe8cf28434 None None] MFA Rules not processed for user `bdf89c77e6324917bcce6b192344ff8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:29.625441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1793e7ea-e5df-49a3-9cb6-68fe8cf28434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:29.721381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6745d-e234-4ec5-86c3-22d3b0877cea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:29.734803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:29.735874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.736376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.736934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.741703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:29.744912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:29.779429 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1586/3157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:29.788402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:29.822528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95814992-3ed0-45d4-8f99-cf29243bb8bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:29.828162 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1572/3158] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:42:29.841086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:29.842528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.843191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.843412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:29.843816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:29.844603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.845608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] PATH_INFO: `/v3/projects/dea95d540b3a493abceeafe170c11c4b/users/0e9cda2739ba4361beccbaebed076602/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:29.848809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea95d540b3a493abceeafe170c11c4b, user_id=0e9cda2739ba4361beccbaebed076602, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:29.854763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:42:29.860836 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:29.867082 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:42:29.901650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1587/3159] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:42:29 2022] PUT /identity/v3/projects/dea95d540b3a493abceeafe170c11c4b/users/0e9cda2739ba4361beccbaebed076602/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:29.914655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1573/3160] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:42:31.467037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:31.690662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:31.827176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb45608-4778-49a3-bbfd-6b4fb7add42f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:31.857782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:31.858669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:31.859089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:31.859465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:32.122538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:32.126101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c996c-5d27-45c0-8904-ce338f441465 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:32.159658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:32.185266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1588/3161] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:32.801091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:34.052854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f842-8565-4cb6-96ee-47793f39762d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:34.053570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f842-8565-4cb6-96ee-47793f39762d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:34.054242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27f842-8565-4cb6-96ee-47793f39762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-de27f842-8565-4cb6-96ee-47793f39762d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:42:34.087226 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:34.088548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:42:34.099342 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1574/3162] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 48 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:42:35.185122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:35.185881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:35.185881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:35.298630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] MFA Rules not processed for user `7f1602f439f64597ae371c084e7faed0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:35.300987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:35.442516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:35.599950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1589/3163] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:42:41.222667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fe48-ab3a-4b93-9eee-39eccca4244f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:41.228957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fe48-ab3a-4b93-9eee-39eccca4244f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:41.229467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550fe48-ab3a-4b93-9eee-39eccca4244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:41.294585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b550fe48-ab3a-4b93-9eee-39eccca4244f None None] MFA Rules not processed for user `ac27c842f7b64080b644fff53f294c65`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:41.298398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b550fe48-ab3a-4b93-9eee-39eccca4244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:41.326042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:41.522440 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1575/3164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:42.107292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:42.323569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f954b-a116-4461-8ff2-e2b3bbc1ba54 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:42.338291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:42.338967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:42.340561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:42.340851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:42.350341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:42.390024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:42.391996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:42.418486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1590/3165] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:42.738828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:42.739440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:42.739440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:42:42.746475 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:42.752714 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:42:42.789804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1576/3166] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 35 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:42:46.774145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:46.778480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:46.829265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c7df6-36dc-4db9-a5c0-1ed513853dac service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:46.857849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:46.859914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:46.860254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:46.863690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:46.868028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:46.908143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:46.911591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:46.987622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1591/3167] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:47.184047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:47.186235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:47.475400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8aa0-3c9a-4995-90ef-db050210a1de None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:47.491349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:47.496900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:47.504466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:47.506856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] PATH_INFO: `/v3/users/a826e2ebcf3a416ebbd0b2f00b314887` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:47.513463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a826e2ebcf3a416ebbd0b2f00b314887)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:47.521291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:47.895290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a826e2ebcf3a416ebbd0b2f00b314887'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:48.014682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a826e2ebcf3a416ebbd0b2f00b314887'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:48.035523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a826e2ebcf3a416ebbd0b2f00b314887'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:48.057828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a826e2ebcf3a416ebbd0b2f00b314887'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:48.058980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-23f7889f-c567-4f95-a89d-3cc04c2874a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a826e2ebcf3a416ebbd0b2f00b314887'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:48.079681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1577/3168] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:42:47 2022] DELETE /identity/v3/users/a826e2ebcf3a416ebbd0b2f00b314887 => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:51.334640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:51.351296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2c743-2d4d-472a-bc64-2e1d04369d44 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:51.589328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:51.590446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:51.590931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:51.591411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] PATH_INFO: `/v3/projects/a62e260bcc524f18b03a968bb631891d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:51.609100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62e260bcc524f18b03a968bb631891d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:51.612857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:51.895990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:51.898950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62e260bcc524f18b03a968bb631891d', 'request_id': 'req-5f3610cd-a67b-4f79-8f26-5d789a82d08a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:51.929462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62e260bcc524f18b03a968bb631891d', 'request_id': 'req-5f3610cd-a67b-4f79-8f26-5d789a82d08a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:52.048928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62e260bcc524f18b03a968bb631891d', 'request_id': 'req-5f3610cd-a67b-4f79-8f26-5d789a82d08a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:52.083101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] The token cache is being invalidate because project a62e260bcc524f18b03a968bb631891d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:42:52.083474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:52.087003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f3610cd-a67b-4f79-8f26-5d789a82d08a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:52.095912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1592/3169] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:51 2022] DELETE /identity/v3/projects/a62e260bcc524f18b03a968bb631891d => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:52.097561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:52.098040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:52.098162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:52.159260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:52.160526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:52.303756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:52.381473 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1578/3170] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:52.400421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:52.400421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:52.400421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:52.423999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:52.425784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:52.439264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1593/3171] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:52.443903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:52.457714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea793-e7b1-449b-9b5a-721d5d40f8aa None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:52.485681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:52.486847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:52.487464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:52.488082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:52.492269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:52.492269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:52.493396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:52.552797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1579/3172] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:52.560425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:52.574938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509003-5ab8-47ac-af09-d729f10c3826 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:52.590994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:52.591917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:52.592392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:52.592982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:52.594756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:52.598027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b09bb8-79be-4ce3-8ca2-2d3a924f6c79 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.002971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1594/3173] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:42:52 2022] POST /identity/v3/projects => generated 363 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:53.003792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.018284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054132f-1da8-47cf-98c5-cdfcad846c8e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.208972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.210451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.211135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.211634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.213544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.217824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.275352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.275725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.276077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.312873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] MFA Rules not processed for user `d475a7c95ae7405db2483fc26ea0a8c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:53.314387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:53.374247 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1580/3174] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:42:53 2022] POST /identity/v3/users => generated 282 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:53.375630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.398070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa1250-96bb-467c-874b-ef999a26c6e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.414980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.416125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.416665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.417215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.418156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.420729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.452472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1581/3175] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:53.458584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.474532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877a92-86cf-4758-8d7a-1940be1d597b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.490369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.491730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.492281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.492807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.493912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.496543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f774b4-17a7-4df9-b3dd-6116983d6cdd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.499632 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1595/3176] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:42:53.522373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1582/3177] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:42:53.580619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:53.605782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b939f8-3881-437d-beb3-5c0baa9fc348 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:53.622786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:53.623800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.624278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.624781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] PATH_INFO: `/v3/projects/9dae73b687df4626a377fcf4030f78a0/users/0f42c89a160549009239a40de8d5daa9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.673310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dae73b687df4626a377fcf4030f78a0, user_id=0f42c89a160549009239a40de8d5daa9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:53.680743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:53.886857 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1596/3178] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:42:53 2022] PUT /identity/v3/projects/9dae73b687df4626a377fcf4030f78a0/users/0f42c89a160549009239a40de8d5daa9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:53.905861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a16f0-22ab-45fb-a798-2c1039778798 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:53.907211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a16f0-22ab-45fb-a798-2c1039778798 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:53.908061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a16f0-22ab-45fb-a798-2c1039778798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:53.948240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eb5a16f0-22ab-45fb-a798-2c1039778798 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:53.950738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eb5a16f0-22ab-45fb-a798-2c1039778798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:54.129260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1583/3179] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:54.189014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:54.192198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:54.352865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937507f-4d2e-4943-b601-ec54ddcc867c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:54.367785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:54.368797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:54.369321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:54.369992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:54.394123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:54.395789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:54.430425 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1597/3180] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:54.487116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:54.487678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:54.487678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:42:54.495050 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:42:54.496880 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:42:54.521925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1584/3181] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:42:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:42:54.940089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:54.943156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:54.975351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222e411-3273-41d3-9896-37159bb82dc9 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:54.982274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:54.983204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:54.983816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:54.984342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] PATH_INFO: `/v3/users/8b0cc8b23d7c43bba9c404d381f2a1bd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:54.985991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0cc8b23d7c43bba9c404d381f2a1bd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:54.990804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:55.105409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:55.258861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0cc8b23d7c43bba9c404d381f2a1bd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:55.335357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0cc8b23d7c43bba9c404d381f2a1bd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:55.384572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0cc8b23d7c43bba9c404d381f2a1bd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:55.385649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0cc8b23d7c43bba9c404d381f2a1bd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:55.388445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-861e8ef4-a260-49e4-a13a-5019faf5cb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0cc8b23d7c43bba9c404d381f2a1bd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:55.411350 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1598/3182] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:42:54 2022] DELETE /identity/v3/users/8b0cc8b23d7c43bba9c404d381f2a1bd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:55.944691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:55.947072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:56.023922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:56.061059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01998a5f-9326-4ebf-bc95-3518705c8390 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:56.066615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:56.067616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:56.068062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:56.068630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] PATH_INFO: `/v3/projects/47284988ba214419947db6506b8f8552` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:56.073460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47284988ba214419947db6506b8f8552)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:56.076291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:56.234284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47284988ba214419947db6506b8f8552', 'request_id': 'req-f478bd06-d7df-4cff-8974-e75edcf7cb61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:56.243709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47284988ba214419947db6506b8f8552', 'request_id': 'req-f478bd06-d7df-4cff-8974-e75edcf7cb61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:56.255016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47284988ba214419947db6506b8f8552', 'request_id': 'req-f478bd06-d7df-4cff-8974-e75edcf7cb61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:56.399830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] The token cache is being invalidate because project 47284988ba214419947db6506b8f8552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:42:56.400622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:56.407298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f478bd06-d7df-4cff-8974-e75edcf7cb61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:56.407298 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1585/3183] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:55 2022] DELETE /identity/v3/projects/47284988ba214419947db6506b8f8552 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:56.408885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:56.409363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:56.409551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:56.446400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:56.450278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:56.599800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1599/3184] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:56.608537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:56.609376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:56.609847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:56.648555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:56.649881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:56.676166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:56.676659 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1586/3185] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:56.690369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f2a62-4cdc-4753-b1ec-f52c6bda9f35 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:56.696518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:56.697441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:56.698302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:56.700416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:56.701535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:42:56.702078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:56.706596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:56.741285 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1600/3186] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:42:56.742442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:56.764360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f829b-8fed-4bc7-acb7-cbb36869b87a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:56.777406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:56.777406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:56.779774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:56.779774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:56.779774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:56.781150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:56.962585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1587/3187] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:42:56 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:56.967680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:56.987719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbb927-ae39-419f-9ee2-9e729e23ed7c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:57.076399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:57.077622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.077969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.078368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.079306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:57.081549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:57.186258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1601/3188] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:42:56 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:42:57.189930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:57.205059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba25d7-df10-4b80-838b-8dc75a9171c9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:57.221720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:57.222635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.223096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.223536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.224364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:57.226241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:57.264736 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1588/3189] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:42:57.265845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:57.281120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e6aa-7492-4d66-9c4d-59184ecf661c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:57.294854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:57.295510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.295766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.305107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.305844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:57.320542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db159e6-97e8-4459-a0b6-41fa96045ec4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:57.330502 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1602/3190] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:42:57.335555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:57.361476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5532-780d-4806-ad60-0fff94175dd3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:57.368628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:57.369581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.370077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.370518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] PATH_INFO: `/v3/projects/cb960fb39af741e19d124f217f50f199/users/70852d13530d4d299f94a11f284fde61/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.411274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb960fb39af741e19d124f217f50f199, user_id=70852d13530d4d299f94a11f284fde61, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:57.415197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:57.566803 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1589/3191] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:42:57 2022] PUT /identity/v3/projects/cb960fb39af741e19d124f217f50f199/users/70852d13530d4d299f94a11f284fde61/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:57.568803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.569332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.569458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.599844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:57.619938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] MFA Rules not processed for user `70852d13530d4d299f94a11f284fde61`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:57.621978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:57.774533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1603/3192] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:57.785016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:57.786803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:57.866768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:57.888760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6ce71-e023-4478-99e5-136b988d1fe3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:57.896167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:57.896821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:57.897094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:57.897446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:57.906793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:57.908378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:57.918892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1590/3193] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:57.959394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:57.961232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:57.989424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:58.045616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66b67b-b036-4dcc-bc83-6c86cd642602 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:58.050439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:58.051077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:58.051541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:58.052121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] PATH_INFO: `/v3/users/bdf89c77e6324917bcce6b192344ff8b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:58.053380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf89c77e6324917bcce6b192344ff8b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:58.055325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:58.096741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b624e2-9e8b-4fd9-9cd0-240a052014fd service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:58.101952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:58.102597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:58.103880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:58.104165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] PATH_INFO: `/v3/users/70852d13530d4d299f94a11f284fde61` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:58.106165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70852d13530d4d299f94a11f284fde61)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:58.108201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:58.316889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70852d13530d4d299f94a11f284fde61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.330415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf89c77e6324917bcce6b192344ff8b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.385798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70852d13530d4d299f94a11f284fde61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.406159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70852d13530d4d299f94a11f284fde61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.415770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70852d13530d4d299f94a11f284fde61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.416863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac96ff57-63b9-448f-a721-1a81daf7f836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70852d13530d4d299f94a11f284fde61'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.425260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1591/3194] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:42:57 2022] DELETE /identity/v3/users/70852d13530d4d299f94a11f284fde61 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:58.434916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:58.434916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:58.434916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:58.479738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:58.489504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:58.490030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf89c77e6324917bcce6b192344ff8b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.533277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf89c77e6324917bcce6b192344ff8b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.539804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf89c77e6324917bcce6b192344ff8b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.546830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df3a5252-f39f-4e57-b16b-530c772d6636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf89c77e6324917bcce6b192344ff8b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:42:58.598746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1604/3195] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:42:57 2022] DELETE /identity/v3/users/bdf89c77e6324917bcce6b192344ff8b => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:42:58.601579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:58.604035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:58.604035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:58.641143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] MFA Rules not processed for user `ac27c842f7b64080b644fff53f294c65`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:42:58.649781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:58.665779 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1592/3196] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:58.708069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:58.708069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:58.763888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1605/3197] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:42:58.826551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd6c3-4275-482e-87d3-bf72cc5b452d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:58.898916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:58.899906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:58.900182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:58.902767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:59.004183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:59.005956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697f61-128e-4f70-baa0-090d4a7c3a94 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:59.020879 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1593/3198] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:42:59.621736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:59.921861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:42:59.923957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:42:59.965376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389d134-29ac-4e4a-9e45-7657438b6af9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:42:59.971264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:42:59.972374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:42:59.973005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:42:59.973520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] PATH_INFO: `/v3/projects/8e13ff7300624e8fa370352995786a37` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:42:59.975100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e13ff7300624e8fa370352995786a37)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:42:59.977805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:42:59.986165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:00.166877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e13ff7300624e8fa370352995786a37', 'request_id': 'req-7f663d31-e3ad-466d-aaf2-09ae5191b59e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:00.176112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e13ff7300624e8fa370352995786a37', 'request_id': 'req-7f663d31-e3ad-466d-aaf2-09ae5191b59e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:00.265863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e13ff7300624e8fa370352995786a37', 'request_id': 'req-7f663d31-e3ad-466d-aaf2-09ae5191b59e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:00.284385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] The token cache is being invalidate because project 8e13ff7300624e8fa370352995786a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:00.284769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:00.285391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f663d31-e3ad-466d-aaf2-09ae5191b59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:00.286906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1606/3199] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:59 2022] DELETE /identity/v3/projects/8e13ff7300624e8fa370352995786a37 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:00.297129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98dd5-9563-4ed3-8a28-945eceb7688b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.297681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98dd5-9563-4ed3-8a28-945eceb7688b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.297681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e98dd5-9563-4ed3-8a28-945eceb7688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.332856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-32e98dd5-9563-4ed3-8a28-945eceb7688b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:00.334454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32e98dd5-9563-4ed3-8a28-945eceb7688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:00.447469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1594/3200] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:00.457272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.457635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.458157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.473055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.473413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.473755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:00.485724 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:00.487277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:00.490047 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1595/3201] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 18 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:43:00.540789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:00.542237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:00.575155 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1607/3202] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:00.579875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:00.614498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7af294-4f74-4858-a4a5-0c724aa1f22a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:00.630418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:00.630418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.630418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.630701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.631301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:00.631604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:00.634068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:00.654105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1596/3203] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:00.661609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:00.685383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4bc1-449f-4aff-bb87-0800997d57e9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:00.706610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:00.707632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.708599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.708599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.708882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:00.712656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:00.769415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:00.772290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:00.801021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9905b4e-762b-41ef-b0e5-2bf2022ce61d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:00.811494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:00.813429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:00.813704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:00.818665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] PATH_INFO: `/v3/projects/cb960fb39af741e19d124f217f50f199` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:00.820799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb960fb39af741e19d124f217f50f199)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:00.823072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:00.909934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1608/3204] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:00 2022] POST /identity/v3/projects => generated 373 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:00.911510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.119701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb960fb39af741e19d124f217f50f199', 'request_id': 'req-01f7c9c6-73db-487d-abb0-39b67e95853b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:01.120623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddfc0-bb47-402b-8b61-4c112ad801c2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.150160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb960fb39af741e19d124f217f50f199', 'request_id': 'req-01f7c9c6-73db-487d-abb0-39b67e95853b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:01.171413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb960fb39af741e19d124f217f50f199', 'request_id': 'req-01f7c9c6-73db-487d-abb0-39b67e95853b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:01.250658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.251483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.251890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.252337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.262600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.267196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8407ec-be41-4127-aec1-f8a5d2076245 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.301806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] The token cache is being invalidate because project cb960fb39af741e19d124f217f50f199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:01.302388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:01.305504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01f7c9c6-73db-487d-abb0-39b67e95853b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:01.307788 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1597/3205] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:00 2022] DELETE /identity/v3/projects/cb960fb39af741e19d124f217f50f199 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:01.310422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.310760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.311033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.385308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] MFA Rules not processed for user `0e9cda2739ba4361beccbaebed076602`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:01.386611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:01.412362 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1609/3206] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:00 2022] POST /identity/v3/users => generated 287 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:01.412362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.412362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.412362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.462525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:01.463888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:01.485912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1610/3207] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:01.487935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.489607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:01.505058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2e8a7-815e-4836-9ec6-a36218f93916 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.513578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.514502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.515023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.516469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.517595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.519527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202311f-fb1c-47a6-8244-0aa50549a9d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.540289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1611/3208] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:01.542054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.542529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.543573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.544648 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1598/3209] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:01.548071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.576046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b2893-f2df-45ce-8ec1-2dbe9c752718 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.589311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.590590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.591059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.591533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.592390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.594247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.594672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:01.596407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:01.621861 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1612/3211] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:01.623036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.623759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1599/3211] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:01.625816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.633361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:01.650789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f828f4-f83c-4de8-95a8-219cea6e9c4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.665268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.665955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.670441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.670754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] PATH_INFO: `/v3/projects/7a9a8c1c922b4a9eae99d190d10ba85e/users/346db825477f4cfca59dfa9ac8ab0455/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.711932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9a8c1c922b4a9eae99d190d10ba85e, user_id=346db825477f4cfca59dfa9ac8ab0455, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.717467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaed50f-d140-40ea-b916-227ad663cd7b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.744528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d630150-f65a-4ff6-97f6-188373d36a3f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.750096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.751174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.751529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.752802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.766082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.774402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.788314 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1613/3212] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:01.791183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.811150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3016f6-02fc-4559-a494-c9b08dcf88da service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.821904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:01.822064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.822408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.823346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:01.824428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:01.825209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:01.826952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:01.854671 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1614/3213] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:01.854671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:01.862860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1600/3214] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:01 2022] PUT /identity/v3/projects/7a9a8c1c922b4a9eae99d190d10ba85e/users/346db825477f4cfca59dfa9ac8ab0455/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:01.863702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995136e-766e-43b9-83c9-b5649026187a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:01.873886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66abe-9a9a-4ff4-beb9-e6ca1802ee9b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:01.874484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66abe-9a9a-4ff4-beb9-e6ca1802ee9b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:01.874966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd66abe-9a9a-4ff4-beb9-e6ca1802ee9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:02.002379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:02.003233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:02.003673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:02.004120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:02.005047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:02.007427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:02.047654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bdd66abe-9a9a-4ff4-beb9-e6ca1802ee9b None None] MFA Rules not processed for user `346db825477f4cfca59dfa9ac8ab0455`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:02.055899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdd66abe-9a9a-4ff4-beb9-e6ca1802ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:02.122413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:02.133252 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1615/3215] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:01 2022] POST /identity/v3/projects => generated 405 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:02.138637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:02.362581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982df764-cc97-4055-977d-fe8dceacb8c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:02.376314 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1601/3216] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:02.383779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:02.384737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:02.385174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:02.385609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:02.386936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:02.393590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:02.399258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:02.401554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:02.406581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:02.415088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:02.547875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] MFA Rules not processed for user `346db825477f4cfca59dfa9ac8ab0455`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:02.547875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:02.579735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1616/3217] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:02 2022] POST /identity/v3/users => generated 303 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:02.584173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:02.635853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc4324-6aaa-4172-a3cc-ca413cd9635a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:02.697367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:02.698386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:02.701867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:02.704164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:02.704473 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1602/3218] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:02.712347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:02.768005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd0c4a-2cc9-4b50-97b7-c3ac7ab8404e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:02.873260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:02.878614 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1617/3219] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:43:02.882085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:02.983811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93c4d6-0e50-4c3b-b706-4b9beb1fe992 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:02.989267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:02.989761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:02.990259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:03.002708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:03.005653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:03.005948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:03.009916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:03.010618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:03.027040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:03.077086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:03.079520 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1603/3220] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:03.080250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:03.081442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:03.131182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07199345-fc09-432c-965e-9285e85153bc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:03.159083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:03.159779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:03.160065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:03.160350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] PATH_INFO: `/v3/projects/2449c558939943129ecf0b6db5251e60/users/66e1e5c8ae83452cb36701b0f335d8a2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:03.235119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2449c558939943129ecf0b6db5251e60, user_id=66e1e5c8ae83452cb36701b0f335d8a2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:03.237979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d6b4e-0752-4f83-ba1b-43ccd5a7e604 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:03.293332 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1618/3221] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:03.315232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:03.325795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:03.346327 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1604/3222] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:03 2022] PUT /identity/v3/projects/2449c558939943129ecf0b6db5251e60/users/66e1e5c8ae83452cb36701b0f335d8a2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:03.348044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:03.350742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:03.350742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:03.415894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:03.418203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:03.419393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:03.764453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0396a1e-ba21-45a4-ac4d-c10e127fc4b3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:03.834342 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1605/3223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:03.844105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:03.851068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:04.031015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:04.031623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:04.031814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:04.032308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:04.157515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ebf18-8327-4bf6-8788-d1f88d25d8d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:04.168770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:04.170339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:04.171059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:04.171543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:04.270346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:04.272154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c16acf-f19a-4d96-818a-18c953e19ae2 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:04.274876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:04.278353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:04.285810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:04.294579 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1606/3224] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:04.296353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:04.300436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:04.316432 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1619/3225] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:04.497153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df797b-dabe-4729-82b5-c0673d25b118 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:04.553378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:04.565766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:04.566121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:04.572162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:04.607581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:04.638410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:04.639887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:04.754791 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1607/3226] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:13.738357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956f21-953e-4033-aafa-0da6192be0be None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:13.739268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956f21-953e-4033-aafa-0da6192be0be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:13.739712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69956f21-953e-4033-aafa-0da6192be0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:13.798401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-69956f21-953e-4033-aafa-0da6192be0be None None] MFA Rules not processed for user `0f42c89a160549009239a40de8d5daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:13.800031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-69956f21-953e-4033-aafa-0da6192be0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:14.056476 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1620/3227] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:14.066591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:14.098889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c92f3-cf7d-46db-8dea-2f1b6a234931 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:14.120631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:14.121240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:14.121517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:14.121787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:14.170642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:14.172275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:14.258534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1608/3228] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:16.893463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba605-206b-46fa-827b-47935066ce7e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:16.898988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba605-206b-46fa-827b-47935066ce7e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:16.898988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba605-206b-46fa-827b-47935066ce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:16.931974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-152ba605-206b-46fa-827b-47935066ce7e None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:16.934668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-152ba605-206b-46fa-827b-47935066ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:16.954981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1621/3229] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:16.997050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:17.041107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be6a38-6b28-4214-994b-a718444fa372 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:17.060850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:17.061476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:17.061761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:17.062039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:17.108082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:17.137556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:17.186437 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1609/3230] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:21.758196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba605-206b-46fa-827b-47935066ce7e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:21.760434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-152ba605-206b-46fa-827b-47935066ce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:21.811357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba605-206b-46fa-827b-47935066ce7e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:21.833611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:21.834275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:21.838804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:21.838804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] PATH_INFO: `/v3/users/d475a7c95ae7405db2483fc26ea0a8c5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:21.843602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d475a7c95ae7405db2483fc26ea0a8c5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:21.852192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:22.117608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:22.131283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd475a7c95ae7405db2483fc26ea0a8c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:22.237283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd475a7c95ae7405db2483fc26ea0a8c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:22.281628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd475a7c95ae7405db2483fc26ea0a8c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:22.284160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd475a7c95ae7405db2483fc26ea0a8c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:22.286504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd475a7c95ae7405db2483fc26ea0a8c5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:22.355466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1622/3231] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:21 2022] DELETE /identity/v3/users/d475a7c95ae7405db2483fc26ea0a8c5 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:23.629779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:23.680050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95341560-767d-4d6f-8c5b-982fa3362cb1 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:23.749529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:23.751132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:23.761757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:23.920314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:23.921037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:23.921313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:23.921584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] PATH_INFO: `/v3/projects/f48fdbeb9a604c66b66780387e3af4de` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:23.927440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48fdbeb9a604c66b66780387e3af4de)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:23.932746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:24.061624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ddbe8-14d7-4304-8ca2-6dbf70358537 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:24.074242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:24.075013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:24.075490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:24.075860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] PATH_INFO: `/v3/users/ac27c842f7b64080b644fff53f294c65` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:24.087151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac27c842f7b64080b644fff53f294c65)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:24.089047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:24.204660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48fdbeb9a604c66b66780387e3af4de', 'request_id': 'req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.232982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48fdbeb9a604c66b66780387e3af4de', 'request_id': 'req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.258655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48fdbeb9a604c66b66780387e3af4de', 'request_id': 'req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.364590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac27c842f7b64080b644fff53f294c65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.397036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] The token cache is being invalidate because project f48fdbeb9a604c66b66780387e3af4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:24.397872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.398977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d1b901a0-b0ac-44b2-a57d-3c60bfd72f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.404670 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1610/3232] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:23 2022] DELETE /identity/v3/projects/f48fdbeb9a604c66b66780387e3af4de => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:24.411100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:24.411402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:24.411774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:24.471576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:24.477290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac27c842f7b64080b644fff53f294c65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.485029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:24.518354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac27c842f7b64080b644fff53f294c65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.519343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac27c842f7b64080b644fff53f294c65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.521442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fe407c9e-72be-4263-a4f9-49348f46961a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac27c842f7b64080b644fff53f294c65'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:24.567611 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1623/3233] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:23 2022] DELETE /identity/v3/users/ac27c842f7b64080b644fff53f294c65 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:24.678050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1611/3234] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:24.686321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:24.686758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:24.687238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:24.734114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:24.735642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:24.822307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:24.887746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1624/3235] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:24.888335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:24.911160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da8727-a0c4-4ffa-b9d9-c1637872db71 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:24.929556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:24.930733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:24.931276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:24.931757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:24.932725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:24.934235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:24.938467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:24.984630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1612/3236] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:24.992388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.005764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a30a7-fa19-405b-8193-56ee121ed583 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:25.031762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:25.032662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.033117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.033556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.034374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:25.036587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a164a-8a86-48ec-9f28-0742201bb6e6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:25.206767 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1625/3237] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:24 2022] POST /identity/v3/projects => generated 377 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:25.210818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.230825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0784e11-f28b-4173-bab3-ea5a7f3fa0d1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:25.376137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.376781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.377281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.497288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] MFA Rules not processed for user `0f42c89a160549009239a40de8d5daa9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:25.504326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:25.530800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:25.602213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:25.602996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.603491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.603981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.604776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:25.606812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:25.622502 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1626/3238] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:25.773480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.775066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:25.791910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b0b21-99e9-445f-99ce-a1dfba394b2e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:25.813659 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1613/3239] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:25 2022] POST /identity/v3/users => generated 289 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:25.818049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.827926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:25.830010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.830363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.830708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] PATH_INFO: `/v3/projects/e1824edba1954bc49c70a63cedd89d53` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.833665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1824edba1954bc49c70a63cedd89d53)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:25.837638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:25.840660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a0ab7-e6b7-4310-911e-24c937f06bb0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:25.858411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:25.859155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.859497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.859997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.860868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:25.864019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:25.898892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1614/3240] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:25.903665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.996112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b994d-4027-4323-848e-0b8f3d6ea581 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:25.996112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:25.996112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:25.996112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1615/3241] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:25.998236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a3c9e8-e401-4def-a1c8-873fa5ae4e6c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:26.007125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:26.008425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:26.009013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:26.009533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] PATH_INFO: `/v3/projects/1d65446c687345bf995d7e3d6d882c4e/users/6f3641a551df479f888d89f9d43bf6a7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:26.029265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d65446c687345bf995d7e3d6d882c4e, user_id=6f3641a551df479f888d89f9d43bf6a7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:26.033514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4739d9-06a5-48fb-b8fd-128b7eb3f222 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:26.315246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1616/3242] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:25 2022] PUT /identity/v3/projects/1d65446c687345bf995d7e3d6d882c4e/users/6f3641a551df479f888d89f9d43bf6a7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:26.320972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:26.320972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:26.320972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:26.342105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:26.343480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:26.348099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1824edba1954bc49c70a63cedd89d53', 'request_id': 'req-d55f50db-d837-4c00-97de-6cf86aefd7bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:26.360997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1824edba1954bc49c70a63cedd89d53', 'request_id': 'req-d55f50db-d837-4c00-97de-6cf86aefd7bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:26.499107 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1617/3243] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:26.499107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:26.499107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:26.506656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b317c-dbe2-47e9-95b1-47e183b209ab None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:26.516134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:26.516134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:26.516134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:26.516134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:26.522455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:26.523919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e07fcb-bd90-4470-aeb4-405025ed295a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:26.535220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1618/3244] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:26.797074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1824edba1954bc49c70a63cedd89d53', 'request_id': 'req-d55f50db-d837-4c00-97de-6cf86aefd7bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:26.819990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] The token cache is being invalidate because project e1824edba1954bc49c70a63cedd89d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:26.820286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:26.821915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d55f50db-d837-4c00-97de-6cf86aefd7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:26.826544 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1627/3245] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:25 2022] DELETE /identity/v3/projects/e1824edba1954bc49c70a63cedd89d53 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:26.833261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:26.833736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:26.833948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:26.878611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:26.879978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:26.893890 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1619/3246] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:26.902198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:26.902861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:26.902861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:26.939379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:26.940733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:26.969569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1628/3247] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:26.974621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:26.989227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe712c-020e-4745-a8ac-9f44e6a4a9c9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:26.997787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:26.999897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.000498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.000932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.001904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:27.002949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:27.006356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:27.029578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1620/3248] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:27.034110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:27.058193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f60aaa-b9dc-4fc9-ac4b-54d94c01d6ef None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:27.065705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:27.066741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.067219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.067722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.068645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:27.070985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:27.289691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:27.316897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1629/3249] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:27 2022] POST /identity/v3/projects => generated 395 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:27.321839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945fdb-5ae4-49e0-b520-a82c7006273f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:27.492015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:27.492895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.493172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.493445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.494085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:27.496807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:27.649078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1621/3250] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:27 2022] POST /identity/v3/users => generated 298 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:27.658805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:27.694612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efeaf-9a42-4ac6-a282-16d8a433890a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:27.738121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:27.738121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.738121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.738121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.739344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:27.739344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:27.766608 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1630/3251] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:27.771256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:27.784939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c9124-45b2-41a6-a60f-a3ad7f68953a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:27.814478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:27.814823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.824651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.832404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.833251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:27.838099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca75f37-ba41-476c-844c-a5b1efff8ce5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:27.892411 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1622/3252] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:27.896848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:27.931406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a83afe-26b2-4cd3-b79f-ba28dee560d9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:27.956713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:27.958608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:27.960689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:27.962053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] PATH_INFO: `/v3/projects/b7517ed437bd40f0bc70a2ec925d3440/users/f2d399c04e90495fb1366bdfe7d0f05f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:27.977388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:28.042519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7517ed437bd40f0bc70a2ec925d3440, user_id=f2d399c04e90495fb1366bdfe7d0f05f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:28.045493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:28.241452 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1631/3253] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:27 2022] PUT /identity/v3/projects/b7517ed437bd40f0bc70a2ec925d3440/users/f2d399c04e90495fb1366bdfe7d0f05f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:28.245901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:28.246293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:28.246502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:28.333637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] MFA Rules not processed for user `f2d399c04e90495fb1366bdfe7d0f05f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:28.334899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:28.564358 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1623/3254] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:28.566839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:28.876038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dab8a-7458-4eb6-a383-98f57b1e0670 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:28.909336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:28.909790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:28.910185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:28.910777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:28.911546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:28.914868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:28.964451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:29.127644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1632/3255] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:28 2022] POST /identity/v3/projects => generated 397 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:29.129382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:29.147689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0f94a-d9bd-4af0-a775-bb46e5d434a6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:29.281847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:29.282589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:29.282589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:29.283776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:29.285025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:29.288328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:29.525958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1624/3256] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:29 2022] POST /identity/v3/users => generated 305 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:29.530422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:29.576786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de21296-ca8b-469e-bb03-cdacbffcecb0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:29.598914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:29.599566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:29.599842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:29.600199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:29.600922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:29.605191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:29.643706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1633/3257] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:29.644695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:29.660530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd0b51-447b-450c-8b42-3a56e3d90ca3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:29.696299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:29.705980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:29.709609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:29.713130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] PATH_INFO: `/v3/projects/07c736ff1bf8432db6c30dfdc2984a02/users/e2ba29b3317f4af087b5d57375b2f535/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:29.803549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c736ff1bf8432db6c30dfdc2984a02, user_id=e2ba29b3317f4af087b5d57375b2f535, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:29.809492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:29.987873 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1625/3258] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:29 2022] PUT /identity/v3/projects/07c736ff1bf8432db6c30dfdc2984a02/users/e2ba29b3317f4af087b5d57375b2f535/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:29.991959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:30.009768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290de5-c079-482c-8a23-53d18de38c1f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:30.263746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:30.264564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:30.264842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:30.265180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:30.265870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:30.267602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ac9e7-af23-4ee0-9770-652e25d3447d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:30.312472 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1634/3259] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:30.312942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:30.337696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938c43e-7268-4c2c-b00c-93fb0f426e25 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:30.349098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:30.349876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:30.350171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:30.350512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] PATH_INFO: `/v3/projects/07c736ff1bf8432db6c30dfdc2984a02/users/e2ba29b3317f4af087b5d57375b2f535/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:30.352604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c736ff1bf8432db6c30dfdc2984a02, user_id=e2ba29b3317f4af087b5d57375b2f535, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:30.357778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7257-e3e7-4670-9d94-1ac021b04f5b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:30.384452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1626/3260] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:30 2022] PUT /identity/v3/projects/07c736ff1bf8432db6c30dfdc2984a02/users/e2ba29b3317f4af087b5d57375b2f535/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:30.395402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:30.395841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:30.396423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:30.459788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] MFA Rules not processed for user `e2ba29b3317f4af087b5d57375b2f535`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:30.461182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:30.612568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:30.612910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:30.613178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:30.663523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1635/3261] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:30.668879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:30.750234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] MFA Rules not processed for user `66e1e5c8ae83452cb36701b0f335d8a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:30.751472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:30.774340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:30.937666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da261202-01fa-41ca-a35a-e3749f217899 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:30.953717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d399c04e90495fb1366bdfe7d0f05f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7517ed437bd40f0bc70a2ec925d3440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:30.955258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:30.955762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:30.956204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:30.963746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Nov 02 12:43:30.972278 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application enforcer_obj._enforce( Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:30.979322 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1636/3262] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:43:30 2022] POST /identity/v3/projects => generated 136 bytes in 306 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:43:30.998620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.000846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1627/3263] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:31.009183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:31.090592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc81c-1e6f-496d-a8a9-e0fae5bcbddd tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:31.105468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:31.106431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:31.107091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:31.107607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:31.108671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:31.119641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invalid input for field 'name': '' is too short Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: On instance['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: On instance['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: '' Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application '' Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.149061 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:43:31.151763 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application '' Nov 02 12:43:31.153416 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.160017 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1637/3264] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:43:30 2022] POST /identity/v3/projects => generated 283 bytes in 170 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:43:31.165394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.188239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e9356-cc04-4d90-91e0-645f76251a3a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:31.214024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:31.214685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:31.221081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:31.221081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:31.221081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:31.221081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: On instance['name']: Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: On instance['name']: Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise error Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:43:31.233432 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:31.235972 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:43:31.238413 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.243923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.257182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1628/3265] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:43:31 2022] POST /identity/v3/projects => generated 412 bytes in 92 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:43:31.273458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99d484-253c-4b97-844e-0cba454aaa4d tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:31.286744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:31.287731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:31.288175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:31.288662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects/3ef2b996e56d474cb05641e88a94eb1a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:31.322283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ef2b996e56d474cb05641e88a94eb1a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:31.327402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Could not find project: 3ef2b996e56d474cb05641e88a94eb1a.: keystone.exception.ProjectNotFound: Could not find project: 3ef2b996e56d474cb05641e88a94eb1a. Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Nov 02 12:43:31.359984 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ef2b996e56d474cb05641e88a94eb1a. Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:31.361793 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1638/3266] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:31 2022] DELETE /identity/v3/projects/3ef2b996e56d474cb05641e88a94eb1a => generated 113 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:43:31.368517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.389490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc442e-623a-43c2-bd0d-5e848b7dfa83 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:31.408096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2d399c04e90495fb1366bdfe7d0f05f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b7517ed437bd40f0bc70a2ec925d3440', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:31.409071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:31.409542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:31.409982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:31.410804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:31.412016 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:31.412016 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:31.412016 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Nov 02 12:43:31.419717 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._list_projects() Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application enforcer_obj._enforce( Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Nov 02 12:43:31.421385 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:31.433793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1629/3267] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:43:31 2022] GET /identity/v3/projects => generated 135 bytes in 66 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:43:31.441739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.462784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2d111-f47b-40b0-bff7-3c02f75012f9 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:31.476976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:31.477945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:31.479246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:31.479753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:31.480618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:31.482783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:31.771413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1639/3268] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:31 2022] POST /identity/v3/projects => generated 357 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:31.777361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:31.797728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9513d-5834-466b-9679-1f7bf0d4f8af tempest-ProjectsNegativeStaticTestJSON-161635707 tempest-ProjectsNegativeStaticTestJSON-161635707-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:32.013833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:32.015238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:32.015688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:32.016138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:32.016972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:32.019111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:32.021911 n-d-857339-6 devstack@keystone.service[82131]: WARNING keystone.server.flask.common [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 02 12:43:32.171172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.sql.core [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-626470069' for key 'project.ixu_project_name_domain_id'") Nov 02 12:43:32.171172 n-d-857339-6 devstack@keystone.service[82131]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:43:32.171172 n-d-857339-6 devstack@keystone.service[82131]: [parameters: {'id': 'a091523cfc424a7a90441981d40db3dc', 'name': 'tempest-project-dup-626470069', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 12:43:32.171172 n-d-857339-6 devstack@keystone.service[82131]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82131) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-626470069, project id a091523cfc424a7a90441981d40db3dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-626470069, project id a091523cfc424a7a90441981d40db3dc. Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:43:32.187150 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result.read() Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-626470069' for key 'project.ixu_project_name_domain_id'") Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:43:32.191981 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application yield resource Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise self.value Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:43:32.193233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application session.commit() Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:43:32.194859 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:43:32.196197 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application result.read() Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:43:32.198984 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-626470069' for key 'project.ixu_project_name_domain_id'") Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [parameters: {'id': 'a091523cfc424a7a90441981d40db3dc', 'name': 'tempest-project-dup-626470069', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:32.201198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-626470069 at domain ID default. Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:32.203222 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-626470069, project id a091523cfc424a7a90441981d40db3dc. Nov 02 12:43:32.205494 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:32.206721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:32.207489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1630/3269] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:43:31 2022] POST /identity/v3/projects => generated 284 bytes in 414 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 02 12:43:32.212523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f25a1-8649-4ee7-8b0f-f665e361edf7 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:32.222509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2ba29b3317f4af087b5d57375b2f535', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07c736ff1bf8432db6c30dfdc2984a02', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:32.223077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:32.224768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:32.225090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] PATH_INFO: `/v3/projects/e0960a9e5f104be8b28a31b6070bc6fe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:32.227930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e0960a9e5f104be8b28a31b6070bc6fe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:32.233035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:32.445882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0960a9e5f104be8b28a31b6070bc6fe', 'request_id': 'req-2b9979dc-a860-4788-b84d-e6e54453bca2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:32.461558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0960a9e5f104be8b28a31b6070bc6fe', 'request_id': 'req-2b9979dc-a860-4788-b84d-e6e54453bca2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:32.669493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0960a9e5f104be8b28a31b6070bc6fe', 'request_id': 'req-2b9979dc-a860-4788-b84d-e6e54453bca2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:32.732538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] The token cache is being invalidate because project e0960a9e5f104be8b28a31b6070bc6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:32.732538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:32.732538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b9979dc-a860-4788-b84d-e6e54453bca2 tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:32.732538 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1640/3270] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:32 2022] DELETE /identity/v3/projects/e0960a9e5f104be8b28a31b6070bc6fe => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:32.785797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:32.785797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:32.785797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:32.869716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dd29-f9bd-4eca-9469-b8489358be6c tempest-ProjectsNegativeStaticTestJSON-1584044658 tempest-ProjectsNegativeStaticTestJSON-1584044658-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:33.013766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:33.013766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:33.013766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:33.013766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] PATH_INFO: `/v3/users/f2d399c04e90495fb1366bdfe7d0f05f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:33.016319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d399c04e90495fb1366bdfe7d0f05f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:33.016319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:34.431706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d399c04e90495fb1366bdfe7d0f05f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:34.523386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d399c04e90495fb1366bdfe7d0f05f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:34.558314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d399c04e90495fb1366bdfe7d0f05f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:34.586064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d399c04e90495fb1366bdfe7d0f05f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:34.587581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d399c04e90495fb1366bdfe7d0f05f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:34.607861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1631/3271] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:32 2022] DELETE /identity/v3/users/f2d399c04e90495fb1366bdfe7d0f05f => generated 0 bytes in 1898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:34.613022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:34.613496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:34.613612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:34.698987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:34.700781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:34.762727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:34.879870 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1641/3272] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:34.887244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:34.888830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:35.129861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f0a91-8678-45bc-9028-9b58f74fcd3c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:35.137975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:35.138706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:35.139050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:35.148938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:35.173436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:35.175087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:35.201526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1632/3273] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:35.895250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:35.896880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:35.916185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771602b9-12af-4ea6-af01-cff954f09035 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:35.935549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:35.936209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:35.936519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:35.936781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] PATH_INFO: `/v3/projects/b7517ed437bd40f0bc70a2ec925d3440` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:35.944224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7517ed437bd40f0bc70a2ec925d3440)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:35.949020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:36.228407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7517ed437bd40f0bc70a2ec925d3440', 'request_id': 'req-fab243b3-88b1-48ed-aa83-7a032bbbc725'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.249085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7517ed437bd40f0bc70a2ec925d3440', 'request_id': 'req-fab243b3-88b1-48ed-aa83-7a032bbbc725'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.327057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7517ed437bd40f0bc70a2ec925d3440', 'request_id': 'req-fab243b3-88b1-48ed-aa83-7a032bbbc725'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.348210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] The token cache is being invalidate because project b7517ed437bd40f0bc70a2ec925d3440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:36.350956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.353213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.359647 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1642/3274] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:35 2022] DELETE /identity/v3/projects/b7517ed437bd40f0bc70a2ec925d3440 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:36.363576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:36.386828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce146aa1-a58c-4f17-8cf7-a255d99ef2cc service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:36.393324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:36.515074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:36.516250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:36.517605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:36.522337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] PATH_INFO: `/v3/users/e2ba29b3317f4af087b5d57375b2f535` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:36.524184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ba29b3317f4af087b5d57375b2f535)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:36.526680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:36.842752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ba29b3317f4af087b5d57375b2f535'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:36.962883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ba29b3317f4af087b5d57375b2f535'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:37.002216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ba29b3317f4af087b5d57375b2f535'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:37.035539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ba29b3317f4af087b5d57375b2f535'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:37.038154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e355d3-7f07-485f-98e1-f26ebb7b0cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ba29b3317f4af087b5d57375b2f535'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:37.072047 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1633/3275] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:36 2022] DELETE /identity/v3/users/e2ba29b3317f4af087b5d57375b2f535 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:37.180622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:37.182281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:37.430136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab243b3-88b1-48ed-aa83-7a032bbbc725 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:37.588100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:37.630423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:37.631396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:37.631873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:37.647102 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:37.648622 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:37.670917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:37.671831 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1634/3276] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:43:37.674560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:37.679224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:37.679770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:37.707054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:37.970786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:37.975717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb152435-ff25-468b-8e4b-c971de8c7e11 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:37.989431 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1643/3277] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 809 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:38.867578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:38.871341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:39.095271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:39.107657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:39.112294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:39.113568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:39.114508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] PATH_INFO: `/v3/projects/07c736ff1bf8432db6c30dfdc2984a02` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:39.117013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c736ff1bf8432db6c30dfdc2984a02)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:39.122939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:39.381943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:39.529791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c736ff1bf8432db6c30dfdc2984a02', 'request_id': 'req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:39.586444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c736ff1bf8432db6c30dfdc2984a02', 'request_id': 'req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:39.648726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c736ff1bf8432db6c30dfdc2984a02', 'request_id': 'req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:39.809462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] The token cache is being invalidate because project 07c736ff1bf8432db6c30dfdc2984a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:39.813267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:39.816465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b696cfe5-31ab-498e-bd5f-8809b5ae5bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:39.827903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1635/3278] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:38 2022] DELETE /identity/v3/projects/07c736ff1bf8432db6c30dfdc2984a02 => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:39.832327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:39.833211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:39.833211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:39.878122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:39.886713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:40.081982 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1644/3279] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:40.090559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:40.091093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:40.091093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:40.151063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:40.152343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:40.206803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:40.209744 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1636/3280] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:40.229388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b77e8c-a8e6-4cf2-b57b-e95c9f028dfc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:40.263776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:40.268861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:40.269154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:40.269434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:40.270130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:40.272788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:40.272788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:40.333269 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1645/3281] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:43:40.337897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:40.356141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c4a7d-1a21-44c9-bd5c-ca9883c9fd24 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:40.378146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:40.383363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:40.383724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:40.384285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:40.388303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:40.393978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:40.571411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:40.572308 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1637/3282] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:40 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:40.586848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce65d3-5621-4fbe-99f6-c8fed5da85e2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:40.835553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:40.837122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:40.837578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:40.838009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:40.844853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:40.850591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:41.062922 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1646/3283] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:40 2022] POST /identity/v3/users => generated 284 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:41.069041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:41.099530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4004f-7cf3-4f10-8148-2a43401ccfb2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:41.127010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:41.129244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:41.136908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:41.137457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:41.140706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:41.146060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:41.189050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1638/3284] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:41.195412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:41.214783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:41.230724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb660418-4101-46ab-9370-5888b81790a7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:41.260264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:41.262725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:41.263125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:41.267309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:41.268665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:41.275734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ee8b2-53f6-42ed-aa34-91914e6ec81f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:41.305725 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1647/3285] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:41.312207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:41.327664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab708b1f-6310-4bf1-aae5-66cbc9b82abe admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:41.336816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:41.338087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:41.338370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:41.339855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] PATH_INFO: `/v3/projects/4f41a41b02574f7f8c36bf596f67041c/users/c10bc5c63de74da499d68fa14cf33c60/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:41.371399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f41a41b02574f7f8c36bf596f67041c, user_id=c10bc5c63de74da499d68fa14cf33c60, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:41.375431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:41.529712 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1639/3286] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:41 2022] PUT /identity/v3/projects/4f41a41b02574f7f8c36bf596f67041c/users/c10bc5c63de74da499d68fa14cf33c60/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:41.542360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:41.542774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:41.543065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:41.602991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] MFA Rules not processed for user `c10bc5c63de74da499d68fa14cf33c60`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:41.607495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:41.834756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1648/3287] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:41.836055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:42.054148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa964f51-5726-4fed-9641-6867f52f7d68 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:42.078782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:42.080036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:42.080036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:42.080352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:42.081204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:42.225768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:42.342794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:42.343481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1640/3288] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:41 2022] POST /identity/v3/projects => generated 367 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:42.394679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db776-f209-486d-9c07-37172a8a9be7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:42.592077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:42.592838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:42.596294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:42.596294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:42.596294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:42.596294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:42.737189 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1649/3289] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:42 2022] POST /identity/v3/users => generated 290 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:42.742132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:42.762011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7454ef2-9c8f-47ed-b6a8-b6b9d81223c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:42.774740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:42.775920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:42.777298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:42.777425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:42.778237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:42.783420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:42.826465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1641/3290] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:42.828836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:42.849999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453d6f-99af-4444-a7e9-f8c7550bab11 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:42.866506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:42.867337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:42.872322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:42.872322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] PATH_INFO: `/v3/projects/482af972da5847af9eb811f54f342dad/users/ebaec53d276f400a85cf5d623e8d49e9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:42.918105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482af972da5847af9eb811f54f342dad, user_id=ebaec53d276f400a85cf5d623e8d49e9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:42.921304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:43.044044 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1650/3291] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:42 2022] PUT /identity/v3/projects/482af972da5847af9eb811f54f342dad/users/ebaec53d276f400a85cf5d623e8d49e9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:43.046350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:43.076088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298d52e-fb6c-49fe-aef6-5869fa82530a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:43.154771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:43.219939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:43.221180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:43.221713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:43.222230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:43.223330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:43.226351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d0853-8932-4057-b55e-9753d76ee51a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:43.244166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1642/3292] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:43.248899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:43.270545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f152b1-b4bc-4142-964d-02f3e88e7278 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:43.284743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:43.285237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:43.285960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:43.286418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] PATH_INFO: `/v3/projects/482af972da5847af9eb811f54f342dad/users/ebaec53d276f400a85cf5d623e8d49e9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:43.290418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482af972da5847af9eb811f54f342dad, user_id=ebaec53d276f400a85cf5d623e8d49e9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:43.295254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:43.327015 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1651/3293] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:43 2022] PUT /identity/v3/projects/482af972da5847af9eb811f54f342dad/users/ebaec53d276f400a85cf5d623e8d49e9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:43.341613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3449c-cc0d-4004-9d0a-2e879523bbd9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:43.342131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3449c-cc0d-4004-9d0a-2e879523bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:43.342517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3449c-cc0d-4004-9d0a-2e879523bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:43.474967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2cf3449c-cc0d-4004-9d0a-2e879523bbd9 None None] MFA Rules not processed for user `ebaec53d276f400a85cf5d623e8d49e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:43.474967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2cf3449c-cc0d-4004-9d0a-2e879523bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:43.747914 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1643/3294] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:43.765767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:43.848618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f71394b-535e-4f82-bada-d0bc82b28501 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:43.848618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:43.848618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:43.849482 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:43.850249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:44.135162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:44.135992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:44.136450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:44.178196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] MFA Rules not processed for user `6f3641a551df479f888d89f9d43bf6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:44.180165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:44.316385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1644/3295] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:44.484959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:44.491659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:44.504355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1652/3296] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:43 2022] POST /identity/v3/roles => generated 234 bytes in 746 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:44.532037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:44.543997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd77c05-3609-4dc5-9c26-2c219c1f8467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:44.560662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:44.561604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:44.562071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:44.562526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:44.563372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:44.565804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:44.636687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377fc5-5e18-450d-a5b5-d630cbcfa90f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:44.644337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:44.645260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:44.645700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:44.646156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:44.672871 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1653/3297] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:44 2022] POST /identity/v3/roles => generated 234 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:44.674243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:44.687162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40438144-1e5a-44dd-87d5-3e9f0434a70c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:44.702784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:44.708453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:44.709861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:44.716200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:44.716200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:44.716725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:44.719269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:44.723717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:44.752589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:44.762680 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1645/3298] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:43:44.907989 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1654/3299] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:44 2022] POST /identity/v3/roles => generated 235 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:44.909823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:44.949998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7bdb3-b426-43e7-b1fe-c92f15b73162 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:44.964363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:44.965300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:44.965678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:44.966783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:44.967563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:44.970963 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:44.970963 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:44.970963 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:44.975465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b29106-3556-4994-a787-f298533cbc7d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:45.141017 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1646/3300] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:43:44 2022] POST /identity/v3/domains => generated 277 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:45.141399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:45.169118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000878-e370-4267-8ed3-8b4938b0039e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:45.252193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:45.252478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:45.252789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:45.294683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:45.295957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:45.311552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:45.358367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:45.362043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:45.362273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:45.362557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:45.363230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:45.365336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:45.480562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1647/3301] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:43:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:45.486971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:45.490760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:45.610926 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1655/3302] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:45 2022] POST /identity/v3/projects => generated 400 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:45.612346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:45.661185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064afd98-e8a6-40c7-831a-0d39ac858122 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.057103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.057103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.057103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.057103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:46.058319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96314be-ff52-4aa8-a785-a8e8e094f80d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.058319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.058319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:46.061977 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:46.062525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:46.062828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:46.062828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:46.062828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1648/3303] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:43:46.063153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1656/3304] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:45 2022] POST /identity/v3/groups => generated 300 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:46.063445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:46.063445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f2579b-0b6c-44b2-9be5-1c00b8d09fd3 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.088340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.089727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.090106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.090613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:46.091431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:46.095404 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:46.095404 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:46.095404 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:46.097427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:46.406512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:46.430335 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1649/3305] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:46 2022] POST /identity/v3/roles => generated 235 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:46.434817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:46.461523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46d752-1ee4-4e20-ba95-04f026453368 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.480125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.486466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.492747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.492747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:46.492747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:46.492747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:46.628392 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1657/3306] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:46 2022] POST /identity/v3/users => generated 439 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:46.632344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:46.658470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3982-c6e2-46ed-a141-434ad78982e2 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.709813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.710474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.710757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.711028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:46.715630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:46.718955 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:46.718955 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:46.718955 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:46.720620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:46.911171 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1650/3307] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:46 2022] POST /identity/v3/roles => generated 269 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:46.915525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:46.966248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c8416-200b-4581-a102-76131697d2cb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:46.987778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:46.989425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:46.996235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:46.996235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/329c9ac29ff546aca180a3a48314a8f3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:47.023538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=329c9ac29ff546aca180a3a48314a8f3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:47.036146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:47.158680 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1658/3308] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:46 2022] PUT /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/329c9ac29ff546aca180a3a48314a8f3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:47.162925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:47.196916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a284-dbde-43bc-b948-31bd0565c467 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:47.344642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:47.345427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:47.355031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:47.355031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:47.355031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Adding query filter params (scope.project.id=4904caa5e9c644449eba3037b5ba4c23, user.id=116dfccf4fa741e8a0ce75ef4f65f4a2) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:47.355031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:47.355487 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:47.355487 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:47.355487 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:47.355487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:47.458216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1651/3309] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:43:47 2022] GET /identity/v3/role_assignments?scope.project.id=4904caa5e9c644449eba3037b5ba4c23&user.id=116dfccf4fa741e8a0ce75ef4f65f4a2&effective => generated 228 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:47.461265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:47.485433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d4bfa-d752-4bae-9833-51de627f4be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:47.508819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:47.511074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:47.512708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:47.513220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/329c9ac29ff546aca180a3a48314a8f3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:47.518454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=329c9ac29ff546aca180a3a48314a8f3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:47.522326 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:47.522326 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:47.522326 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:47.525235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:47.551190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 329c9ac29ff546aca180a3a48314a8f3 was removed from user 116dfccf4fa741e8a0ce75ef4f65f4a2 on project 4904caa5e9c644449eba3037b5ba4c23. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:47.552222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:47.554392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:47.683115 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1659/3310] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:43:47 2022] DELETE /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/329c9ac29ff546aca180a3a48314a8f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:47.687315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:47.689945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:47.705366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d158c-1a13-40e9-ab66-c7cea554f177 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:47.805441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:47.806116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:47.806398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:47.806673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/329c9ac29ff546aca180a3a48314a8f3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:47.812307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=329c9ac29ff546aca180a3a48314a8f3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:47.814699 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:47.814699 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:47.814699 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:47.817204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:47.917406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:47.917406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:47.935276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:47.985294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 329c9ac29ff546aca180a3a48314a8f3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:47.985884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:47.986800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:47.989639 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1652/3311] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:47 2022] DELETE /identity/v3/roles/329c9ac29ff546aca180a3a48314a8f3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:48.009703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:48.012752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:48.089598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0aca53-d97c-4898-915e-8e34239092a7 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:48.153568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b38a6-3df4-419c-b0b9-e1ad73dfa17d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:48.169639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:48.170333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:48.170614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:48.172520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/8e930feab4f1418f841cbc039adfbd70` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:48.179354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=8e930feab4f1418f841cbc039adfbd70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:48.184946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:48.248781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:48.250464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:48.250910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:48.251315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:48.254161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:48.254602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:48.317706 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1653/3312] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:48 2022] PUT /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/8e930feab4f1418f841cbc039adfbd70 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:48.321664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:48.394443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:48.398140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:48.443045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1660/3313] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:48.471278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be4134-584d-4648-8eaf-58c476277eb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:48.487833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:48.490344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:48.491171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:48.491459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:48.497883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:48.500098 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:48.500098 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:48.500098 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:48.503626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f55ad5-1f93-4da1-894a-dabcc1e0379e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:48.720028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1654/3314] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:43:48 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 519 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:48.722445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:48.745051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428c37-36d5-4387-a5cb-3fba76b9ab41 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:48.819698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:48.820053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:48.820230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:48.890827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:48.895664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:48.939511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:48.940137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:48.940670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:48.941123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:48.942081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Adding query filter params (scope.project.id=4904caa5e9c644449eba3037b5ba4c23, user.id=116dfccf4fa741e8a0ce75ef4f65f4a2) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:48.942577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:48.943802 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:48.943802 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:48.943802 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:48.945351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.036874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1661/3315] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:43:48 2022] GET /identity/v3/role_assignments?scope.project.id=4904caa5e9c644449eba3037b5ba4c23&user.id=116dfccf4fa741e8a0ce75ef4f65f4a2&effective => generated 1061 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:49.038895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.056287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00650371-4471-4217-9dcf-2826af3a087b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.060278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1655/3316] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:43:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:49.082400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.083000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:49.087877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.089070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.089512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.089964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.099745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:49.102821 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:49.102821 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:49.102821 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:49.107750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.233828 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1662/3317] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:43:49 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:49.236178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229b9e8-0553-4631-a983-ba5b461f5b9d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.238345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.406820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f214a0-0166-4cad-918a-a29bb94123cd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.408262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.408918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.409193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.409460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.417487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.420341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.420638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.420918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.421848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Adding query filter params (scope.project.id=4904caa5e9c644449eba3037b5ba4c23, user.id=116dfccf4fa741e8a0ce75ef4f65f4a2) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:49.422248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:49.435816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41446d64-0b00-4e4c-bd78-cc4d3f506c12 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.519238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:49.522631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.541780 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1663/3319] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:43:49 2022] GET /identity/v3/role_assignments?scope.project.id=4904caa5e9c644449eba3037b5ba4c23&user.id=116dfccf4fa741e8a0ce75ef4f65f4a2&effective => generated 577 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:43:49.543244 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1656/3319] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:43:49.545571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.545925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.546383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.547486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.575753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] MFA Rules not processed for user `6f3641a551df479f888d89f9d43bf6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:49.577055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:49.579727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f3d6-fb11-43e4-b832-93f88d9d2496 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.593850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.594571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.594870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.595138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.600181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:49.601256 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:49.601256 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:49.601256 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:49.602235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0.: keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = query.one() Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._iter().one() Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._only_one_row( Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exc.NoResultFound( Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:49.621122 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Nov 02 12:43:49.623198 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1657/3320] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:43:49 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 137 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:43:49.627092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.639170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ed326-3d67-4447-865d-a8ce99ed1eec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.650176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.651656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.651786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.652108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/8e930feab4f1418f841cbc039adfbd70` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:49.654566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=8e930feab4f1418f841cbc039adfbd70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:49.658732 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:49.658732 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:49.658732 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:49.661809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:49.675444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 8e930feab4f1418f841cbc039adfbd70 was removed from user 116dfccf4fa741e8a0ce75ef4f65f4a2 on project 4904caa5e9c644449eba3037b5ba4c23. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:49.675444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:49.675444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:49.694261 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1664/3321] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:49.845317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1658/3322] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:43:49 2022] DELETE /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/8e930feab4f1418f841cbc039adfbd70 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:49.862383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:49.868962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:49.911635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad5d25-3050-411a-8b22-cb87940f230a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:49.997553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:49.998268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:49.998755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:49.999731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.001099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:50.002986 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:50.002986 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:50.002986 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:50.004248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:50.118154 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1665/3323] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:49 2022] POST /identity/v3/roles => generated 272 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:50.122785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.139587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a87ef-62b2-46bd-bd0b-110353acc693 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:50.152622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:50.153335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.153528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.153811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.155484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Adding query filter params (domain_id=94fde93b8ae846478a2921644e5639e7) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:50.155814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:50.159993 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:50.159993 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:50.159993 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:50.163297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:50.185266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1659/3324] 10.222.0.64 () {58 vars in 1207 bytes} [Wed Nov 2 12:43:50 2022] GET /identity/v3/roles?domain_id=94fde93b8ae846478a2921644e5639e7 => generated 409 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:50.189509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.242595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffb3cf-6efc-4f47-8fcf-1f48df1af400 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:50.259406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:50.261113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.261802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.262333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/bb3c5781be7a4b819dbcf15b93c59954` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.263671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bb3c5781be7a4b819dbcf15b93c59954)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:50.265268 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:50.265268 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:50.265268 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:50.269932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:50.335441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:50.391639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role bb3c5781be7a4b819dbcf15b93c59954 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:50.394979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:50.396043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:50.403289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1666/3325] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:50 2022] DELETE /identity/v3/roles/bb3c5781be7a4b819dbcf15b93c59954 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:50.405201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.407537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:50.433796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7504c-1f4d-4e43-9eb4-51e0b955c289 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:50.562957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:50.562957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.562957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.564313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.566772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Adding query filter params (domain_id=94fde93b8ae846478a2921644e5639e7) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:50.567337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:50.569644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:50.586278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.610365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1660/3326] 10.222.0.64 () {58 vars in 1207 bytes} [Wed Nov 2 12:43:50 2022] GET /identity/v3/roles?domain_id=94fde93b8ae846478a2921644e5639e7 => generated 148 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:50.613947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbea4-2abc-4bfd-a43f-4ebd909f6008 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:50.630105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:50.630784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.631064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.631339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/bb3c5781be7a4b819dbcf15b93c59954` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.653389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-22533f24-be87-49ec-ab63-0ec38e53deed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Could not find role: bb3c5781be7a4b819dbcf15b93c59954.: keystone.exception.RoleNotFound: Could not find role: bb3c5781be7a4b819dbcf15b93c59954. Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Nov 02 12:43:50.658768 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:43:50.668943 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bb3c5781be7a4b819dbcf15b93c59954. Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:50.670434 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1667/3327] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:50 2022] DELETE /identity/v3/roles/bb3c5781be7a4b819dbcf15b93c59954 => generated 110 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:43:50.671169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.689366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f488ea-f2a4-4b0a-8a98-f49444881fa6 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:50.696114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:50.697061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.697629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.698971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.708119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=94fde93b8ae846478a2921644e5639e7, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:50.711619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:50.825791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:50.826067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:50.826347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:50.833270 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:50.834056 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:50.860363 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1668/3328] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:43:50.878858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1661/3329] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:50 2022] PUT /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:50.881723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:50.939638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:51.024064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.053628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.056810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.058442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.058726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.060912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=94fde93b8ae846478a2921644e5639e7, group_id=2852fc90d8f74060ae811ab4ddf84e48)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.062553 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:51.062553 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:51.062553 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:51.063999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.065485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.067979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:51.088293 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1669/3330] 10.222.0.64 () {58 vars in 1365 bytes} [Wed Nov 2 12:43:50 2022] GET /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles => generated 410 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:51.092588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.105800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e90b00-2df8-420b-94d3-c16d99b3fb50 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.111651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.112442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.112756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.113192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.115755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=94fde93b8ae846478a2921644e5639e7, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.118953 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:51.118953 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:51.118953 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:51.120347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.138564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1670/3331] 10.222.0.64 () {58 vars in 1465 bytes} [Wed Nov 2 12:43:51 2022] HEAD /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:51.142959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.167115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e87e8-83ca-4a10-9acc-bb01e00fd4c4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.187877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.189108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.189593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.190062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.193340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=94fde93b8ae846478a2921644e5639e7, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.198042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.203005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8812c6-194f-4b79-a9cc-1de0b461f305 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.217349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role a7172b6ff6b34672b345d8e00ad9ccab was removed from group 2852fc90d8f74060ae811ab4ddf84e48 on domain 94fde93b8ae846478a2921644e5639e7. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:51.217646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.218577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.222601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.223473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.224195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.224744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] PATH_INFO: `/v3/users/0f42c89a160549009239a40de8d5daa9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.228186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f42c89a160549009239a40de8d5daa9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.232003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.336797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1671/3332] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:43:51 2022] DELETE /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:51.346912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.355213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:51.515085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc843757-393b-4a87-b0ed-5009574aeab8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.534257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.534977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.535262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.535539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.545672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f42c89a160549009239a40de8d5daa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.554253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.567738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a65063-9d08-4998-acd5-f8952d2551ca tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.660438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f42c89a160549009239a40de8d5daa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.691617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f42c89a160549009239a40de8d5daa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.721727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f42c89a160549009239a40de8d5daa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.724041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f42c89a160549009239a40de8d5daa9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:51.727577 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1672/3333] 10.222.0.64 () {60 vars in 1486 bytes} [Wed Nov 2 12:43:51 2022] PUT /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:51.727577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.727577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.727577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.743852 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1662/3334] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:51 2022] DELETE /identity/v3/users/0f42c89a160549009239a40de8d5daa9 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:51.746250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.747967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:51.778012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:51.779806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:51.872428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:51.911759 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1673/3335] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:43:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:51.934024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.943685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:51.949027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ad5eb-c51c-47a5-8ace-593b464e09ac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:51.962128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:51.962128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:51.962128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:51.962485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:51.962485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_grants(project_id=4904caa5e9c644449eba3037b5ba4c23, group_id=2852fc90d8f74060ae811ab4ddf84e48)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:51.962485 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:51.962485 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:51.962485 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:51.962785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:51.982280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1663/3336] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:43:51 2022] GET /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles => generated 411 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:51.983431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:51.995910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed8191-2457-4f9e-8a43-999d8a8b1be3 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:52.003486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:52.004218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.005168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.005489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/groups/2852fc90d8f74060ae811ab4ddf84e48/users/116dfccf4fa741e8a0ce75ef4f65f4a2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.008064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2852fc90d8f74060ae811ab4ddf84e48, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:52.009324 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:52.009324 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:52.009324 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:52.010683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70feedc8-bbd8-44d0-91cd-2a7a8a5c9f42 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:52.086675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf908d-16a7-4d1a-b812-6a79e0891cea None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:52.110707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:52.118402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.120958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.120958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.149556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:52.151887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1664/3337] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:43:51 2022] PUT /identity/v3/groups/2852fc90d8f74060ae811ab4ddf84e48/users/116dfccf4fa741e8a0ce75ef4f65f4a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:52.159004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:52.159313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.159597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.159879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.176466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1674/3338] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:52.216447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] MFA Rules not processed for user `116dfccf4fa741e8a0ce75ef4f65f4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:52.217901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:52.364228 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1665/3339] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:52.375444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:52.375629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:52.375629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:52.383882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44aad-9a53-4894-9ddf-495952c94b01 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:52.476559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:52.477526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.478762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.479080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.481588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:52.484684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:52.492119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1675/3340] 10.222.0.64 () {58 vars in 1468 bytes} [Wed Nov 2 12:43:52 2022] HEAD /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:52.498415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:52.511907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a0601-56d5-47c2-a945-9c02369efe9a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:52.514091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70475d57-229a-4501-8c64-3ae8edc81bf5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:52.540457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:52.541214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.541548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.541820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] PATH_INFO: `/v3/projects/9dae73b687df4626a377fcf4030f78a0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.543121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:52.543890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:52.544159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:52.544431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:52.545782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dae73b687df4626a377fcf4030f78a0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:52.547977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:52.553252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:52.556231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:52.570361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role a7172b6ff6b34672b345d8e00ad9ccab was removed from group 2852fc90d8f74060ae811ab4ddf84e48 on project 4904caa5e9c644449eba3037b5ba4c23. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:52.571081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:52.573479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:52.680078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1676/3341] 10.222.0.64 () {58 vars in 1470 bytes} [Wed Nov 2 12:43:52 2022] DELETE /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:52.684451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:52.685935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:52.827372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dae73b687df4626a377fcf4030f78a0', 'request_id': 'req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:52.858573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dae73b687df4626a377fcf4030f78a0', 'request_id': 'req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:52.907400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dae73b687df4626a377fcf4030f78a0', 'request_id': 'req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:52.928885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8160c8f2-a54a-4b95-83f7-bc13d3db2797 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.002928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] The token cache is being invalidate because project 9dae73b687df4626a377fcf4030f78a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:53.003489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:53.003967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b254cb8f-a5dd-4cbd-8d87-64c225b4bd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:53.018741 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1666/3342] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:52 2022] DELETE /identity/v3/projects/9dae73b687df4626a377fcf4030f78a0 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:53.021234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57815d-fe0a-4906-bfb7-e117c8273716 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.021447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57815d-fe0a-4906-bfb7-e117c8273716 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.021693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57815d-fe0a-4906-bfb7-e117c8273716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.027080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.028166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.029817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.030283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/groups/2852fc90d8f74060ae811ab4ddf84e48/users/116dfccf4fa741e8a0ce75ef4f65f4a2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.034254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2852fc90d8f74060ae811ab4ddf84e48, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.035610 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:53.035610 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:53.035610 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:53.037460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.066160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3b57815d-fe0a-4906-bfb7-e117c8273716 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:53.070982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3b57815d-fe0a-4906-bfb7-e117c8273716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:53.130664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c04e90cf-228c-4e65-8d1f-f357f53a9feb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:53.161027 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1667/3343] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:53.173342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.173628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.173904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.196670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:53.197935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:53.208995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1668/3344] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:53.217153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.224569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1677/3345] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:43:52 2022] DELETE /identity/v3/groups/2852fc90d8f74060ae811ab4ddf84e48/users/116dfccf4fa741e8a0ce75ef4f65f4a2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:53.232262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.232666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.233014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.259419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] MFA Rules not processed for user `d3f905a0f01e4ad191eb456ea9aec7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:53.260948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:53.262016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13eb1d-7c10-49e6-b885-0ceef39a5ad3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.373693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:53.377846 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1678/3346] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:53.379091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.380809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:53.401435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.403895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.404375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.404746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.406153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:43:53.406153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.408926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.424055 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1669/3347] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:53.429819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.473098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af44ea-9e51-477c-94b1-921b9351fa89 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.492262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fabfe8-c646-4ff0-8a4c-e44e270258a1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.494738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.498171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.498422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.498896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.499058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.499368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.499544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.499785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.502018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.503154 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:53.503154 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:53.503154 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:53.504110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.504274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.520967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.539915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:53.632258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1679/3348] 10.222.0.64 () {60 vars in 1381 bytes} [Wed Nov 2 12:43:53 2022] PUT /identity/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:53.637024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.649324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd4baf-010b-45d7-9465-0c30a816861e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.658724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.659576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.659860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.660142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.661643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=2852fc90d8f74060ae811ab4ddf84e48)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.663085 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:53.663085 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:53.663085 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:53.663716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.691682 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1670/3349] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:43:53 2022] POST /identity/v3/projects => generated 395 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:53.691682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.692963 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1680/3350] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:43:53 2022] GET /identity/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles => generated 376 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:53.693909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.698721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:53.778351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4dca3-d2d3-4bc2-9cc1-737c0e159351 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.783275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.783941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.784204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.784481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.786314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.787295 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:53.787295 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:53.787295 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:53.788127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.795579 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1671/3351] 10.222.0.64 () {58 vars in 1363 bytes} [Wed Nov 2 12:43:53 2022] HEAD /identity/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:53.796404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:53.830147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af951a-b18e-4e4d-8412-8fb09fa08e6e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.887263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe5fe2-49a4-4e79-985e-96aed8448fc5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:53.892608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.893483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.893757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.894031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.894698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:53.896715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:53.949367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:53.950003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:53.950276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:53.950546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:53.952892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:54.036939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.038859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.052534 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1681/3352] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:54.053732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.068898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1672/3353] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:43:53 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:54.070938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.076082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bec8e-1b27-4b65-8460-a00dd2ee9fd5 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.081692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.082392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.082745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.083308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.086091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=2852fc90d8f74060ae811ab4ddf84e48, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.087882 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:54.087882 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:54.087882 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:54.093529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.098049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aea7b8-876c-4274-b34b-4ad272863d19 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.107512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.108435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.109589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.109867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.111779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.112899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.134952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1673/3354] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:54 2022] GET /identity/v3/roles => generated 2322 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:54.136010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.148048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1eb68-0757-4598-a9d5-c0c383ac47f6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.154462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.155551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.155551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.155830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.156690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.158839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.180675 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1674/3355] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:43:54 2022] GET /identity/v3/roles => generated 2322 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:43:54.181709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.193948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5524620-17bc-4db2-83ad-8c91264b215a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.199838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.200661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.201149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.204333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] PATH_INFO: `/v3/projects/12c9018d300642ea8827af97192c4104/users/4893fb8aad454ab29cff4cc79cdfbfbc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.223900 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1682/3356] 10.222.0.64 () {58 vars in 1365 bytes} [Wed Nov 2 12:43:54 2022] DELETE /identity/v3/system/groups/2852fc90d8f74060ae811ab4ddf84e48/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:54.225752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c9018d300642ea8827af97192c4104, user_id=4893fb8aad454ab29cff4cc79cdfbfbc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.229617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fba3d-6bde-4c2c-a7d7-5e80aa59c936 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.231506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.244081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dd730-cdd5-498f-9d39-d337ab734d1e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.250441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.251232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.251536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.251793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.254266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=94fde93b8ae846478a2921644e5639e7, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.257493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f6031-e234-4860-98e2-ce8797facad5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.327947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:54.336280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1675/3357] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:54 2022] PUT /identity/v3/projects/12c9018d300642ea8827af97192c4104/users/4893fb8aad454ab29cff4cc79cdfbfbc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:54.343347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.343946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.345045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.367359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:54.369423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:54.418101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1683/3358] 10.222.0.64 () {60 vars in 1480 bytes} [Wed Nov 2 12:43:54 2022] PUT /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:54.419932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.420283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.421291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:54.429021 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:43:54.429867 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:54.430629 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1684/3359] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:43:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:43:54.430964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.461411 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1676/3360] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:43:54.480666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.482123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:54.581309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92541400-9478-4761-8afc-a887b8e3ec54 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.610281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1198aa3-1625-43f0-a28e-62690b845ed6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.619130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.620603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.620889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.621249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.623491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=94fde93b8ae846478a2921644e5639e7, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.626208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.643263 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1685/3361] 10.222.0.64 () {58 vars in 1362 bytes} [Wed Nov 2 12:43:54 2022] GET /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles => generated 409 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:54.646804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.658741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba458f7-d360-448f-9b55-588edb147b33 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.661380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.662004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.662290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.662663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.664519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.665221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.665489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.665767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.668200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=94fde93b8ae846478a2921644e5639e7, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.671779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.679702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1686/3362] 10.222.0.64 () {58 vars in 1462 bytes} [Wed Nov 2 12:43:54 2022] HEAD /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:43:54.693180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.706271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6c7a-3466-48df-81d6-dfa89ec01600 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:54.721309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:54.722041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:54.722614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:54.722924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:54.729017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=94fde93b8ae846478a2921644e5639e7, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.731698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.747366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role a7172b6ff6b34672b345d8e00ad9ccab was removed from user 116dfccf4fa741e8a0ce75ef4f65f4a2 on domain 94fde93b8ae846478a2921644e5639e7. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:54.747879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:54.750128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:54.782364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:54.783314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:54.794690 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1677/3363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:43:54.905674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1687/3364] 10.222.0.64 () {58 vars in 1464 bytes} [Wed Nov 2 12:43:54 2022] DELETE /identity/v3/domains/94fde93b8ae846478a2921644e5639e7/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:54.911538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:54.926169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de248b8f-8837-4055-8deb-ce258c886847 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.020649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.021442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.021788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.022186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.025305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.029922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.140375 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1678/3365] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:43:54 2022] PUT /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:55.141710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.143207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:55.159382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa1a33-119c-4317-b17d-304c64ada46a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.234302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.235326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.235838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.236346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.238664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_grants(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.242095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.267718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.275177 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1688/3366] 10.222.0.64 () {58 vars in 1365 bytes} [Wed Nov 2 12:43:55 2022] GET /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles => generated 410 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:55.279621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea2bd9-a522-4dc9-8e3c-fca55452ac3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.286757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.287585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.289755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.289755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.290982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.292275 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:55.292275 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:55.292275 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:55.294815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.309417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.309995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1679/3367] 10.222.0.64 () {58 vars in 1465 bytes} [Wed Nov 2 12:43:55 2022] HEAD /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:55.322344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70cfe1-236c-47a3-acd8-f157c0514402 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.333256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.334092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.334474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.334859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.338313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4904caa5e9c644449eba3037b5ba4c23, user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.341794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.348241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role a7172b6ff6b34672b345d8e00ad9ccab was removed from user 116dfccf4fa741e8a0ce75ef4f65f4a2 on project 4904caa5e9c644449eba3037b5ba4c23. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:55.348746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:55.349928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:55.447886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1689/3368] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:43:55 2022] DELETE /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:55.454475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.462122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:55.490395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302cf00a-14e8-486e-9665-584bd9017a78 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.619614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.622326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.623163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.623647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.629184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.631843 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:55.631843 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:55.631843 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:55.634013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.785951 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1680/3369] 10.222.0.64 () {60 vars in 1378 bytes} [Wed Nov 2 12:43:55 2022] PUT /identity/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:55.792248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.815383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc479495-e394-4a74-9ace-b031d9f66c6d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.830668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.831586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.833933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.840732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.840732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.844434 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:55.844434 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:55.844434 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:55.845612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.886979 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1690/3370] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:43:55 2022] GET /identity/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles => generated 375 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:55.891216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.911658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b10e0-b5b6-43bd-9382-86f6eb83d252 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.917265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.917937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.918223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.918500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.926455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.927569 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:55.927569 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:55.927569 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:55.928509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:55.943097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1681/3371] 10.222.0.64 () {58 vars in 1360 bytes} [Wed Nov 2 12:43:55 2022] HEAD /identity/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:55.949886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:55.963698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb23825-e4d9-4e62-a606-08bbb273b004 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:55.980593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:55.981480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:55.981814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:55.982095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:55.985335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=116dfccf4fa741e8a0ce75ef4f65f4a2, role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:55.986933 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:55.986933 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:55.986933 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:55.987851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:56.060200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:56.091646 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1691/3372] 10.222.0.64 () {58 vars in 1362 bytes} [Wed Nov 2 12:43:55 2022] DELETE /identity/v3/system/users/116dfccf4fa741e8a0ce75ef4f65f4a2/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:56.096902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:56.118449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5f03b-3ff2-4297-a897-ad1c2922f929 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:56.124636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:56.125228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:56.125529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:56.126938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:56.127689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:56.129549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:56.225358 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1682/3373] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:56 2022] POST /identity/v3/roles => generated 269 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:56.229813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:56.241859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a719-d66d-4493-a524-b910a947d824 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:56.266636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:56.267935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:56.268697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:56.269321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:56.271179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:56.273429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:56.351279 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1692/3374] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:56 2022] POST /identity/v3/roles => generated 269 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:56.356281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:56.372905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4d6e1-b9dc-4d67-be83-0b996c81c34e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:56.385218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:56.387657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:56.388175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:56.388695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/d72042f60e7d47d88b58910ff21d9320` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:56.391240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=d72042f60e7d47d88b58910ff21d9320)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:56.393588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:56.438469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:56.618672 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1683/3375] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:43:56 2022] PUT /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/d72042f60e7d47d88b58910ff21d9320 => generated 529 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:56.621279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:56.642493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5eb12e-3270-46db-8f1f-9f12eaca1d3a tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:56.734668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:56.735464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:56.744002 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:56.744602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:56.853108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1693/3376] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:43:56 2022] POST /identity/v3/domains => generated 276 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:56.857369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:56.893038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee37773-1870-4006-ba80-f5fdf7c3cef5 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:57.007280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:57.008163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:57.011100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:57.011432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:57.012186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:57.014317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:57.136557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1684/3377] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:43:56 2022] POST /identity/v3/roles => generated 270 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:57.140895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:57.159567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a18d-e90f-4296-be8f-e9809b19c78e tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:57.167189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:57.167945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:57.168404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:57.168669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/6e58195254d44838a05642fca66e81f3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:57.171267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=6e58195254d44838a05642fca66e81f3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:57.172637 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:57.172637 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:43:57.172637 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:43:57.173839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:57.310668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1694/3378] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:43:57 2022] PUT /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/6e58195254d44838a05642fca66e81f3 => generated 530 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:43:57.320841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:57.333654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4a38ed-0cdd-4eae-90a5-3ed3450f88e0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:57.502570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:57.502570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:57.502902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:57.503512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:57.507143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:57.516521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0be33-243d-4885-97fb-7a5e5713f145 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:57.722144 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1685/3379] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:43:57 2022] PUT /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 525 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:43:57.725002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:57.740429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:57.740882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:57.741196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:57.743210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c28ac-76f0-4fcd-8b65-eb8a43ab1f0c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:57.825831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:43:57.828139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:57.955898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:57.965287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:57.965787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:57.966208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/a7172b6ff6b34672b345d8e00ad9ccab/implies/58deaa31bdc74d4da1f371b1df1adc6b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:57.970717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a7172b6ff6b34672b345d8e00ad9ccab, implied_role_id=58deaa31bdc74d4da1f371b1df1adc6b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:57.979952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:58.045307 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1686/3380] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:43:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] 58deaa31bdc74d4da1f371b1df1adc6b cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 58deaa31bdc74d4da1f371b1df1adc6b cannot be an implied roles. Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Nov 02 12:43:58.060319 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 58deaa31bdc74d4da1f371b1df1adc6b cannot be an implied roles. Nov 02 12:43:58.061389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:43:58.064193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:58.065870 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1695/3381] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:43:57 2022] PUT /identity/v3/roles/a7172b6ff6b34672b345d8e00ad9ccab/implies/58deaa31bdc74d4da1f371b1df1adc6b => generated 116 bytes in 342 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:43:58.067220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:58.071690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:58.082222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275d5ae-fc25-4132-b6e6-54a56acf2498 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:58.093283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:58.094326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:58.095002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:58.096558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:58.104203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:58.108100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:58.163029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:58.205983 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1696/3382] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:43:58 2022] DELETE /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:58.206862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:58.278247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc586acc-343c-41af-bda0-0e90a1786654 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:58.423035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865925d-454f-47df-8b35-8292ca7e61a1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:58.433560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:58.434848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:58.435301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:58.435732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/6e58195254d44838a05642fca66e81f3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:58.439245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=6e58195254d44838a05642fca66e81f3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:58.441658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:58.476889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:58.477533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:58.478007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:58.478424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:58.513510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:58.572328 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1697/3383] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:43:58 2022] DELETE /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/6e58195254d44838a05642fca66e81f3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:58.574178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:58.657885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:58.663749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:58.724452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1687/3384] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:43:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:58.801741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679ad86-5ff6-4242-a249-7a75feb7ad86 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:58.816107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:58.818535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:58.818925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:58.819207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/6e58195254d44838a05642fca66e81f3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:58.822168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=6e58195254d44838a05642fca66e81f3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:58.827349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:59.076303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 6e58195254d44838a05642fca66e81f3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:43:59.076303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.076303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.086022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:59.086881 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1698/3385] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:58 2022] DELETE /identity/v3/roles/6e58195254d44838a05642fca66e81f3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:43:59.111218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a15d33-be18-4afb-97cd-1f2d2cb8fa89 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:59.250854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:59.252653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:59.253064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:59.253481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.273668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a6ebc92edc904554b4f9dcc82c81d5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:59.275324 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:59.275324 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:59.275324 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:59.278398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:59.316703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.318018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.328119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:59.330110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:59.513960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c4abc-4e90-4b56-9fd6-f3b3af4a0616 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:59.544975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.552685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.570950 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1688/3386] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:43:59 2022] PATCH /identity/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2 => generated 277 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:43:59.572315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:43:59.576856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:43:59.691128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:59.691692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:59.691975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:59.692248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] PATH_INFO: `/v3/users/346db825477f4cfca59dfa9ac8ab0455` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.693627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=346db825477f4cfca59dfa9ac8ab0455)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:59.695627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:59.713442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470aa74-19ab-4fb0-acff-16dffe1f24e4 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:43:59.724146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:43:59.727069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:43:59.727503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:43:59.727925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:43:59.746215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a6ebc92edc904554b4f9dcc82c81d5d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:43:59.747783 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:43:59.747783 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:43:59.747783 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:43:59.749062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:43:59.790476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:43:59.798582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.177606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346db825477f4cfca59dfa9ac8ab0455'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.181032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.228307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.259575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.371707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346db825477f4cfca59dfa9ac8ab0455'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.401211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346db825477f4cfca59dfa9ac8ab0455'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.402969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346db825477f4cfca59dfa9ac8ab0455'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.404033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-219fa486-8f5e-4e00-ba51-b641b312eecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346db825477f4cfca59dfa9ac8ab0455'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.430552 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1699/3387] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:43:59 2022] DELETE /identity/v3/users/346db825477f4cfca59dfa9ac8ab0455 => generated 0 bytes in 1103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:00.437858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:00.438239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:00.438569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:00.463948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:00.465616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:00.572881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] The token cache is being invalidate because project a6ebc92edc904554b4f9dcc82c81d5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:00.573886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.575871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.619519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.621202 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1700/3388] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:00.641356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.644119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a6ebc92edc904554b4f9dcc82c81d5d2', 'request_id': 'req-df1bc2da-9c07-4499-ba3b-9678e57c8b44'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:00.664084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:00.665840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:00.667213 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1689/3389] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:43:59 2022] DELETE /identity/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2 => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:00.674709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:00.680737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:00.825881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d8e4e-7d77-4501-b780-2d3de41c179a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:00.833222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:00.833826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:00.834110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:00.834387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:00.844335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:00.875744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:00.879138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:00.914706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1701/3390] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:00.942883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1bc2da-9c07-4499-ba3b-9678e57c8b44 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:01.069226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:01.069903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:01.070188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:01.070467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/d72042f60e7d47d88b58910ff21d9320` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:01.073493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=58deaa31bdc74d4da1f371b1df1adc6b, implied_role_id=d72042f60e7d47d88b58910ff21d9320)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:01.075997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:01.109967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:01.138810 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1690/3391] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:00 2022] DELETE /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b/implies/d72042f60e7d47d88b58910ff21d9320 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:01.142745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:01.160898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11731e-f9d8-4d94-9462-738dab5bfa72 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:01.280901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:01.283020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:01.283529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:01.284154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/d72042f60e7d47d88b58910ff21d9320` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:01.287801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=d72042f60e7d47d88b58910ff21d9320)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:01.290970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:01.386097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:01.531847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role d72042f60e7d47d88b58910ff21d9320 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:01.532270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:01.535895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:01.542124 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1702/3392] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:01 2022] DELETE /identity/v3/roles/d72042f60e7d47d88b58910ff21d9320 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:01.547248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:01.549140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:01.577718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2e727-a7f4-4ea7-86c3-fef0945c438c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:01.759839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:01.767955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:01.768731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:01.768987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:01.773865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=58deaa31bdc74d4da1f371b1df1adc6b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:01.777771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.232313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 58deaa31bdc74d4da1f371b1df1adc6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:02.232810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:02.233633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:02.236038 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1691/3393] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:01 2022] DELETE /identity/v3/roles/58deaa31bdc74d4da1f371b1df1adc6b => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:02.242549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:02.258047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5f879-46fa-495d-bc9b-d1fa6e4b2eea tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:02.297817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:02.299504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.389387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:02.390485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.390874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.391227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.394075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:02.396234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.432897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410af1c-b2ef-434b-b6b2-474a53e1d669 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:02.441842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:02.442606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.442890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.443167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] PATH_INFO: `/v3/users/6f3641a551df479f888d89f9d43bf6a7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.444760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f3641a551df479f888d89f9d43bf6a7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:02.449262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.681256 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1703/3394] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:02 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 519 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:02.685779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:02.690457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.784896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9c176-c684-4182-aea6-49d4f2d13a02 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:02.793763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:02.794469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:02.794759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:02.795040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:02.797093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:02.799742 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:02.799742 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:02.799742 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:02.800970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.802735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:02.803885 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:02.803885 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:02.803885 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:02.805058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:02.839024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1704/3395] 10.222.0.64 () {58 vars in 1345 bytes} [Wed Nov 2 12:44:02 2022] HEAD /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:02.841369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:02.845717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f3641a551df479f888d89f9d43bf6a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:02.849137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:02.995587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f33ceb-ed40-430a-b3d3-ab4258c07dac tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:03.001230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:03.003423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.003904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.004611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] PATH_INFO: `/v3/projects/7a9a8c1c922b4a9eae99d190d10ba85e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.006183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9a8c1c922b4a9eae99d190d10ba85e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:03.009512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:03.017295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f3641a551df479f888d89f9d43bf6a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.038408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f3641a551df479f888d89f9d43bf6a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.068276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f3641a551df479f888d89f9d43bf6a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.069498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f3641a551df479f888d89f9d43bf6a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.089805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1692/3396] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:02 2022] DELETE /identity/v3/users/6f3641a551df479f888d89f9d43bf6a7 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:03.089805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:03.092796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:03.218296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2681c-633d-4f22-9414-88b8e892e4ab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:03.253853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9a8c1c922b4a9eae99d190d10ba85e', 'request_id': 'req-e51bb359-fc0a-427a-94d9-27db361cff4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.268066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9a8c1c922b4a9eae99d190d10ba85e', 'request_id': 'req-e51bb359-fc0a-427a-94d9-27db361cff4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.423161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:03.424058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.424450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.424925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.431295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9a8c1c922b4a9eae99d190d10ba85e', 'request_id': 'req-e51bb359-fc0a-427a-94d9-27db361cff4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.439059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:03.440339 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:03.440339 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:03.440339 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:03.445905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:03.454927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] The token cache is being invalidate because project 7a9a8c1c922b4a9eae99d190d10ba85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:03.454927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.461957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e51bb359-fc0a-427a-94d9-27db361cff4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.467139 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1705/3397] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:02 2022] DELETE /identity/v3/projects/7a9a8c1c922b4a9eae99d190d10ba85e => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:03.475829 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1693/3398] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:44:03 2022] GET /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 519 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:03.480172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e27b-4310-4375-9c35-aadd6428eec8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.480587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e27b-4310-4375-9c35-aadd6428eec8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.482135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79e27b-4310-4375-9c35-aadd6428eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.483091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:03.489278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:03.516921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69060e-d051-4050-9c33-57963a64a79f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:03.529826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:03.529826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.529826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.530398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.536042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:03.537898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:03.554316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6a79e27b-4310-4375-9c35-aadd6428eec8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:03.558555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a79e27b-4310-4375-9c35-aadd6428eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:03.661851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1706/3399] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:03.670327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.670717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.671135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.707420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:03.710527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:03.731546 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1707/3400] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:03.732631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:03.734635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:03.748683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf026a-22b3-40e9-a139-81f6367c308e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:03.754596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:03.755277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:03.755548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:03.755824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] PATH_INFO: `/v3/projects/1d65446c687345bf995d7e3d6d882c4e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:03.757503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d65446c687345bf995d7e3d6d882c4e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:03.759516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:03.813470 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1694/3401] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:03 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:03.815415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:03.958327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0ead60-c41b-4cc8-9e25-2f3036be3ba8 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:03.962937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d65446c687345bf995d7e3d6d882c4e', 'request_id': 'req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:03.976962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:03.983877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d65446c687345bf995d7e3d6d882c4e', 'request_id': 'req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:04.057561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.058534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.058885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.059234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.060138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:04.060615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.062850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.084025 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1695/3402] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:04.085665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.221755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d65446c687345bf995d7e3d6d882c4e', 'request_id': 'req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:04.239753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] The token cache is being invalidate because project 1d65446c687345bf995d7e3d6d882c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:04.240075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:04.241346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:04.253973 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1708/3403] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:03 2022] DELETE /identity/v3/projects/1d65446c687345bf995d7e3d6d882c4e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:04.255086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.260014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:04.278089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533c6eb-e5bd-4634-ae52-6830c5a0ff66 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.278699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944272-26ef-4f6b-82e5-beded59d8ef0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.285885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.286752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.287259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.287500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.288168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.290531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.290750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f7ac-7c21-4746-8ddd-6039f2162982 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.292298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.292887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.296705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.296705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.299139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ca7e08c3-0d4c-4f26-89f6-a57224d7c071 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0.: keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = query.one() Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._iter().one() Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._only_one_row( Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exc.NoResultFound( Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:04.311556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Nov 02 12:44:04.312780 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Nov 02 12:44:04.313939 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Nov 02 12:44:04.313939 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:44:04.313939 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.321471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1696/3404] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:44:04 2022] GET /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 137 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:44:04.323722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.325365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.325689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.359658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:04.361935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:04.372276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1697/3405] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:04.373380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.378457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:04.400436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a548a-577e-420c-bf91-008ff6d8f97a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.406038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.406972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.407336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.415348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.415348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.415348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.415634 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1709/3406] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:04 2022] POST /identity/v3/projects => generated 405 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:04.415634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.415634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.415634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0.: keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = query.one() Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._iter().one() Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._only_one_row( Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exc.NoResultFound( Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:04.423369 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Nov 02 12:44:04.424722 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Nov 02 12:44:04.425839 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Nov 02 12:44:04.425839 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Nov 02 12:44:04.425839 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Nov 02 12:44:04.425839 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 8e930feab4f1418f841cbc039adfbd70 does not imply 99041b7b5e434f67b23ef64d2e870ac0. Nov 02 12:44:04.425839 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:44:04.426509 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1698/3407] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:04 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 137 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:44:04.427452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.451971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:04.452602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d09f13-54e6-488c-9c58-d31832edf290 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.453223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:04.515951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:04.608942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.609785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.610315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.610987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.612145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.614970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.625407 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1710/3408] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:04.626590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.740238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c810e-1a66-409c-bab8-3abd1278ec72 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.747779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.748457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.748909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.749231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.751054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.753733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.790372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1699/3409] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:04 2022] POST /identity/v3/users => generated 303 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:04.792086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.811967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffc93b-5702-47bd-bb55-66e778a86f61 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.818503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.823456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.824590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.825254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.826109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:04.827339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.831072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.847665 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1700/3410] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:04.849238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.862779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96808a3-71ea-4d68-8555-4868d8679623 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.885760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.886366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.886726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.887133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.887829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.889758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.905855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1701/3411] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:04 2022] GET /identity/v3/roles => generated 2322 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:04.906668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:04.918664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab23cd-03be-4159-95c6-861e7353e979 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:04.923732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:04.925943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:04.926419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:04.926928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:04.927701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:04.929765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:04.935956 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1711/3412] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:04 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 519 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:04.940108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.048206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281327e-96d6-45a9-8a54-62bc8ae9e2eb tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:05.060581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:05.061252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.061696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.061937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.062579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:05.064252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:05.085472 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1712/3413] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:04 2022] GET /identity/v3/roles => generated 2322 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:05.085472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.116856 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1702/3414] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:04 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:05.121009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.195779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0da70-a160-44b0-93f4-319ecb6ac772 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:05.243147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d112a-57e2-4971-bbe5-5bb34719184a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:05.266802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:05.268724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.269197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.269663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] PATH_INFO: `/v3/projects/a62ee57746e345a799a6ddab45624dc9/users/12efbd6f761d49ceb86b035b48c47c7e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.316523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62ee57746e345a799a6ddab45624dc9, user_id=12efbd6f761d49ceb86b035b48c47c7e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:05.333305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:05.380646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:05.383192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.383746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.384270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.387564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:05.389454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705327a8-ca31-4693-b4bb-5b0cc0c6acee tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:05.504042 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1703/3415] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:05 2022] PUT /identity/v3/projects/a62ee57746e345a799a6ddab45624dc9/users/12efbd6f761d49ceb86b035b48c47c7e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:05.504042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.558534 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1713/3416] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:05 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e => generated 520 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:05.559981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.560463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.573291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.617209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887ce7a-d1ce-47fa-894d-506e8c40efa5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:05.642606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:05.643876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:05.714686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:05.715537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.715897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.716241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.717494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:05.720576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:05.794043 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1714/3417] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:05.795273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.887678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955ec94-d340-4caa-b9de-a7086d700f95 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:05.903878 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1704/3418] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:05 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:05.905360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:05.907864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:05.909849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:05.910517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:05.910799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:05.911075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:05.913122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:05.914779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.017314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75689e2e-51d7-4619-9f85-eb816e5d7435 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.022565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.024241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.024241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.024241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.035439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.037128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.054634 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1705/3419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:06.056801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.070256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1c1bf-ff68-4360-8945-10300694aaa2 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.077156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.078116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.078538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.078977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.080112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.082463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.109402 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1706/3420] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:06 2022] GET /identity/v3/roles => generated 2322 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:06.110919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.114492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:06.140732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a50aca-d399-47c0-b8b2-fc97dfa8df31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.149687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.150378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.150699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.150970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] PATH_INFO: `/v3/users/66e1e5c8ae83452cb36701b0f335d8a2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.160927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1715/3421] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:05 2022] PUT /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 521 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:06.165152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.165343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66e1e5c8ae83452cb36701b0f335d8a2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.170981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.310266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12219b10-cb78-41c7-957e-56888717b164 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.320626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.321454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.323245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.323735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.325086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.328586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.354871 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1716/3422] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:06 2022] GET /identity/v3/roles => generated 2322 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:06.354871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.467893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9696-cfcf-4789-b536-f5d806a2be41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.484115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.485301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.485715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.486107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.487845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.490051 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:06.490051 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:06.490051 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:06.493636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.544445 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1717/3423] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:44:06 2022] GET /identity/v3/role_inferences => generated 1606 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:06.545141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.571474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06593a9b-d10e-4df0-8bb8-4d983ac9ff00 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:06.584458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:06.585199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.585479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.585760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] PATH_INFO: `/v3/projects/609b25c5d73a4866898c08b5b37c063c/users/8fc9b2638f1f4af7acb932cdfdc0d4d5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.623884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=609b25c5d73a4866898c08b5b37c063c, user_id=8fc9b2638f1f4af7acb932cdfdc0d4d5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:06.630774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:06.643600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66e1e5c8ae83452cb36701b0f335d8a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:06.799619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:06.800449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66e1e5c8ae83452cb36701b0f335d8a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:06.810201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1718/3424] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:06 2022] PUT /identity/v3/projects/609b25c5d73a4866898c08b5b37c063c/users/8fc9b2638f1f4af7acb932cdfdc0d4d5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:06.810201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:06.825165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66e1e5c8ae83452cb36701b0f335d8a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:06.837291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66e1e5c8ae83452cb36701b0f335d8a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:06.838161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-beb9267c-ceea-43b3-a553-101f3c6ef0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66e1e5c8ae83452cb36701b0f335d8a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:06.845387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1707/3425] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:06 2022] DELETE /identity/v3/users/66e1e5c8ae83452cb36701b0f335d8a2 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:06.846994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:06.847383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:06.847759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:06.877644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:06.880632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:06.996053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7270e-5b42-41be-af0a-839b79ffa315 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:07.063210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1708/3426] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:07.087014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:07.089612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:07.192776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:07.193846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:07.194367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:07.194793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:07.198434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:07.200305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:07.215521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac668-45a0-45fa-8fdb-8a386cf9ab94 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:07.229451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:07.230178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:07.230456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:07.231281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:07.242237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:07.243876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:07.273275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1709/3427] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:07.333699 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1719/3428] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:06 2022] DELETE /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:07.343962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:07.343962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:07.377878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410850a-5e46-4096-b685-1b3a0186003b service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:07.548245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:07.550418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:07.551618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:07.552034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:07.556523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:07.560382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:07.739595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:07.745410 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1710/3429] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:07 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:07.747691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:07.778126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:07.780463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:07.787247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1de43-f325-4c41-8fd9-949976d007be tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:08.029141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3275c-a034-478f-98e1-5f668719a583 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:08.029666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:08.029666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.029666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.029919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.029919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:08.029919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:08.030916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:08.031882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.032797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.033557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] PATH_INFO: `/v3/projects/2449c558939943129ecf0b6db5251e60` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.037694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2449c558939943129ecf0b6db5251e60)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:08.040693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:08.330509 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1720/3430] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:07 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:08.337094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:08.365197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2449c558939943129ecf0b6db5251e60', 'request_id': 'req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:08.374710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2449c558939943129ecf0b6db5251e60', 'request_id': 'req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:08.382453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2449c558939943129ecf0b6db5251e60', 'request_id': 'req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:08.412780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77731d-8f78-4fc4-8893-cb86a25ddd4c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:08.494776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:08.495474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.495842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.496181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.496962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:08.501064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:08.519991 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1721/3431] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:08 2022] GET /identity/v3/roles => generated 2322 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:08.525292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:08.539987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b4379-db9d-46b9-8932-f6331e5a712d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:08.555906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:08.556834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.559063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.559689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.561723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:08.567323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:08.568327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] The token cache is being invalidate because project 2449c558939943129ecf0b6db5251e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:08.568969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:08.569921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-538ba1cb-7986-4f01-ae3a-805a85f5c1b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:08.573613 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1711/3432] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:07 2022] DELETE /identity/v3/projects/2449c558939943129ecf0b6db5251e60 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:08.580284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556221b2-547e-4887-9135-4bbb215ad4d2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.580841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556221b2-547e-4887-9135-4bbb215ad4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.581263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556221b2-547e-4887-9135-4bbb215ad4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.677883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-556221b2-547e-4887-9135-4bbb215ad4d2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:08.680172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-556221b2-547e-4887-9135-4bbb215ad4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:08.701120 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1722/3433] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:44:08 2022] POST /identity/v3/roles => generated 235 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:44:08.706386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:08.712411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:08.754514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ba90e-51bf-4b8a-9500-6d3fc8907a2b tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:08.776521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:08.777563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:08.784008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:08.784008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:08.784588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:update_role(role_id=2c5594a0ae4c435e951f0eae18d48ef2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:08.787827 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:08.787827 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:08.787827 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:08.793322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:08.986300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1723/3434] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:44:08 2022] PATCH /identity/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2 => generated 237 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:08.990993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:08.994824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1712/3435] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:09.004041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.004596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.005012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.012091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fa203-0794-4316-85e7-8c2dfcf89ca1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.018505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.019717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.020212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.021517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.046404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:get_role(role_id=2c5594a0ae4c435e951f0eae18d48ef2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.047897 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:09.047897 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:09.047897 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:09.049407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.053961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1724/3436] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:44:08 2022] GET /identity/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2 => generated 237 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:44:09.058189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.065157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:09.069731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:09.085572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792bd4a-8759-4f4a-91cb-7ff252d6ac40 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.093935 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1713/3437] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:09.095387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.105848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.107070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.107599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.108141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.110931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.113643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec3a5f-399b-4724-bdfa-5b665491d4e8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.114839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.135011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.135011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.135011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.135011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.135798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:09.135798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.137318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.152847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1725/3438] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:09 2022] GET /identity/v3/roles => generated 2550 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:09.156799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.174287 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1714/3439] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:44:09.176267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.190205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29e677-02e2-4a4b-92c4-bfbda9d77b8c tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.203114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.205055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d3693-98fb-406e-b5fd-a8173efdc966 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.205446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.206900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.207269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.209932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2c5594a0ae4c435e951f0eae18d48ef2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.215461 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:09.215461 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:09.215461 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:09.216790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.218713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.219630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.220091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.220580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.221570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.224755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.472477 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1715/3440] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:09.479710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.482793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 2c5594a0ae4c435e951f0eae18d48ef2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:09.483178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:09.486134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:09.495019 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1726/3441] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:09 2022] DELETE /identity/v3/roles/2c5594a0ae4c435e951f0eae18d48ef2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:09.505546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:09.511294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:09.644887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a3237-746f-48f7-aaa8-382c8e088b9a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.700400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a7ce1-5371-42ef-a559-e5dff5aa0c87 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:09.716476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.718886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.719721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.721230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.725990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.731201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:09.756013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:09.758213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:09.758761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:09.759247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:09.760776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:09.763866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.047037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:10.055031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1716/3442] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:09 2022] POST /identity/v3/users => generated 290 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:10.059668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1727/3443] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:09 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 519 bytes in 551 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:10.061731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:10.062409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:10.063635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:10.088294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8e890-337f-4fe1-9498-092da01b2344 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:10.239804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040e39b-cd3d-4e4a-87ea-81f4ecbba31f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:10.254384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:10.255060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.255349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.259414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.259658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:10.259658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.259658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.259658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.261062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:10.263125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:10.265036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.267535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.298394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1717/3444] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:10 2022] GET /identity/v3/roles => generated 2322 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:44:10.302787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:10.321921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0b728-4f1a-435a-9f12-2d4d747da570 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:10.354292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:10.355301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.356362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.356941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.358826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:10.363455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.400201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1718/3445] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:10 2022] GET /identity/v3/roles => generated 2322 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:10.402251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:10.403622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1728/3446] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:10 2022] PUT /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e => generated 520 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:10.407431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:10.420097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe3b0-d368-4554-95f1-80c955f9b08b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:10.564765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:10.565313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.565313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.565591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] PATH_INFO: `/v3/projects/655e1bdbfb0c469daeec1ba8a61057d4/users/f113dfb7876f43c293443ba1bce61302/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.610566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=655e1bdbfb0c469daeec1ba8a61057d4, user_id=f113dfb7876f43c293443ba1bce61302, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:10.613465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74978c-7381-43c0-a71a-7bdfe0d07d5d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.669372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e950155-dd8a-4604-a944-bf03c647bafa tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:10.676942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:10.677978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.678480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.679192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.682812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:10.684798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:10.785057 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1719/3447] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:10 2022] PUT /identity/v3/projects/655e1bdbfb0c469daeec1ba8a61057d4/users/f113dfb7876f43c293443ba1bce61302/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:10.790598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:10.791157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:10.791856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:10.832007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:10.836881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:10.840035 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1729/3448] 10.222.0.64 () {60 vars in 1363 bytes} [Wed Nov 2 12:44:10 2022] PUT /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 521 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:10.843515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.010778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508c4ba-10c2-4a3b-8c81-9c5a5074f908 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.025889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.026270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.026565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.027578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.029246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.035127 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:11.035127 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:11.035127 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:11.036050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.045259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1720/3449] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:11.053812 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1730/3450] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:44:10 2022] GET /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies => generated 490 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:11.065265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.078771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de918693-79f8-4ac2-925f-b15ebe83ba2a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.087866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.090752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.091282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.091719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.099430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8e930feab4f1418f841cbc039adfbd70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.099430 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:11.099430 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:11.099430 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:11.099430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.109054 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1721/3451] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:44:11 2022] GET /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies => generated 659 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:11.114203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.131913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34258-4e80-4b87-9ec1-fc2ab4049d18 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.142557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.143359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.144168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.150979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.154130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e, implied_role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.168270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.173714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.177032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:11.293336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a2c6-7cb1-49ab-9cb4-6b7c2b173ec0 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.298231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.299119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.299580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.300056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.303241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1731/3452] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:11 2022] DELETE /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e/implies/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:11.307440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.329704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.331678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.344210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1722/3453] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:11.416675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f60410-58fa-464e-96cc-1c13bb4aed72 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.428382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.429670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.430165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.430591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.434176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.436137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c47b93-a230-4e9d-8735-146e9d29ed92 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.583318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1732/3454] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:11 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/e2f8d0d143ea4c47a0e09d48017fdc1e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:11.589331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:11.611135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e1e33-59a2-441f-b527-85fe37241bc3 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:11.809439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:11.810186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.810529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.817255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.817255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8e930feab4f1418f841cbc039adfbd70, implied_role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:11.817876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:11.887071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:11.887611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:11.888205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:11.918595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:11.923646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:12.019498 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1733/3455] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:44:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:12.033419 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1723/3456] 10.222.0.64 () {58 vars in 1347 bytes} [Wed Nov 2 12:44:11 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70/implies/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:12.037443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:12.039075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:12.042480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:12.046707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:12.073151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeac25b-bb93-45d8-a066-f8124a605b6e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:12.273498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:12.274169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:12.274457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:12.274803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:12.301469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:44:12.302282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7650502-6854-4825-aec9-b00e50c20690 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:12.317929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:12.318559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:12.321742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:12.321742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Could not find domain: a6ebc92edc904554b4f9dcc82c81d5d2.: keystone.exception.DomainNotFound: Could not find domain: a6ebc92edc904554b4f9dcc82c81d5d2. Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a6ebc92edc904554b4f9dcc82c81d5d2. Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:12.324681 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:44:12.325791 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a6ebc92edc904554b4f9dcc82c81d5d2. Nov 02 12:44:12.326823 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:12.333495 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1734/3457] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:44:12 2022] PATCH /identity/v3/domains/a6ebc92edc904554b4f9dcc82c81d5d2 => generated 112 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:44:12.338876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:12.402347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5f2d8-7d80-46e0-9cb6-7fe632d5290d tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:12.414902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:12.415867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:12.416755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:12.417038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/users/116dfccf4fa741e8a0ce75ef4f65f4a2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:12.431569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_user(user_id=116dfccf4fa741e8a0ce75ef4f65f4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:12.433920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:12.492954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:12.494642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:12.507846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1724/3458] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:44:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:12.569215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:12.706628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:12.886577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:12.930292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:12.931069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:12.931733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116dfccf4fa741e8a0ce75ef4f65f4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:12.971675 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1735/3459] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:12 2022] DELETE /identity/v3/users/116dfccf4fa741e8a0ce75ef4f65f4a2 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:12.973040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:13.001401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5ff9b-ce6f-46c3-a63d-2002e480aca1 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:13.109345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:13.110404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.110887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.112520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/a7172b6ff6b34672b345d8e00ad9ccab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:13.121795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a7172b6ff6b34672b345d8e00ad9ccab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:13.123563 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:13.123563 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:13.123563 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:13.124896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:13.368367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role a7172b6ff6b34672b345d8e00ad9ccab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:13.368900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:13.370333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78f9ab61-01a6-4ac6-91da-33f39d9f790f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:13.377137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1725/3460] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:12 2022] DELETE /identity/v3/roles/a7172b6ff6b34672b345d8e00ad9ccab => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:13.378094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:13.379681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.400711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582bb2-aed3-45c1-a6cd-d19f9e77d674 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:13.536148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.536437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.539553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:13.539779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:13.540686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.541203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.541667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/groups/2852fc90d8f74060ae811ab4ddf84e48` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:13.543433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2852fc90d8f74060ae811ab4ddf84e48)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:13.545292 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:13.545292 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:13.545292 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:13.547272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:13.577640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:13.579210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.667828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1726/3461] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:13.682937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:13.694686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.731658 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1736/3462] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:44:13 2022] DELETE /identity/v3/groups/2852fc90d8f74060ae811ab4ddf84e48 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:13.732874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:13.750495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:13.844573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f8ff7-9454-4c71-995e-96a2c03e33f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:13.866232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288f836-7ea9-4de4-9737-16b0a9c4e592 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:13.873875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:13.875112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.875562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.875850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/projects/4904caa5e9c644449eba3037b5ba4c23` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:13.877111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4904caa5e9c644449eba3037b5ba4c23)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:13.879091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:13.951625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:13.952314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:13.952677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:13.953355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.044524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4904caa5e9c644449eba3037b5ba4c23', 'request_id': 'req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.055594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4904caa5e9c644449eba3037b5ba4c23', 'request_id': 'req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.057304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:14.059758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:14.076825 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1727/3463] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:14.083299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:14.152077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4904caa5e9c644449eba3037b5ba4c23', 'request_id': 'req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.179776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] The token cache is being invalidate because project 4904caa5e9c644449eba3037b5ba4c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:14.180233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.181371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bd3b5e5d-12ca-4c96-a586-1ed0a0a1f3ec tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.186151 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1737/3464] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:13 2022] DELETE /identity/v3/projects/4904caa5e9c644449eba3037b5ba4c23 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:14.189705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:14.217083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec6b0e-13e6-4f61-b405-8c939e748048 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:14.418629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:14.419812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:14.420911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:14.421551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.428815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=94fde93b8ae846478a2921644e5639e7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:14.431022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:14.485229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.487469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.503114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc399e4-c122-4fcb-a195-f7e4d7ba24f4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:14.503986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc399e4-c122-4fcb-a195-f7e4d7ba24f4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:14.503986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc399e4-c122-4fcb-a195-f7e4d7ba24f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.609724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3cc399e4-c122-4fcb-a195-f7e4d7ba24f4 None None] MFA Rules not processed for user `4893fb8aad454ab29cff4cc79cdfbfbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:14.611034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3cc399e4-c122-4fcb-a195-f7e4d7ba24f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:14.678139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.689025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.695757 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1728/3465] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:44:14 2022] PATCH /identity/v3/domains/94fde93b8ae846478a2921644e5639e7 => generated 278 bytes in 504 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:14.699927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:14.701578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:14.782618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1738/3466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:14.784320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6d61-5b14-426e-ac93-f97e3a015fc1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:14.784705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6d61-5b14-426e-ac93-f97e3a015fc1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:14.785053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb6d61-5b14-426e-ac93-f97e3a015fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.827835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ddfb6d61-5b14-426e-ac93-f97e3a015fc1 None None] MFA Rules not processed for user `4893fb8aad454ab29cff4cc79cdfbfbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:14.829189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ddfb6d61-5b14-426e-ac93-f97e3a015fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:14.832134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736a7c-312c-4b5c-9f52-099d4a3d26ed tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:14.843795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:14.845089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:14.845855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:14.847607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/domains/94fde93b8ae846478a2921644e5639e7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.848914 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1739/3467] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:14.855307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:14.855701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:14.855856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:14.881552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=94fde93b8ae846478a2921644e5639e7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:14.883953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:14.897029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:14.906760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:14.908022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:14.920737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:14.927269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '94fde93b8ae846478a2921644e5639e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.035451 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1740/3468] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:15.054093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:15.061891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:15.077050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.086401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.095149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.195197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f78e9-5831-4e9d-a291-55f1b11780f8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:15.240361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] The token cache is being invalidate because project 94fde93b8ae846478a2921644e5639e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:15.240955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.243106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.258521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.264205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.265507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '94fde93b8ae846478a2921644e5639e7', 'request_id': 'req-5c393ef7-9669-48fd-9838-5e0af18acfb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.279290 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1729/3469] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:44:14 2022] DELETE /identity/v3/domains/94fde93b8ae846478a2921644e5639e7 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:15.284379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:15.286153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:15.318268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:15.319354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:15.319354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:15.319638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:15.322598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:15.437663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c393ef7-9669-48fd-9838-5e0af18acfb1 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:15.446983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:15.450025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:15.450432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:15.450786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:15.455821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:15.487497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:15.496200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:15.511658 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1741/3470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:15 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:15.513267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:15.514919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:15.628478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:15.628817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f0f91-a9bb-4d87-9849-77f1732ee728 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:15.631221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:15.647980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:15.647980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:15.647980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:15.648341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:15.649773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e2f8d0d143ea4c47a0e09d48017fdc1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:15.650904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:15.655579 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1730/3471] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:44:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:15.808686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role e2f8d0d143ea4c47a0e09d48017fdc1e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:15.810445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.812878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:15.819990 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1742/3472] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:15 2022] DELETE /identity/v3/roles/e2f8d0d143ea4c47a0e09d48017fdc1e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:15.828910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:15.845986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf1a3a-e9f0-460e-845b-43d7ce917430 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:15.965483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:15.968537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:15.970255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:15.971661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/99041b7b5e434f67b23ef64d2e870ac0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:15.973599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_role(role_id=99041b7b5e434f67b23ef64d2e870ac0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:15.977933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:16.110066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 99041b7b5e434f67b23ef64d2e870ac0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:16.110719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.122702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.128088 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1731/3473] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:15 2022] DELETE /identity/v3/roles/99041b7b5e434f67b23ef64d2e870ac0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:16.132939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:16.134498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.151195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c05a76-d364-4935-8d15-0298a33ca5dd tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:16.285540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:16.287760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.313686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebaec53d276f400a85cf5d623e8d49e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '482af972da5847af9eb811f54f342dad', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:16.316202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.316202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.316202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] PATH_INFO: `/v3/roles/8e930feab4f1418f841cbc039adfbd70` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.318185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8e930feab4f1418f841cbc039adfbd70)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:16.319919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:16.428479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11c19f-bd2d-4ff5-a0a7-fd0c5f907c49 tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:16.441329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:16.441329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.441329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.441329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] PATH_INFO: `/v3/users/d03db5013be642b88ea298fba0d87f20` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.449420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03db5013be642b88ea298fba0d87f20)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:16.451406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:16.571643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invalidating the token cache because role 8e930feab4f1418f841cbc039adfbd70 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:16.572220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.576763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec300805-27af-475e-8123-a7c62b3cbc3f tempest-RolesV3TestJSON-1729727361 tempest-RolesV3TestJSON-1729727361-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.579543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1743/3474] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:16 2022] DELETE /identity/v3/roles/8e930feab4f1418f841cbc039adfbd70 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:16.581193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.581547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.581915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:16.592262 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:16.593138 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:16.593898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1744/3475] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:44:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:44:16.597168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:16.618049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:16.786726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03db5013be642b88ea298fba0d87f20'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.868944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:16.876257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:16.877441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.877825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.878202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] PATH_INFO: `/v3/users/c10bc5c63de74da499d68fa14cf33c60` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:16.879986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10bc5c63de74da499d68fa14cf33c60)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:16.882909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:16.936681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03db5013be642b88ea298fba0d87f20'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.960288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03db5013be642b88ea298fba0d87f20'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.976560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03db5013be642b88ea298fba0d87f20'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.977691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bad16c69-2325-40cc-8c84-1f16b16a6ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03db5013be642b88ea298fba0d87f20'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:16.992513 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1732/3476] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:16 2022] DELETE /identity/v3/users/d03db5013be642b88ea298fba0d87f20 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:16.994511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:16.995057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:16.995538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:17.030229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:17.033438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:17.172451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1733/3477] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:17.194991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:17.199764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:17.270861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10bc5c63de74da499d68fa14cf33c60'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:17.396397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ad59f-35f2-4da8-b37a-12e2fbec9bb0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:17.403165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10bc5c63de74da499d68fa14cf33c60'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:17.424147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:17.425235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:17.425791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:17.426211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:17.441493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10bc5c63de74da499d68fa14cf33c60'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:17.448195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10bc5c63de74da499d68fa14cf33c60'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:17.449313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bffc454f-3578-4a6d-8b89-2f79d258c543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10bc5c63de74da499d68fa14cf33c60'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:17.483667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:17.483667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:17.489013 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1745/3478] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:16 2022] DELETE /identity/v3/users/c10bc5c63de74da499d68fa14cf33c60 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:17.498224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:17.498654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:17.499001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:17.518632 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1734/3479] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:17.562328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:17.574383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:17.631539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:17.702861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:17.861776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1746/3480] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:17.915011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:17.927972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8c166-9bd2-43ea-918c-29f8eac1aa64 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:18.067015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:18.067619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:18.067892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:18.070345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:18.096761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:18.098383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:18.123023 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1735/3481] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:19.206406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:19.283392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:20.583079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:20.585345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:20.613331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6db1-6a78-46c4-acb6-fbd96a4e7b04 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:20.636046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:20.636834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:20.637112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:20.639533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] PATH_INFO: `/v3/projects/4f41a41b02574f7f8c36bf596f67041c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:20.644338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f41a41b02574f7f8c36bf596f67041c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:20.648506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:20.705068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:20.706550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:20.739184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a311b8-496e-4cbf-8254-a6f5eb68ddd7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:20.756144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:20.756144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:20.756144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:20.756144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] PATH_INFO: `/v3/projects/c0a42b724065423cb31303f3f9b55f36` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:20.758305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a42b724065423cb31303f3f9b55f36)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:20.765865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:20.937510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f41a41b02574f7f8c36bf596f67041c', 'request_id': 'req-fccfc58e-be04-4bf0-85dd-82232daa55f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:20.956115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f41a41b02574f7f8c36bf596f67041c', 'request_id': 'req-fccfc58e-be04-4bf0-85dd-82232daa55f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.034097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f41a41b02574f7f8c36bf596f67041c', 'request_id': 'req-fccfc58e-be04-4bf0-85dd-82232daa55f0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.047272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a42b724065423cb31303f3f9b55f36', 'request_id': 'req-bd79542c-4ec0-4639-8007-5a709cdbd6b7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.053052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] The token cache is being invalidate because project 4f41a41b02574f7f8c36bf596f67041c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:21.053399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.054687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.058380 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1747/3482] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:20 2022] DELETE /identity/v3/projects/4f41a41b02574f7f8c36bf596f67041c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:21.062723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:21.064269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:21.070485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a42b724065423cb31303f3f9b55f36', 'request_id': 'req-bd79542c-4ec0-4639-8007-5a709cdbd6b7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.086310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a42b724065423cb31303f3f9b55f36', 'request_id': 'req-bd79542c-4ec0-4639-8007-5a709cdbd6b7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.220441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] The token cache is being invalidate because project c0a42b724065423cb31303f3f9b55f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:21.221206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.224069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bd79542c-4ec0-4639-8007-5a709cdbd6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.227545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:21.227890 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1736/3483] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:20 2022] DELETE /identity/v3/projects/c0a42b724065423cb31303f3f9b55f36 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:21.233728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61771-1f48-46dc-a8c3-e20c1ccca3d4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:21.234308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61771-1f48-46dc-a8c3-e20c1ccca3d4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:21.239193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df61771-1f48-46dc-a8c3-e20c1ccca3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:21.253555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfc58e-be04-4bf0-85dd-82232daa55f0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:21.286496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3df61771-1f48-46dc-a8c3-e20c1ccca3d4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:21.289994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3df61771-1f48-46dc-a8c3-e20c1ccca3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:21.338560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:21.524168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:21.527008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:21.527318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:21.527598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] PATH_INFO: `/v3/users/ebaec53d276f400a85cf5d623e8d49e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:21.533421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebaec53d276f400a85cf5d623e8d49e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:21.537148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:21.565832 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1737/3484] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:21.575069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:21.575513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:21.575807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:21.641555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:21.647569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:21.687681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1738/3485] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:21.688937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:21.708834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05fcb2-7e4b-4f3a-9b42-fe029ef6ce8c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:21.727247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:21.728111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:21.728608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:21.729093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:21.729957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:21.730425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:21.732219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:21.760216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1739/3486] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:21.763263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:21.790272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900e261-8c4a-4f4a-8297-bbcebfb3ab31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:21.809822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:21.810815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:21.811321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:21.811843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:21.812719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:21.815140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:21.835431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebaec53d276f400a85cf5d623e8d49e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.919574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebaec53d276f400a85cf5d623e8d49e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.951395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebaec53d276f400a85cf5d623e8d49e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.951783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebaec53d276f400a85cf5d623e8d49e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.957982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebaec53d276f400a85cf5d623e8d49e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:21.966589 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1740/3487] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:21 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:21.976373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:21.978391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:22.037457 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1748/3488] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:21 2022] DELETE /identity/v3/users/ebaec53d276f400a85cf5d623e8d49e9 => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:22.114972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85931a2-18cb-4a67-bdf0-e086ab95013f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:22.347761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:22.348565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.348849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.349121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.349763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:22.354571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:22.514188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:22.561717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1741/3489] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:21 2022] POST /identity/v3/users => generated 293 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:22.565341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:22.591515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754a9e6-cd6c-487b-ac01-71178c1fc044 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:22.618069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:22.618868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.619461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.619843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.620723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:22.637823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:22.661999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1749/3490] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:22.665550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:22.695656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e496d-d808-4158-b7bc-40d0c0794a26 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:22.731224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:22.731985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.732626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.733148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.736863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:22.740342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc02f8-5e4d-468e-93e0-4dc2fa1da83a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:22.778666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:22.780622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1742/3491] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:22.802477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fea3a-c2d7-4fbf-b153-4e0a79e1944d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:22.813309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:22.814736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:22.818584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:22.820646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] PATH_INFO: `/v3/projects/3cba33c0c76d4baba02f19f515721a27/users/276ebe7b0d1b4962a18cd74a07fe6c7c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:22.875073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cba33c0c76d4baba02f19f515721a27, user_id=276ebe7b0d1b4962a18cd74a07fe6c7c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:22.884955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:23.092946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1750/3492] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:22 2022] PUT /identity/v3/projects/3cba33c0c76d4baba02f19f515721a27/users/276ebe7b0d1b4962a18cd74a07fe6c7c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:23.104954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:23.105490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:23.105913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:23.167072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] MFA Rules not processed for user `276ebe7b0d1b4962a18cd74a07fe6c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:23.187102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:23.467979 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1743/3493] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:23.481954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:23.484072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:23.572208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:23.704236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfd4b1-37bc-4b35-baf6-2e27ed47ed27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:23.731028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:23.731669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:23.731948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:23.732229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:23.772391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:23.781386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:23.818765 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1751/3494] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:24.605823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:24.993039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:24.995122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:24.997153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:24.998568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:25.162194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:25.195908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0760d01-81b8-40ad-8831-915bcb0bc08a service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:25.233409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:25.233409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.233409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.233409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] PATH_INFO: `/v3/projects/482af972da5847af9eb811f54f342dad` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.233898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5420ee-ee03-4d0a-9fab-0de22ec0477f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:25.234030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482af972da5847af9eb811f54f342dad)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:25.234030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:25.234407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:25.234407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.234407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.234407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] PATH_INFO: `/v3/users/d3f905a0f01e4ad191eb456ea9aec7ca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.234999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f905a0f01e4ad191eb456ea9aec7ca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:25.234999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:25.460591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482af972da5847af9eb811f54f342dad', 'request_id': 'req-f583b443-8499-4343-9dd2-b41b2478d9f6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.485002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482af972da5847af9eb811f54f342dad', 'request_id': 'req-f583b443-8499-4343-9dd2-b41b2478d9f6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.581538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f905a0f01e4ad191eb456ea9aec7ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.600175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482af972da5847af9eb811f54f342dad', 'request_id': 'req-f583b443-8499-4343-9dd2-b41b2478d9f6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.618391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] The token cache is being invalidate because project 482af972da5847af9eb811f54f342dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:25.618692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.621138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.638187 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1752/3495] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:24 2022] DELETE /identity/v3/projects/482af972da5847af9eb811f54f342dad => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:25.641609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:25.644741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:25.690617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f905a0f01e4ad191eb456ea9aec7ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.738315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f905a0f01e4ad191eb456ea9aec7ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.767637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f905a0f01e4ad191eb456ea9aec7ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.774787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e934fa-027f-4bcf-afe7-8f8a02f647ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f905a0f01e4ad191eb456ea9aec7ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:25.809082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1744/3496] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:24 2022] DELETE /identity/v3/users/d3f905a0f01e4ad191eb456ea9aec7ca => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:25.809814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8a0c-28d9-4416-8e01-6e08c486a2bc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:25.809814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8a0c-28d9-4416-8e01-6e08c486a2bc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:25.809814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc8a0c-28d9-4416-8e01-6e08c486a2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:25.918779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583b443-8499-4343-9dd2-b41b2478d9f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:25.919199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7fdc8a0c-28d9-4416-8e01-6e08c486a2bc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:25.920843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7fdc8a0c-28d9-4416-8e01-6e08c486a2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:26.096649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:26.097342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:26.099426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:26.099426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] PATH_INFO: `/v3/users/276ebe7b0d1b4962a18cd74a07fe6c7c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:26.099754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] RBAC: Authorizing `identity:delete_user(user_id=276ebe7b0d1b4962a18cd74a07fe6c7c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:26.102466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:26.143008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1745/3497] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:26.144594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:26.147394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:26.147701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:26.221765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:26.236792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:26.251526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1746/3498] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:26.256121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:26.258647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:26.288910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d55eab-a79a-4827-aaaf-d02a35d9c1da None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:26.322183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:26.327936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:26.327936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:26.327936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] PATH_INFO: `/v3/users/7f1602f439f64597ae371c084e7faed0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:26.327936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1602f439f64597ae371c084e7faed0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:26.328383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:26.478425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276ebe7b0d1b4962a18cd74a07fe6c7c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.620050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276ebe7b0d1b4962a18cd74a07fe6c7c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.652186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1602f439f64597ae371c084e7faed0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.654346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276ebe7b0d1b4962a18cd74a07fe6c7c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.660480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276ebe7b0d1b4962a18cd74a07fe6c7c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.668435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276ebe7b0d1b4962a18cd74a07fe6c7c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.706493 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1753/3499] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:25 2022] DELETE /identity/v3/users/276ebe7b0d1b4962a18cd74a07fe6c7c => generated 0 bytes in 1066 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:26.707866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:26.718137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:26.765824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1602f439f64597ae371c084e7faed0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.801620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1602f439f64597ae371c084e7faed0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.822557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1602f439f64597ae371c084e7faed0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.824455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69af2884-f081-4b01-8d17-c7081a726c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1602f439f64597ae371c084e7faed0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:26.837982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1747/3500] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:26 2022] DELETE /identity/v3/users/7f1602f439f64597ae371c084e7faed0 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:26.837982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da02ad-3612-47af-b0d7-5c08c266f598 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:26.837982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da02ad-3612-47af-b0d7-5c08c266f598 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:26.837982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da02ad-3612-47af-b0d7-5c08c266f598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:26.857291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:26.865377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a34cbc-b29b-44cb-852a-a3b000df951a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:26.886219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a0da02ad-3612-47af-b0d7-5c08c266f598 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:26.891465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0da02ad-3612-47af-b0d7-5c08c266f598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:26.974953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:27.019633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.030335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907fa7-35bf-4045-b4ef-1a4244be2267 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.055026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1754/3501] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:27.064626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.065268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.065755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.065991 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1748/3502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:27.073356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.077130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.090071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.150482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:27.153359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.175037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] MFA Rules not processed for user `12efbd6f761d49ceb86b035b48c47c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:27.176278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.177924 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1749/3503] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:27.179055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.180652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.212882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2046f4-bea6-4941-8a31-7b84caddeb31 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:27.229916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.231177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.231613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.232037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.232875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.238743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.323127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1755/3504] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:27.324292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.328141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.370960 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1750/3505] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/projects => generated 369 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:27.372051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.374732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.475494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4697-1e25-4a52-b950-34f297d579d5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:27.480826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.485570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.486295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.488183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.494958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502e80f-ec78-4efa-9112-73bdbc333a4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:27.509904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.510838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.511261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.511926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.595394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.597048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.616893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1756/3506] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:27.617625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.622703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.661894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe9264-2f97-4ebd-b4f7-29cb46eeceac service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:27.674760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.680636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.681688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.684277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.684277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.684277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.685483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.691332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.713519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1751/3507] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:27.715250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.741771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af157-e0b6-413e-83b8-c8b99c845cd4 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:27.747674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:27.748597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:27.748921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:27.749242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:27.750348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:27.753447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:27.859219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1757/3508] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/projects => generated 403 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:27.860686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.863531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:27.911711 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1752/3509] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:27.918308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:27.938549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84ff7c-351d-48b4-bf46-5050865a5cad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.015502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce279d1-1817-4af2-a557-b6ec58fc13f0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.029388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.029388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.029388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.029388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] PATH_INFO: `/v3/projects/0ff598bce6e74831be9e50484b4075d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.030970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff598bce6e74831be9e50484b4075d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.034933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.097277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.098233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.098744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.099166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.099987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.102179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.248685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff598bce6e74831be9e50484b4075d2', 'request_id': 'req-e2a5721e-914e-4a38-ae33-d65c96354b2c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:28.268810 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1753/3510] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:27 2022] POST /identity/v3/users => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:28.269914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.278131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff598bce6e74831be9e50484b4075d2', 'request_id': 'req-e2a5721e-914e-4a38-ae33-d65c96354b2c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:28.300590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd4ad8-1fb9-4c04-a1b3-6484b98f28ab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.406595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.407510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.407898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.408268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.409621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.411754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.441823 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1754/3511] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:28.442742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.469882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a7aff-4101-40df-8da8-a6231f88ef3c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.473557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff598bce6e74831be9e50484b4075d2', 'request_id': 'req-e2a5721e-914e-4a38-ae33-d65c96354b2c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:28.479966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.480709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.481113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.481354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.484630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.486312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.499801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] The token cache is being invalidate because project 0ff598bce6e74831be9e50484b4075d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:28.500170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:28.500900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:28.502137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1755/3512] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:28.507567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1758/3513] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:27 2022] DELETE /identity/v3/projects/0ff598bce6e74831be9e50484b4075d2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:28.507796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.508768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.511912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.515787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.544721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f434e867-6815-45ca-a01f-06b2b5dfce88 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.550954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.552746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.553277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.553783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.554690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.556717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.560579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a5721e-914e-4a38-ae33-d65c96354b2c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.567456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.569812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.569812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.569812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.570116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.573755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.577250 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1756/3514] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:28.578486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.584524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:28.597544 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1759/3515] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:28.598693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.609186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5543e-0215-421f-bcf3-e1dca0888929 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.615584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.616951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.617454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.617993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] PATH_INFO: `/v3/users/0e9cda2739ba4361beccbaebed076602` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.619310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db1a28-cf72-46e6-8b48-3e8b8a76730a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.619791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9cda2739ba4361beccbaebed076602)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.622057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.626378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.627451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.627614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.628001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] PATH_INFO: `/v3/projects/f1172bb613284b959b8fabf9acd9a906/users/2294c9c291fd4435a18c212f5cbd6705/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.650646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1172bb613284b959b8fabf9acd9a906, user_id=2294c9c291fd4435a18c212f5cbd6705, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:28.653802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:28.795544 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1760/3516] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:28 2022] PUT /identity/v3/projects/f1172bb613284b959b8fabf9acd9a906/users/2294c9c291fd4435a18c212f5cbd6705/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:28.803252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:28.951920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763ec2-fb9f-4500-8549-9cbe51f28ba7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:28.965475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:28.969286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:28.969662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:28.969956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] PATH_INFO: `/v3/projects/d15efd8b3a96452e84f31fe686b088c1/users/bdf29c3b6214410aafdcb41a23ce317a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:28.984336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9cda2739ba4361beccbaebed076602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.013109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15efd8b3a96452e84f31fe686b088c1, user_id=bdf29c3b6214410aafdcb41a23ce317a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:29.018703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:29.136839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:29.182443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9cda2739ba4361beccbaebed076602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.200126 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1761/3517] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:28 2022] PUT /identity/v3/projects/d15efd8b3a96452e84f31fe686b088c1/users/bdf29c3b6214410aafdcb41a23ce317a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:29.202601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:29.207346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:29.219578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9cda2739ba4361beccbaebed076602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.244607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9cda2739ba4361beccbaebed076602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.244607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-58eb29ec-24e0-4ff0-a076-bfebd4c70946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9cda2739ba4361beccbaebed076602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.262700 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1757/3518] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:28 2022] DELETE /identity/v3/users/0e9cda2739ba4361beccbaebed076602 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:29.264127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:29.264420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:29.265887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:29.350453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] MFA Rules not processed for user `2294c9c291fd4435a18c212f5cbd6705`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:29.351680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:29.426034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849934c-32ee-48a1-95c6-b2355288f2a1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:29.605459 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1758/3519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:29.606400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:29.610869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:29.651396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:29.652354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:29.652354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:29.652637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] PATH_INFO: `/v3/projects/cdd844366c7343be97d0911ff5c05ba4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:29.655217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd844366c7343be97d0911ff5c05ba4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:29.657034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:29.754027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242811e-5007-4cca-8929-5b15a5376130 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:29.760848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:29.761553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:29.761832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:29.762103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] PATH_INFO: `/v3/projects/3cba33c0c76d4baba02f19f515721a27` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:29.763428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cba33c0c76d4baba02f19f515721a27)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:29.765819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:29.915186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd844366c7343be97d0911ff5c05ba4', 'request_id': 'req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.925536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd844366c7343be97d0911ff5c05ba4', 'request_id': 'req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:29.985900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:30.045463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd844366c7343be97d0911ff5c05ba4', 'request_id': 'req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.066303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cba33c0c76d4baba02f19f515721a27', 'request_id': 'req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.079578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] The token cache is being invalidate because project cdd844366c7343be97d0911ff5c05ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:30.080061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.081382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.083841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1762/3520] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:29 2022] DELETE /identity/v3/projects/cdd844366c7343be97d0911ff5c05ba4 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:30.084945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:30.087576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:30.092292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cba33c0c76d4baba02f19f515721a27', 'request_id': 'req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.113434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cba33c0c76d4baba02f19f515721a27', 'request_id': 'req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.264718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] The token cache is being invalidate because project 3cba33c0c76d4baba02f19f515721a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:30.267048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.269940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.284217 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1759/3521] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:29 2022] DELETE /identity/v3/projects/3cba33c0c76d4baba02f19f515721a27 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:30.287753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:30.291565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62891b4-8907-417d-8d0b-60ba9ed2a4a5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:30.298819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:30.443928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:30.444658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:30.444941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:30.445215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:30.445953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:30.454889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b130f-19e0-4d23-9536-a0001e8487f4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:30.552791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84b72d-f3bb-471d-bac9-dbe1f4ab2d68 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:30.573086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:30.574608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:30.574608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:30.577375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] PATH_INFO: `/v3/users/14813a5cf87b4979abafa9e8459f5d1d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:30.582774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=14813a5cf87b4979abafa9e8459f5d1d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:30.589599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:30.679439 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1763/3522] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:30 2022] POST /identity/v3/projects => generated 367 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:30.682025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:30.685321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:30.685741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:30.764882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:30.766914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:30.913116 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1764/3523] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:30.913116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:30.913116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:30.945100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14813a5cf87b4979abafa9e8459f5d1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:30.960302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa315f7-3d70-431c-a8eb-d99c67fa3171 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:30.974009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:30.977749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:30.978084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:30.979072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:30.979760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:30.988422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.026511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14813a5cf87b4979abafa9e8459f5d1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.044722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:31.067640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14813a5cf87b4979abafa9e8459f5d1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.067988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1765/3524] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:30 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:31.070327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:31.077444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.092325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14813a5cf87b4979abafa9e8459f5d1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.093223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3de465ce-9f53-40dc-8e6f-d5526d708dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14813a5cf87b4979abafa9e8459f5d1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.105113 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1760/3525] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:30 2022] DELETE /identity/v3/users/14813a5cf87b4979abafa9e8459f5d1d => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:31.113347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da7f764-2c98-4f93-ae70-361cc08db1b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:31.114716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a44c-30ec-4c1e-8872-f8b83da20802 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.115947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a44c-30ec-4c1e-8872-f8b83da20802 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.116442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6a44c-30ec-4c1e-8872-f8b83da20802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.158928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-24e6a44c-30ec-4c1e-8872-f8b83da20802 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:31.171003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-24e6a44c-30ec-4c1e-8872-f8b83da20802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.243242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:31.244544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.244829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.245099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] PATH_INFO: `/v3/projects/dea95d540b3a493abceeafe170c11c4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.246373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea95d540b3a493abceeafe170c11c4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:31.249245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.302387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1761/3526] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:31.304229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.304849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.305135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.342677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] MFA Rules not processed for user `8fc9b2638f1f4af7acb932cdfdc0d4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:31.344149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.375877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea95d540b3a493abceeafe170c11c4b', 'request_id': 'req-0842926a-3dd2-4048-af6f-954aa0a60c27'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.397228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea95d540b3a493abceeafe170c11c4b', 'request_id': 'req-0842926a-3dd2-4048-af6f-954aa0a60c27'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.483560 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1762/3527] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:31.485112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:31.486676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.531223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef2b32-43cd-455b-a02f-cd46c1322e9d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:31.533317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea95d540b3a493abceeafe170c11c4b', 'request_id': 'req-0842926a-3dd2-4048-af6f-954aa0a60c27'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.554636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] The token cache is being invalidate because project dea95d540b3a493abceeafe170c11c4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:31.556634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.558386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.560582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1766/3528] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:31 2022] DELETE /identity/v3/projects/dea95d540b3a493abceeafe170c11c4b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:31.561726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:31.563952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.683812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842926a-3dd2-4048-af6f-954aa0a60c27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:31.684864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:31.686888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.687533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.687961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] PATH_INFO: `/v3/users/4893fb8aad454ab29cff4cc79cdfbfbc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.689978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4893fb8aad454ab29cff4cc79cdfbfbc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:31.694136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.698589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:31.699373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.699736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.700113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.700899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:31.702607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.737174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1767/3529] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:31.738372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:31.746226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.764701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d5ba68-4fe7-4cb9-b1fb-f3e6209f0bc3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:31.771592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:31.772577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.773000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.773414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.774284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:31.774793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:31.777649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895276e9-7042-443e-a659-ec419a5f9607 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:31.794776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1768/3530] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:31.796545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f1ab-6804-4806-998f-2d59547c5333 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.797332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f1ab-6804-4806-998f-2d59547c5333 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.797731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9f1ab-6804-4806-998f-2d59547c5333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.822223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-56c9f1ab-6804-4806-998f-2d59547c5333 None None] MFA Rules not processed for user `8fc9b2638f1f4af7acb932cdfdc0d4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:31.824684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56c9f1ab-6804-4806-998f-2d59547c5333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.937625 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1769/3531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:31.937625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:31.937625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:31.937625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:31.972745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:31.975888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:31.976602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4893fb8aad454ab29cff4cc79cdfbfbc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:31.992702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1770/3532] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:31.994700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:32.028998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e82e30-0ab8-43f3-889c-6e4c0851eeda None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:32.037208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:32.038345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.038630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.038905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] PATH_INFO: `/v3/projects/f5fb649351044cc4ba522e4311970e15/users/fa8a88807a284d00bf3e110517fc96ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.078618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4893fb8aad454ab29cff4cc79cdfbfbc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:32.086501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fb649351044cc4ba522e4311970e15, user_id=fa8a88807a284d00bf3e110517fc96ac, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:32.093142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:32.102353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4893fb8aad454ab29cff4cc79cdfbfbc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:32.118161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4893fb8aad454ab29cff4cc79cdfbfbc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:32.122443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4893fb8aad454ab29cff4cc79cdfbfbc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:32.131777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1763/3533] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:31 2022] DELETE /identity/v3/users/4893fb8aad454ab29cff4cc79cdfbfbc => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:32.132375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:32.134573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.228983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:32.235078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1771/3534] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:31 2022] PUT /identity/v3/projects/f5fb649351044cc4ba522e4311970e15/users/fa8a88807a284d00bf3e110517fc96ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:32.236254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:32.239973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.372045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5fff-1ba3-43bb-bc46-d26a1bae0247 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:32.523289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12318-7231-4ba6-9499-28007696bd55 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:32.538743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:32.540815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.541099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.541303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:32.542245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.542560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.542883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.543620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.544462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:32.548385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.552600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:32.675272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:32.677374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c58e85-7cf4-4723-91c6-dee8bc54d0cb service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:32.691063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1772/3535] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:32.693958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.694352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.694823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.715598 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1764/3536] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:32 2022] POST /identity/v3/projects => generated 399 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:32.716450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:32.723841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.725059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:32.730523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.856887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1773/3537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:32.858329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:32.861052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:32.891366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad9916-b740-4e0d-a0f8-6479f2653ff8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:32.899250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:32.900718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.901218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.901719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] PATH_INFO: `/v3/projects/8d329267d391470f91c0e06b8d838ede` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.903881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d329267d391470f91c0e06b8d838ede)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:32.908141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:32.962076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcfc2e0-294e-4d8f-82e1-d3a1b94272fa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:32.976830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:32.983257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:32.983257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:32.983257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:32.984904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:32.986771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:33.018387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1765/3538] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:33.019700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:33.045186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa04674-3a7a-4be5-a3cb-d7da3bd6ede3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:33.060663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:33.061362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.061634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.061957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.062603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:33.073539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:33.171695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d329267d391470f91c0e06b8d838ede', 'request_id': 'req-f2e68c04-fd49-482c-8459-a8a0320e4d2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.206284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d329267d391470f91c0e06b8d838ede', 'request_id': 'req-f2e68c04-fd49-482c-8459-a8a0320e4d2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.233925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1766/3539] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:33 2022] POST /identity/v3/users => generated 300 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:33.239069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:33.240016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:33.268265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c794100d-05f7-447b-af0c-34ae5a5c287d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:33.307810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d329267d391470f91c0e06b8d838ede', 'request_id': 'req-f2e68c04-fd49-482c-8459-a8a0320e4d2d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.329205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] The token cache is being invalidate because project 8d329267d391470f91c0e06b8d838ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:33.329507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.330187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.338656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1774/3540] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:32 2022] DELETE /identity/v3/projects/8d329267d391470f91c0e06b8d838ede => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:33.339692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:33.345064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:33.396963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:33.404991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.405471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.406965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] PATH_INFO: `/v3/projects/12c9018d300642ea8827af97192c4104` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.408943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c9018d300642ea8827af97192c4104)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:33.427005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:33.514652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68c04-fd49-482c-8459-a8a0320e4d2d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:33.527512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:33.528157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.528428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.528876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.529545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:33.529849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:33.534394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:33.567488 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1775/3541] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:33.568575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:33.574012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:33.605637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2e12-549c-49f6-bbe7-dea3a2aa10d3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:33.620954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c9018d300642ea8827af97192c4104', 'request_id': 'req-455cd855-7af7-44db-90f4-01fedeb1a089'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.632125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c9018d300642ea8827af97192c4104', 'request_id': 'req-455cd855-7af7-44db-90f4-01fedeb1a089'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.647613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c9018d300642ea8827af97192c4104', 'request_id': 'req-455cd855-7af7-44db-90f4-01fedeb1a089'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.723874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:33.724637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.724918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.725189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] PATH_INFO: `/v3/projects/f5fb649351044cc4ba522e4311970e15/users/fa8a88807a284d00bf3e110517fc96ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.734933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fb649351044cc4ba522e4311970e15, user_id=fa8a88807a284d00bf3e110517fc96ac, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:33.746168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:33.773084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] The token cache is being invalidate because project 12c9018d300642ea8827af97192c4104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:33.773696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.774606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-455cd855-7af7-44db-90f4-01fedeb1a089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:33.788395 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1776/3542] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:33 2022] PUT /identity/v3/projects/f5fb649351044cc4ba522e4311970e15/users/fa8a88807a284d00bf3e110517fc96ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:33.788395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:33.788395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:33.791526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1767/3543] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:33 2022] DELETE /identity/v3/projects/12c9018d300642ea8827af97192c4104 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:33.798061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.798597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.801757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.845497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:33.847875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:33.933955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:33.970810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2460c-4683-44db-b44d-3f80b7520949 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:33.985207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:33.986361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:33.987083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:33.987473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:33.995266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:33.997244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764a520-8f31-4465-b45a-2e67fdd6715b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.015168 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1777/3544] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:34.015168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072549a-c455-45a5-be05-5abeee64c1fb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.015168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072549a-c455-45a5-be05-5abeee64c1fb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.018610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072549a-c455-45a5-be05-5abeee64c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e072549a-c455-45a5-be05-5abeee64c1fb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:34.051441 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:34.052639 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:34.053746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1778/3545] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:44:34.066049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda09c-d36f-4660-9e35-8b759ef5deaa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.066766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda09c-d36f-4660-9e35-8b759ef5deaa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.066766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eda09c-d36f-4660-9e35-8b759ef5deaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.089198 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1768/3546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.089198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.089198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.118077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-21eda09c-d36f-4660-9e35-8b759ef5deaa None None] MFA Rules not processed for user `f113dfb7876f43c293443ba1bce61302`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:34.119240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845f967-0eec-470d-99b4-31d027624e83 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.131154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21eda09c-d36f-4660-9e35-8b759ef5deaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.144379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.147022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.148938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.149242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.150050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.154009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105165ea-df02-403c-96f6-acd010aa2925 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.207912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:34.248229 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1779/3547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.255707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.256612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.257235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.294619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] MFA Rules not processed for user `fa8a88807a284d00bf3e110517fc96ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:34.296316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.350068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1769/3548] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/projects => generated 395 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:34.352747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9386-d60c-435d-bc07-6ec95cb35e66 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.353834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9386-d60c-435d-bc07-6ec95cb35e66 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.355387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9386-d60c-435d-bc07-6ec95cb35e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.399476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f4bf9386-d60c-435d-bc07-6ec95cb35e66 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:34.401293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f4bf9386-d60c-435d-bc07-6ec95cb35e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.506805 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1780/3549] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.506805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.516322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1770/3550] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.518033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.518393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.518817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.550989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc08e2-6dd1-4351-81e1-6bafe63039d1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.561425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:34.563478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.564341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.565562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.565810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.566089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.566938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.568703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.583010 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1771/3551] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.587816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.590659 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1781/3552] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:34.591512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.591767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.604500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a63ab-5035-4ac3-849d-8a9dcff9f8a0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.611136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.611787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.612065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.612336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.613030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.615258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.642052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51135ca1-1a1b-419a-9715-ed0a28d4a043 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.650468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.651387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.651671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.652127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.652816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.655986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee754a-0491-4197-aad6-f45536309548 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.715363 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1782/3553] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:34.717910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.810993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed3dffd-e7f4-4a20-88fe-c297086e630f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.816742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.817399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.817877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.818155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.818970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.820138 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:34.820138 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:34.820138 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:34.821212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:34.828020 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1772/3554] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:34.833662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.833954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.834287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.860257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:34.864694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:34.932443 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1783/3555] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/services => generated 240 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:34.933181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.961949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237f2cf-a249-40b8-92d4-ecc733948667 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.963661 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1773/3556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:34.964574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:34.976578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9344a-28db-4239-a286-2a951fa2524f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:34.982597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.983491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:34.984183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.984459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.984804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] PATH_INFO: `/v3/projects/028ae84504c3470795228745c92988ae/users/e1fd343aed7f4afa811a5a04837e8bc4/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.988069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:34.988359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:34.988668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:34.991597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:34.991967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:34.994199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.007838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028ae84504c3470795228745c92988ae, user_id=e1fd343aed7f4afa811a5a04837e8bc4, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.011888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.034838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1784/3557] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:35.035727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.053409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dc4c1-a64d-4f43-aff5-34c015220d2b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.062079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.062710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.062992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.063319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.063984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.066113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.079815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1785/3558] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:35.080858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.107404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11ae2be-7b82-4e83-8761-14732d3a0dad admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.115844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.116506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.116840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.117124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.117769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.119913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.170884 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1774/3559] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:34 2022] PUT /identity/v3/projects/028ae84504c3470795228745c92988ae/users/e1fd343aed7f4afa811a5a04837e8bc4/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:35.170884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.266451 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1786/3560] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:35 2022] POST /identity/v3/users => generated 295 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:35.269275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.284935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10950-5aa6-4861-9c34-683cc7a0d87f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.344858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ace8f-e653-49b7-b249-dbe508be3b24 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.353775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.354418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.354708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.354988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/84392dee857f411a9c333cb349db2d3b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.355578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:delete_service(service_id=84392dee857f411a9c333cb349db2d3b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.356627 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:35.356627 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:35.356627 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:35.357536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.405325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.406209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.406858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.407228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.408156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:35.408618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.410796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.438389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1787/3561] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:35.441957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.466759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff9c7e-e9a7-4780-ad35-77d496f7c9c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.482546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.483331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.483708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.484192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.489117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.491656 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1775/3562] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:35 2022] DELETE /identity/v3/services/84392dee857f411a9c333cb349db2d3b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:35.492895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.501055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.542938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:35.562775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a587ab5-1e09-4c87-a7bb-15b72694bd7c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.569641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.570635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.571011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.571409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.573306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.575938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ac6c0-0eac-4747-b933-524d4ca00185 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.594674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1776/3563] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:35.594674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.594674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.594674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.621350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:35.622794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:35.652370 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1777/3564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:35.653250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.679042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbcfc0-68e2-4e22-ba35-d04e41cc00b0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.686107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.686774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.687054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.687338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.688061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.692914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.694221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1788/3565] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:35 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:35.696946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.710378 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1778/3566] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:35.711141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:35.761142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5de76b-ed37-4c17-b404-c58d17c5492c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.872157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0528-e8bd-4d07-a762-e04dd7d0e075 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:35.886887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.888660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.888950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.889224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.890268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.896634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:35.916050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:35.916942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:35.918414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:35.918696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:35.920557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:35.923884 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:35.923884 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:35.923884 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:35.931772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:36.060644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1779/3567] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:35 2022] POST /identity/v3/services => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:36.061696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:36.069305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1789/3568] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:35 2022] POST /identity/v3/projects => generated 391 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:36.070310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:36.077438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:36.126927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d723327-380a-4d6a-a1cf-195206df971a tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:36.268617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:36.269410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.270130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.270408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] PATH_INFO: `/v3/projects/6fcb3622750f4d468efb3f30bd74a498/users/a10dacce8dd54fdfa16778aefa38e43e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.293687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcb3622750f4d468efb3f30bd74a498, user_id=a10dacce8dd54fdfa16778aefa38e43e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:36.296757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:36.342044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a7936-6488-4216-8dcc-44ee51bb261f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:36.393686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:36.394379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.400712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.400712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.432448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:36.434344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:36.436857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1780/3569] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:36 2022] PUT /identity/v3/projects/6fcb3622750f4d468efb3f30bd74a498/users/a10dacce8dd54fdfa16778aefa38e43e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:36.438525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:36.498656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1790/3570] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:36.499694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:36.542706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad855482-09d0-4073-95ba-af8d4597a212 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:36.566975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:36.689269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704fb0-7750-48d6-8b1d-fa5960dfbb31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:36.706456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:36.707248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.708165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.709412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.716663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:36.724386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:36.784330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:36.786969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:36.791681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:36.793407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:36.793813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] PATH_INFO: `/v3/projects/5db19daadcca4fb7a4b682b68de52c61/users/3e7652bfbb3b4fcea8d7f6bb127176f1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:36.839433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db19daadcca4fb7a4b682b68de52c61, user_id=3e7652bfbb3b4fcea8d7f6bb127176f1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:36.842454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.018250 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1781/3571] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:36 2022] POST /identity/v3/users => generated 292 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:37.021848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.025892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1791/3572] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:36 2022] PUT /identity/v3/projects/5db19daadcca4fb7a4b682b68de52c61/users/3e7652bfbb3b4fcea8d7f6bb127176f1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:37.028477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.202725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5e1aa-2e30-49a1-90f0-81556ddd76e9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.218237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.218879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.219162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.219432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.220129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.232200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c21fb-4cbe-4109-8e18-ac3fec588d89 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.264903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed633460-34fb-43c9-b116-dcf77d047bf9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.357704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1792/3573] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:37 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:37.357704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.357704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.357704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.368074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.369023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.371400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.371907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/d9ecfdb9356942b6afcad2befbafec4b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.372648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:update_service(service_id=d9ecfdb9356942b6afcad2befbafec4b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.374828 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:37.374828 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:37.374828 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:37.382621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.401019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:37.402507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:37.416728 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1793/3574] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:37.416728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.429406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c95b78-530b-47ab-b45e-5bffe47d01b2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.437035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.437991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.438408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.438842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.439756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.442772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.473096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1794/3575] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:37.475738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.488726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024dc24-735c-4807-b31c-9bf0376c0c09 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.494991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.498436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.498436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.498436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.498436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.499790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.502150 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1782/3576] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:44:37 2022] PATCH /identity/v3/services/d9ecfdb9356942b6afcad2befbafec4b => generated 283 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:37.503430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.526336 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1795/3577] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:37.532303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.532303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:37.565223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6476d-fcf1-427b-9498-9edb0c5df693 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.584204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.586140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.586425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.591006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.592809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.597838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.635641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1783/3578] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:37.635641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.656935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede06eb0-a980-4491-8ca1-7e92493dc4ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.673948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.675738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.679214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.679772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.680697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.683086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.734912 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1784/3579] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:37.741224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.758604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8fd4e-ab43-41ca-8f55-163868e56789 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.793010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.794046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.794046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.794360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.801647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b7198-806f-4504-b1a0-73523599b4b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.813747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.815775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.816380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.816913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/d9ecfdb9356942b6afcad2befbafec4b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.818232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:get_service(service_id=d9ecfdb9356942b6afcad2befbafec4b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.819243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.819919 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:37.819919 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:37.819919 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:37.821481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.822513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.832013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1785/3580] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/services/d9ecfdb9356942b6afcad2befbafec4b => generated 283 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:37.834775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.849664 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1796/3581] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:37.851510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce68f-0b68-4fb8-b151-82fb09dd500d tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.852549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.858418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.882237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.885039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:37.885213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906763ea-d86a-42dd-a32a-3cd7798e656a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:37.885940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.886369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] PATH_INFO: `/v3/projects/5db19daadcca4fb7a4b682b68de52c61/users/3e7652bfbb3b4fcea8d7f6bb127176f1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.897251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db19daadcca4fb7a4b682b68de52c61, user_id=3e7652bfbb3b4fcea8d7f6bb127176f1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.904192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.922499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:37.926757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:37.928019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:37.933359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:37.937618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:37.943212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:37.973545 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1786/3582] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:37 2022] PUT /identity/v3/projects/5db19daadcca4fb7a4b682b68de52c61/users/3e7652bfbb3b4fcea8d7f6bb127176f1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:37.983657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:37.988091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1797/3583] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:37.989777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:38.033278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce02cb-f79a-415d-89fb-0fb8062a12d4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:38.133872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628d9f5-42f1-4db4-a8ed-abf12a8257cd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:38.153696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:38.153696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.154046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.154256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] PATH_INFO: `/v3/projects/a444e4c0cab7408b8e6cc8b87398f290/users/1dea9e27e67b4fd888fb2c4085ec5bfb/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.197835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:38.207566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a444e4c0cab7408b8e6cc8b87398f290, user_id=1dea9e27e67b4fd888fb2c4085ec5bfb, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:38.215940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:38.216415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:38.217236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.222619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.223030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/d9ecfdb9356942b6afcad2befbafec4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.223799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d9ecfdb9356942b6afcad2befbafec4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:38.227434 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:38.227434 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:38.227434 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:38.231288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c10ad-9ae6-4251-8ef6-8e24789d0bb3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:38.322637 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1787/3584] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:37 2022] PUT /identity/v3/projects/a444e4c0cab7408b8e6cc8b87398f290/users/1dea9e27e67b4fd888fb2c4085ec5bfb/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:38.324230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:38.408410 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1798/3585] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:37 2022] DELETE /identity/v3/services/d9ecfdb9356942b6afcad2befbafec4b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:38.410487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.410995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.411494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.499269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:38.503796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:38.524309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13b53a-c7a0-48d2-9996-d635b1a6c1ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:38.566345 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1799/3586] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:38.569595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:38.571532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:38.572306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.573417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.573417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] PATH_INFO: `/v3/projects/6839662ece854e21ac3002b262fdc52e/users/e92466fea4504554b1bda7cea02b45a7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.612336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6839662ece854e21ac3002b262fdc52e, user_id=e92466fea4504554b1bda7cea02b45a7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:38.619709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:38.763741 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1788/3587] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:38 2022] PUT /identity/v3/projects/6839662ece854e21ac3002b262fdc52e/users/e92466fea4504554b1bda7cea02b45a7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:38.768877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:38.784505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e357b5-84ce-489d-9a98-46f9714a3bdb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:38.919893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d2f78-4530-49f0-b005-fbc2e7629521 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:38.933180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:38.933967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.934319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.934703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.964229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:38.965362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.965651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/d9ecfdb9356942b6afcad2befbafec4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:get_service(service_id=d9ecfdb9356942b6afcad2befbafec4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:38.972439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-26011f6f-8035-44fe-b439-39542c591921 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Could not find service: d9ecfdb9356942b6afcad2befbafec4b.: keystone.exception.ServiceNotFound: Could not find service: d9ecfdb9356942b6afcad2befbafec4b. Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d9ecfdb9356942b6afcad2befbafec4b. Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:38.986654 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_service(service_id) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:44:38.987709 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d9ecfdb9356942b6afcad2befbafec4b. Nov 02 12:44:38.988672 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:38.993788 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1800/3588] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:44:38 2022] GET /identity/v3/services/d9ecfdb9356942b6afcad2befbafec4b => generated 113 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:44:38.996700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:38.996700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:38.996931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.023202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:39.025737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:39.165622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1801/3589] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:39.166392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.184425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1739c1f-1298-47e4-a551-483d2a75e199 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.191308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.193791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.198713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.199436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.199836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.200173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.201660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.203882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.226876 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1789/3590] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:39.228555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.261487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30790a60-5253-401c-b083-7a42a4f57d8b service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.281762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.282400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.282723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.283024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.312345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.313916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.340060 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1790/3591] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:39.341921 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1802/3592] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:39 2022] POST /identity/v3/services => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:39.347475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.381724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd37f24-cb33-4fb2-b02e-94bbb9992ab4 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.406221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.406539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.406826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.407102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.408434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.409613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.590251 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1791/3593] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:39 2022] POST /identity/v3/services => generated 273 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:44:39.599556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.614583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1dd27b-0441-43c3-9057-a2c387230d27 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.662098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.662741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.663018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.663292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.663941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.665853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:39.876771 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1803/3594] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:39 2022] POST /identity/v3/services => generated 275 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:39.889646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:39.909153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e046b63-fe59-4f8e-a2e3-c1b3b13c3473 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:39.928963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:39.960227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:39.960887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:39.961338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:39.961743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:39.963789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:39.967681 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:39.967681 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:44:39.967681 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:44:39.971250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.004716 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1792/3595] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:44:39 2022] GET /identity/v3/services => generated 2978 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:40.009794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.027817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ffbbb-0ec1-4cb5-97c9-c4ce974c74e3 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.043969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.044710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.044990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.045331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.046091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1856978767) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:40.046451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.047941 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:44:40.047941 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:44:40.047941 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:44:40.050029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.066305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1804/3596] 10.222.0.64 () {58 vars in 1222 bytes} [Wed Nov 2 12:44:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1856978767 => generated 418 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:40.071505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.099173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11c01a-c863-41a5-9ed4-458bed50d86f tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.115538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.117199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.119048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.127398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.127638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-984217744) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:40.128092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.131061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.142745 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1793/3597] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Nov 2 12:44:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-984217744 => generated 415 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:40.146473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.162210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010a93b-aca5-45f2-9744-248ebbc77d56 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.175005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.182174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.185956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.186519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.187448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1361124108) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:40.189230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.197527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.236093 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1805/3598] 10.222.0.64 () {58 vars in 1222 bytes} [Wed Nov 2 12:44:40 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1361124108 => generated 418 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:40.239837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.257943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f581f57-cb2d-4c6d-a4c4-d2030dce4c46 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.278906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.279569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.279846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.280119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/8a5f51063b8e470d95a3ced3785f093f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.280734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8a5f51063b8e470d95a3ced3785f093f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.282381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.478996 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1794/3599] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:40 2022] DELETE /identity/v3/services/8a5f51063b8e470d95a3ced3785f093f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:40.483619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.507947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97a23-f5a9-4f0e-932a-f301801524cd tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.590516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.592365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.597042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.599194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/279fa758e811468995895e3166f62897` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.602430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:delete_service(service_id=279fa758e811468995895e3166f62897)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.607724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:40.729506 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1806/3600] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:40 2022] DELETE /identity/v3/services/279fa758e811468995895e3166f62897 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:40.733773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:40.748942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223dc06-f0cb-4609-b485-84413baa77de tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:40.821362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa8a88807a284d00bf3e110517fc96ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5fb649351044cc4ba522e4311970e15', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:40.822107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:40.822401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:40.822663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] PATH_INFO: `/v3/services/8913d8807be445ccacd7ca8b3eb4dc35` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:40.823250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8913d8807be445ccacd7ca8b3eb4dc35)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:40.824886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916a9ad-aa6d-4564-8c96-cc5e593e7a3c tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:41.096668 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1795/3601] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:40 2022] DELETE /identity/v3/services/8913d8807be445ccacd7ca8b3eb4dc35 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:41.097064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:41.097064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:41.097064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dab353-c1c4-44e8-a04b-2249f38a6052 tempest-ServicesTestJSON-143578800 tempest-ServicesTestJSON-143578800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:41.125100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:41.126178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:41.126647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:41.127101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] PATH_INFO: `/v3/users/2294c9c291fd4435a18c212f5cbd6705` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:41.128955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2294c9c291fd4435a18c212f5cbd6705)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:41.131735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:41.400223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2294c9c291fd4435a18c212f5cbd6705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:41.527876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2294c9c291fd4435a18c212f5cbd6705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:41.548296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2294c9c291fd4435a18c212f5cbd6705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:41.549323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2294c9c291fd4435a18c212f5cbd6705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:41.550284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2294c9c291fd4435a18c212f5cbd6705'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:41.582973 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1807/3602] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:41 2022] DELETE /identity/v3/users/2294c9c291fd4435a18c212f5cbd6705 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:41.584004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:41.584307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:41.584644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:41.651510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:41.661197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:41.753821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:41.830448 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1796/3603] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:41.855204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:41.857341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:42.094419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53075578-fccf-45e3-8a04-d0e5d2002e78 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:42.105203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:42.106652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:42.106652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:42.106652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:42.144171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:42.145970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:42.176642 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1808/3604] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:43.130870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:43.524813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:43.675878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:43.678584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:43.694950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277a487-74ec-4d99-9d66-6da40ca35f18 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:43.714869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:43.715863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:43.716381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:43.716880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] PATH_INFO: `/v3/projects/f1172bb613284b959b8fabf9acd9a906` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:43.718343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1172bb613284b959b8fabf9acd9a906)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:43.720814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:44.211349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1172bb613284b959b8fabf9acd9a906', 'request_id': 'req-4cf09861-191a-4940-a28e-1a32cc26fd71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:44.251827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1172bb613284b959b8fabf9acd9a906', 'request_id': 'req-4cf09861-191a-4940-a28e-1a32cc26fd71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:44.251827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1172bb613284b959b8fabf9acd9a906', 'request_id': 'req-4cf09861-191a-4940-a28e-1a32cc26fd71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:44.642492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] The token cache is being invalidate because project f1172bb613284b959b8fabf9acd9a906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:44.643015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:44.643805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:44.650114 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1797/3605] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:43 2022] DELETE /identity/v3/projects/f1172bb613284b959b8fabf9acd9a906 => generated 0 bytes in 971 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:44.650254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:44.663379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39e95-cb34-49c3-a573-20e99c48040e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:44.827623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:44.835580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:44.836000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:44.836166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] PATH_INFO: `/v3/users/fa8a88807a284d00bf3e110517fc96ac` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:44.857844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8a88807a284d00bf3e110517fc96ac)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:44.857844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:45.199723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:45.202469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:45.222213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8a88807a284d00bf3e110517fc96ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.231705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf09861-191a-4940-a28e-1a32cc26fd71 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:45.239370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:45.240072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:45.240353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:45.240826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] PATH_INFO: `/v3/users/8fc9b2638f1f4af7acb932cdfdc0d4d5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:45.242709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc9b2638f1f4af7acb932cdfdc0d4d5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:45.247218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:45.368901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8a88807a284d00bf3e110517fc96ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.387954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8a88807a284d00bf3e110517fc96ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.389217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8a88807a284d00bf3e110517fc96ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.390043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8a88807a284d00bf3e110517fc96ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.415777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1809/3606] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:44 2022] DELETE /identity/v3/users/fa8a88807a284d00bf3e110517fc96ac => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:45.577312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc9b2638f1f4af7acb932cdfdc0d4d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.730634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc9b2638f1f4af7acb932cdfdc0d4d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.763423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc9b2638f1f4af7acb932cdfdc0d4d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.781039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc9b2638f1f4af7acb932cdfdc0d4d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.782615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc9b2638f1f4af7acb932cdfdc0d4d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:45.802148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1798/3607] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:45 2022] DELETE /identity/v3/users/8fc9b2638f1f4af7acb932cdfdc0d4d5 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:45.944354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:46.280882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:46.282805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:46.314086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:46.328713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:46.330515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:46.504175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dab6a1-a443-458f-a178-2b3f762c243f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:46.544555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ece31-0237-435d-afdd-67e64a30b267 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:46.553922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:46.554610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:46.555104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:46.555389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] PATH_INFO: `/v3/projects/609b25c5d73a4866898c08b5b37c063c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:46.561132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609b25c5d73a4866898c08b5b37c063c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:46.563849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:46.598881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:46.599400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:46.599725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:46.600170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] PATH_INFO: `/v3/projects/f5fb649351044cc4ba522e4311970e15` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:46.604866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fb649351044cc4ba522e4311970e15)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:46.610615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:46.747958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609b25c5d73a4866898c08b5b37c063c', 'request_id': 'req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.761345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609b25c5d73a4866898c08b5b37c063c', 'request_id': 'req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.776034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609b25c5d73a4866898c08b5b37c063c', 'request_id': 'req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.851868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fb649351044cc4ba522e4311970e15', 'request_id': 'req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.864534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fb649351044cc4ba522e4311970e15', 'request_id': 'req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.936332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] The token cache is being invalidate because project 609b25c5d73a4866898c08b5b37c063c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:46.936932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.937845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec17fe44-46de-4e3e-b855-8b0f3ac19b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:46.942766 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1799/3608] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:46 2022] DELETE /identity/v3/projects/609b25c5d73a4866898c08b5b37c063c => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:46.952885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056ba2-1270-46ad-9630-21d893396b5b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:46.953493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056ba2-1270-46ad-9630-21d893396b5b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:46.954013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f056ba2-1270-46ad-9630-21d893396b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.022729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5f056ba2-1270-46ad-9630-21d893396b5b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:47.024299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f056ba2-1270-46ad-9630-21d893396b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:47.092006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fb649351044cc4ba522e4311970e15', 'request_id': 'req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:47.123365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] The token cache is being invalidate because project f5fb649351044cc4ba522e4311970e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:47.133009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:47.136194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e30b7d1c-86c3-4824-9d5b-51bcb62a659f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:47.139078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1810/3609] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:46 2022] DELETE /identity/v3/projects/f5fb649351044cc4ba522e4311970e15 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:47.147712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.151105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.153359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.179190 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1800/3610] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:47.181905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee516-db38-4752-86d1-fe248562c950 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.182193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee516-db38-4752-86d1-fe248562c950 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.182468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ee516-db38-4752-86d1-fe248562c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.214894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:47.215570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:47.235008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b77ee516-db38-4752-86d1-fe248562c950 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:47.237499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b77ee516-db38-4752-86d1-fe248562c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:47.244662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1811/3611] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:47.281028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1801/3612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:47.286098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.309250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a8805-9fd9-45f6-a2b7-8de879845374 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:47.325547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:47.332105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.332718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.333163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.335362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:47.335696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:47.339099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:47.350614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.351524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.351946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.359925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1812/3613] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:47.391188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.425402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:47.433904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d2cf9-3d90-4028-972a-79102c8e989e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:47.440073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:47.450665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:47.451297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.451575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.451902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.454341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:47.456299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:47.469079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1802/3614] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:47.472482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.537785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d317e5-6f17-46c5-9587-0f7acaf38b5d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:47.547686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:47.549002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.550149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.550669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.551865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:47.552370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:47.554373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:47.580666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1803/3615] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:47.581910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.596095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01630f-94d4-41b8-b0bd-b6318a96509c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:47.605364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:47.606133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.606482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.606849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.608272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:47.610578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:47.644737 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1813/3616] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/projects => generated 379 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:47.645527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.791562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab3249-ea9e-478e-89d9-d920eabd49b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:47.802148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:47.803215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:47.804382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:47.805081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:47.806293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:47.813731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:47.871070 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1804/3617] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:47.872750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:47.998490 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1814/3618] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:48.003751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.046998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75482161-0587-4568-9126-86c4207ff0a5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.119687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f202451-746f-4c50-96db-faabf04624eb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.123616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:48.133167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.134436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.134718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.135006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.135771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.138675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.264358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.269108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.269330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.269602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.276011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.281398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.305221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1815/3619] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:48.310655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.329276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1805/3620] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:47 2022] POST /identity/v3/users => generated 286 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:48.329541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eff2b2-8a53-43f2-a4c4-f09ea240a677 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.332896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.336879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.337545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.338185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.338480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.339224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.340995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.347268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f961e-ff8b-4fb8-9320-a1acaf87e12d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.355570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.356634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.357063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.357283 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1816/3621] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:48.357555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.358316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.358427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.360714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.373562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bb8d6-a458-4ec1-9037-918199f64010 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.375167 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1806/3622] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:48.379358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.382858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.383988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.385761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.386235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] PATH_INFO: `/v3/projects/48e7348010084007a1f39fd226ff05d9/users/6ba62c421ca94a938534b56430fddd85/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.397416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229a6b1-8358-41f2-8f06-b767b5a2597e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.404924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.405548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.405820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.406087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.407187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.409166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.415470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e7348010084007a1f39fd226ff05d9, user_id=6ba62c421ca94a938534b56430fddd85, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.418560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d34e9-5148-4715-a558-89e30a730a34 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.432677 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1807/3623] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:44:48.438260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.453646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136dd6e5-d329-4b91-93f9-383c46ecfc46 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.467540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.468598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.468929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.469170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] PATH_INFO: `/v3/projects/118f11154ca24855b3e323db49f76185/users/995303db577b4cccae8265027720c5e5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.498927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118f11154ca24855b3e323db49f76185, user_id=995303db577b4cccae8265027720c5e5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.505241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455c6c3-9eea-4f30-b2da-3b4d3f2b6ec5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.574942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1817/3624] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:48 2022] PUT /identity/v3/projects/48e7348010084007a1f39fd226ff05d9/users/6ba62c421ca94a938534b56430fddd85/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:48.581926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.582504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.582780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.626004 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1808/3625] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:48 2022] PUT /identity/v3/projects/118f11154ca24855b3e323db49f76185/users/995303db577b4cccae8265027720c5e5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:48.636434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.636858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.637232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.642184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:48.644642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:48.702000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] MFA Rules not processed for user `995303db577b4cccae8265027720c5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:48.705721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:48.724412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:48.810787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1818/3626] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:48.819296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.820908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:48.920106 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1809/3627] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:48.922392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.940382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8cdbc-63a1-4dd0-8e89-c5667f7e2335 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:48.957288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '995303db577b4cccae8265027720c5e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '118f11154ca24855b3e323db49f76185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:48.957933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:48.959846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:48.960820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:48.961433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:48.966459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:48.975994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1810/3628] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:48.981586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:48.989068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10849df8-3f34-42ac-a9d1-d77748e496bb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:49.000536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:49.001168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.001451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.001727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.017918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097cb17-f15f-4bc5-ae82-adb832df5f0e tempest-IdentityCatalogTest-63254190 tempest-IdentityCatalogTest-63254190-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:49.022536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:49.024335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b859ba-17ea-4219-a14e-90e956f4dac5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:49.046676 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1819/3629] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:49.058089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:49.058863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.059156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.059531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] PATH_INFO: `/v3/users/995303db577b4cccae8265027720c5e5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.061360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] RBAC: Authorizing `identity:delete_user(user_id=995303db577b4cccae8265027720c5e5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:49.066728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:49.670663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c1a3-58f1-4328-abc1-239d42caaf23 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.671235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c1a3-58f1-4328-abc1-239d42caaf23 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.671320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8c1a3-58f1-4328-abc1-239d42caaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.721836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995303db577b4cccae8265027720c5e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:49.760737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2fa8c1a3-58f1-4328-abc1-239d42caaf23 None None] MFA Rules not processed for user `bdf29c3b6214410aafdcb41a23ce317a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:49.762055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2fa8c1a3-58f1-4328-abc1-239d42caaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:49.918225 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1820/3630] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:49.919911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:49.920200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:49.920477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:49.942004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] MFA Rules not processed for user `12efbd6f761d49ceb86b035b48c47c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:49.945396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:50.062716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995303db577b4cccae8265027720c5e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:50.160364 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1821/3631] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:50.163954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995303db577b4cccae8265027720c5e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:50.174051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995303db577b4cccae8265027720c5e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:50.175209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18663f82-3ae8-462c-82af-3345c670847c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995303db577b4cccae8265027720c5e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:50.180072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:50.182546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:50.187269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1811/3632] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:48 2022] DELETE /identity/v3/users/995303db577b4cccae8265027720c5e5 => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:50.191645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:50.192085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:50.192355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:50.236873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:50.241803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:50.443243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04ac7a-3ba4-4de8-b9ec-b11728d44694 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:50.443655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1812/3633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:50.451510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:50.453046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:50.653215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f82da-edd2-4c23-98c1-f878284a0569 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:50.669627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:50.670488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:50.670488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:50.670488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:50.670488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:50.671031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:50.671031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:50.671031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:50.672341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:50.690545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:50.703522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:50.727821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1813/3634] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:50.827512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:50.829212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce7bcd-b3d1-4d45-b031-48840a5e05e6 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:50.860246 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1822/3635] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:50.971486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:50.973544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:51.160763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20865ee8-0a2a-4065-aca6-61af67af1b41 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:51.165709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:51.166439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:51.166716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:51.167023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:51.178667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:51.220410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:51.223333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:51.260935 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1814/3636] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:51.631380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:51.685832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add357fa-aff8-4ba6-8cb4-1c259f00af80 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:51.686387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add357fa-aff8-4ba6-8cb4-1c259f00af80 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:51.686902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add357fa-aff8-4ba6-8cb4-1c259f00af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-add357fa-aff8-4ba6-8cb4-1c259f00af80 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:44:51.695990 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:44:51.698003 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:44:51.740399 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1823/3637] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:44:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:44:52.110491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:52.112886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:52.140833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb274-a5dd-4345-9ec0-de77303d688e service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:52.156187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:52.157524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:52.158941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:52.162595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] PATH_INFO: `/v3/projects/118f11154ca24855b3e323db49f76185` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:52.168417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118f11154ca24855b3e323db49f76185)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:52.170843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:52.410339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118f11154ca24855b3e323db49f76185', 'request_id': 'req-749851fa-3c51-4245-881c-a3cdd15731d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:52.432740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118f11154ca24855b3e323db49f76185', 'request_id': 'req-749851fa-3c51-4245-881c-a3cdd15731d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:52.456250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118f11154ca24855b3e323db49f76185', 'request_id': 'req-749851fa-3c51-4245-881c-a3cdd15731d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:52.621347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] The token cache is being invalidate because project 118f11154ca24855b3e323db49f76185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:52.624545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:52.624545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-749851fa-3c51-4245-881c-a3cdd15731d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:52.626424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1815/3638] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:52 2022] DELETE /identity/v3/projects/118f11154ca24855b3e323db49f76185 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:52.632395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb987-d029-4b49-8689-bf138770040d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:52.633030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb987-d029-4b49-8689-bf138770040d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:52.633628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87eb987-d029-4b49-8689-bf138770040d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:52.673519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a87eb987-d029-4b49-8689-bf138770040d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:52.675158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a87eb987-d029-4b49-8689-bf138770040d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:52.828136 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1824/3639] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:44:52.830724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:52.831009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:52.831843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:52.879665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:52.883598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:52.896170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:52.903521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1816/3640] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:52.908225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eb987-d029-4b49-8689-bf138770040d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:52.928795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87eb987-d029-4b49-8689-bf138770040d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:52.946206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:52.946870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:52.947149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:52.947420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:52.948094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:52.948396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:52.950473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:52.979465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1825/3641] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:52.984248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:52.995219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ebd3a-ec73-46a3-8b7f-addbacf5302d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:53.010452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:53.016641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.016641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.016641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.016641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:53.016641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:53.160464 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1817/3642] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:52 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:53.162710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:53.174177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd267b8-0524-4b97-b1ca-a80475a418fa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:53.349872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:53.351836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.354266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.358304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.360528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:53.363481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:53.573379 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1826/3643] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:53 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:53.577473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:53.596040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cdf9c-bc5a-4827-bc6b-59a9c9a32aff admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:53.614579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:53.618793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.620141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.620141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.621444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:53.626650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:53.661331 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1818/3644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:53.669154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:53.686375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe511-6ddd-44c5-b7c4-57bf29db8652 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:53.699174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:53.699824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.700108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.700724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.701571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:53.703412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406373d6-6c2b-446b-9904-5d88811e77d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:53.742599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:53.745264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1827/3645] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:44:53.759404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817e693-54e3-46b1-a274-c6a973f11ae3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:53.774874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:53.775899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:53.776367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:53.776913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] PATH_INFO: `/v3/projects/5ed3a076aa8641938569bf322fc6a616/users/a98420ad739a4209b31ef9ff55af54f1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:53.797583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed3a076aa8641938569bf322fc6a616, user_id=a98420ad739a4209b31ef9ff55af54f1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:53.800901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:54.005986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:54.007359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:54.007884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:54.017269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1819/3646] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:44:53 2022] PUT /identity/v3/projects/5ed3a076aa8641938569bf322fc6a616/users/a98420ad739a4209b31ef9ff55af54f1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:44:54.080667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] MFA Rules not processed for user `a98420ad739a4209b31ef9ff55af54f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:54.082042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:54.228927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1828/3647] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:54.233463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:54.247993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829be139-4d09-4b15-b33a-b90dfbaaca5d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:54.253196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a98420ad739a4209b31ef9ff55af54f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ed3a076aa8641938569bf322fc6a616', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:54.254102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:54.254433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:54.254931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] PATH_INFO: `/v3/domains/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:54.256425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:54.259459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f9ca1-94b8-4ea4-a2b5-ee622366cc4f tempest-DefaultDomainTestJSON-2022562667 tempest-DefaultDomainTestJSON-2022562667-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:54.262435 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1820/3648] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:44:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:44:54.267193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:54.469852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c5308-36f1-41bb-a6ab-0f47c21f9b91 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:54.497811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:54.497811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:54.497811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:54.497811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] PATH_INFO: `/v3/users/a98420ad739a4209b31ef9ff55af54f1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:54.499746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98420ad739a4209b31ef9ff55af54f1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:54.502030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:54.973695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98420ad739a4209b31ef9ff55af54f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:55.103587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98420ad739a4209b31ef9ff55af54f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:55.150974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98420ad739a4209b31ef9ff55af54f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:55.152264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98420ad739a4209b31ef9ff55af54f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:55.153294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98420ad739a4209b31ef9ff55af54f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:55.185338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1829/3649] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:44:54 2022] DELETE /identity/v3/users/a98420ad739a4209b31ef9ff55af54f1 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:55.190950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:55.191633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:55.192876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:55.280796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:55.283699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:55.373901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:55.502164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1821/3650] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:55.712986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:55.714861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:55.846502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bc502-ff12-4f5f-a6fd-195fcf9091ce admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:55.859728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:55.863178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:55.863640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:55.863950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:55.879342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:55.890221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8f2bc-2095-465c-8c90-a9908a70f4e7 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:55.918665 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1830/3651] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:56.212053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:58.269941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:58.553562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:58.677154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:58.680219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:58.724405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7911d7e-18cb-4bfa-b0dc-416c214f2f8c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:58.749329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:58.754021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:58.754472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:58.757290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] PATH_INFO: `/v3/projects/5ed3a076aa8641938569bf322fc6a616` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:58.759962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed3a076aa8641938569bf322fc6a616)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:58.778269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:58.989819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:59.105550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed3a076aa8641938569bf322fc6a616', 'request_id': 'req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:59.125370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed3a076aa8641938569bf322fc6a616', 'request_id': 'req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:59.139964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed3a076aa8641938569bf322fc6a616', 'request_id': 'req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:59.298504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] The token cache is being invalidate because project 5ed3a076aa8641938569bf322fc6a616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:44:59.300609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:59.304521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4ce69f8-d8d3-4862-8725-5f7e8e38e765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:44:59.311841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.312205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.312584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.321743 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1822/3652] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:44:58 2022] DELETE /identity/v3/projects/5ed3a076aa8641938569bf322fc6a616 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:44:59.355082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:59.358643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:59.589808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1831/3653] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:59.598644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.598937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.599582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.643881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:44:59.645286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:44:59.672683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:59.687477 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1823/3654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:44:59.688229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bfc8b-b5d2-468c-bcf3-af1f2ab17bf5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:59.700756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:59.704789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.705130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.705404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.706124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:44:59.706431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:59.709397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:59.749979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:59.759352 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1832/3655] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:44:59.770333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30272-2798-4bbd-8a6e-29afd83c6dde None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:44:59.777850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:44:59.780020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:44:59.782855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:44:59.783417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:44:59.785928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:44:59.786696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:59.791433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:44:59.938727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1824/3656] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:44:59.943138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:44:59.961381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f93f6-c725-4c32-80a5-39caa488c868 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:00.137210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:00.137850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:00.141233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:00.141730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:00.142573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:00.144929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:00.331936 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1833/3657] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:44:59 2022] POST /identity/v3/users => generated 286 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:00.335951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:00.354949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0617e7-8a19-4f4f-a9a4-a6bce45e8813 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:00.370900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:00.372623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:00.372623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:00.374603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:00.376607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:00.386256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:00.421403 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1825/3658] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:45:00.426049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:00.445838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472641c-14ad-4853-a307-1f5d94ba9c80 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:00.466367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:00.472677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:00.477073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:00.478206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:00.479206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:00.481187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3683d6-87bf-45c3-8054-a6eb331a94c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:00.510815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:00.516911 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1834/3659] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:00.533866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531bfcd-fd59-4315-a264-f4ef7e4e9c0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:00.551615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:00.553266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:00.557413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:00.558014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] PATH_INFO: `/v3/projects/365be44ca75e403d84cec93fbaa4a9b0/users/dd689b62b48b46d09021f445075d2db1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:00.579859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:00.597545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365be44ca75e403d84cec93fbaa4a9b0, user_id=dd689b62b48b46d09021f445075d2db1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:00.606549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:00.802052 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1826/3660] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:00 2022] PUT /identity/v3/projects/365be44ca75e403d84cec93fbaa4a9b0/users/dd689b62b48b46d09021f445075d2db1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:00.804731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:00.805316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:00.806067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:00.873134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] MFA Rules not processed for user `dd689b62b48b46d09021f445075d2db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:00.874795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:01.046543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1835/3661] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:01.047311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.068788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495038fc-6be6-4047-b0ac-05d0c2ccc472 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.076535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.080054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.080703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.081197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.082914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:01.090030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:01.231805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1827/3662] 10.222.0.64 () {60 vars in 1299 bytes} [Wed Nov 2 12:45:01 2022] POST /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:01.236704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.253389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6734c0e-6ac3-4db2-8ad2-c2a8aaa8ea69 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.268572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.269277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.270253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.270556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/749b04f6d9b4475aac77b12d5867f811` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.275883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=749b04f6d9b4475aac77b12d5867f811)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:01.277706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:01.391613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:01.447245 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1836/3663] 10.222.0.64 () {58 vars in 1380 bytes} [Wed Nov 2 12:45:01 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/749b04f6d9b4475aac77b12d5867f811 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:45:01.453344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.472732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcbb2f-b231-4d8c-b69b-8d789ee2222d tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.485384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.487873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.490355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.490954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.491761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:01.499742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:01.672856 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1828/3664] 10.222.0.64 () {60 vars in 1299 bytes} [Wed Nov 2 12:45:01 2022] POST /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:01.676447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.689858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36c853-b463-4675-a0b6-28a61d431acc tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.701943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.703369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.703830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.704267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/d682b79945de44b7a45fcef81537dbf9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.710190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=d682b79945de44b7a45fcef81537dbf9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:01.712365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:01.881482 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1837/3665] 10.222.0.64 () {58 vars in 1380 bytes} [Wed Nov 2 12:45:01 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/d682b79945de44b7a45fcef81537dbf9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:01.883199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.900904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd351d-a0ce-4c3b-b5a7-b0957f56d387 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.909330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.910292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.910764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.911184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/d682b79945de44b7a45fcef81537dbf9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Could not find credential: 2631e3f9482ed3727411ee3231591fb1faeda02cc87fc788ce069e1c2741a0a3.: keystone.exception.CredentialNotFound: Could not find credential: 2631e3f9482ed3727411ee3231591fb1faeda02cc87fc788ce069e1c2741a0a3. Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Nov 02 12:45:01.954387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:45:01.958062 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 2631e3f9482ed3727411ee3231591fb1faeda02cc87fc788ce069e1c2741a0a3. Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:45:01.958994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1829/3666] 10.222.0.64 () {58 vars in 1377 bytes} [Wed Nov 2 12:45:01 2022] GET /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/d682b79945de44b7a45fcef81537dbf9 => generated 148 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:45:01.962337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:01.976684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe85e-15a2-4644-8f61-660470c502eb tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:01.988826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:01.992037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:01.992037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:01.992037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:01.992037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:01.996573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.136847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1838/3667] 10.222.0.64 () {60 vars in 1299 bytes} [Wed Nov 2 12:45:01 2022] POST /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:02.137711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.154296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51932dce-4cc5-493c-90d5-999f5b1646f8 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.171799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.173162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.173724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.174158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.175461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.177186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.319451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1830/3668] 10.222.0.64 () {60 vars in 1299 bytes} [Wed Nov 2 12:45:02 2022] POST /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:45:02.326036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.339727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9055e-14e2-4ceb-9461-2c6ab23b6f15 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.351118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.351871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.352218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.353200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.353901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.356863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.392923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1839/3669] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 12:45:02 2022] GET /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 865 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:02.398807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.413798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb8517-b557-493a-8596-0b0f91344fd9 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.436882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.437778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.438295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.439397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/cac95bdebed74afbba5c08c267af019c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.444090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=cac95bdebed74afbba5c08c267af019c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.447410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.617647 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1831/3670] 10.222.0.64 () {58 vars in 1380 bytes} [Wed Nov 2 12:45:02 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/cac95bdebed74afbba5c08c267af019c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:02.622507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.637937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ff303-ddfd-4464-b081-a2ac8f4d0fe2 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.667719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.668957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.669570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.670089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/91abf28be8794e55a94e3e6878949c3c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.673054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=91abf28be8794e55a94e3e6878949c3c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.675761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:02.820562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1840/3671] 10.222.0.64 () {58 vars in 1380 bytes} [Wed Nov 2 12:45:02 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/91abf28be8794e55a94e3e6878949c3c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:02.827818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:02.849588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5dc940-26ee-4157-bf8a-72b18eabcb0c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:02.861855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:02.862332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:02.867024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:02.867024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:02.867024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:02.867024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:03.025367 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1832/3672] 10.222.0.64 () {60 vars in 1299 bytes} [Wed Nov 2 12:45:02 2022] POST /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2 => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:03.036121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:03.056050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d130-de5b-48ca-b08e-90151566451c tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:03.070741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:03.072023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:03.072370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:03.072712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/0fce53033e074126b583b4b071159a4d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:03.082041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=0fce53033e074126b583b4b071159a4d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:03.084088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:03.089260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1841/3673] 10.222.0.64 () {58 vars in 1377 bytes} [Wed Nov 2 12:45:03 2022] GET /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/0fce53033e074126b583b4b071159a4d => generated 367 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:03.093508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:03.114372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49b4f0-7794-4403-8837-5cdbaa17d358 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:03.127688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd689b62b48b46d09021f445075d2db1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '365be44ca75e403d84cec93fbaa4a9b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:03.128461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:03.128789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:03.129403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/0fce53033e074126b583b4b071159a4d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:03.135477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=dd689b62b48b46d09021f445075d2db1, credential_id=0fce53033e074126b583b4b071159a4d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:03.144777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283324b-7dfa-46ab-8063-e94b50a9ad8e tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:03.324811 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1833/3674] 10.222.0.64 () {58 vars in 1380 bytes} [Wed Nov 2 12:45:03 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1/credentials/OS-EC2/0fce53033e074126b583b4b071159a4d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:03.334033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:03.480229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:03.611047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad923ca4-7df0-47bc-981b-db1451f44446 tempest-EC2CredentialsTest-376729601 tempest-EC2CredentialsTest-376729601-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:03.628088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:03.634358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:03.634358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:03.634358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] PATH_INFO: `/v3/users/dd689b62b48b46d09021f445075d2db1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:03.636332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd689b62b48b46d09021f445075d2db1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:03.638794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:04.069901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd689b62b48b46d09021f445075d2db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:04.085000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:04.185931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd689b62b48b46d09021f445075d2db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:04.254337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd689b62b48b46d09021f445075d2db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:04.257129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd689b62b48b46d09021f445075d2db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:04.261512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd689b62b48b46d09021f445075d2db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:04.390974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c552f-6623-4608-b3e9-3ba2f9ad14f0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:04.392688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c552f-6623-4608-b3e9-3ba2f9ad14f0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:04.393446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c552f-6623-4608-b3e9-3ba2f9ad14f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:04.398817 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1842/3675] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:03 2022] DELETE /identity/v3/users/dd689b62b48b46d09021f445075d2db1 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:04.470848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5c6c552f-6623-4608-b3e9-3ba2f9ad14f0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:04.480899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c6c552f-6623-4608-b3e9-3ba2f9ad14f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:04.846135 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1834/3676] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:04.999940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:05.001593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:05.122736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:05.157550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:05.237241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a118531-79af-4bf9-b0c4-521e168335a5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:05.250895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:05.251791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.252256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.252718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.321926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:05.323626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1764320-96cc-424c-8e2e-08d3555fb859 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:05.367255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1843/3677] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:05.875995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:05.876419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:05.876845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:05.918712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] MFA Rules not processed for user `e1fd343aed7f4afa811a5a04837e8bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:05.920449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.010764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.094647 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1835/3678] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:06.102992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f086d6-7f26-4608-8aba-b41426717475 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:06.104374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f086d6-7f26-4608-8aba-b41426717475 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:06.105091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f086d6-7f26-4608-8aba-b41426717475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:06.129288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f9f086d6-7f26-4608-8aba-b41426717475 None None] MFA Rules not processed for user `e1fd343aed7f4afa811a5a04837e8bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:06.131572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9f086d6-7f26-4608-8aba-b41426717475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.145869 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1844/3679] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:06.154525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:06.155835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.279016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.319943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:06.320773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:06.321776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:06.392788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9138f7-28dd-4577-85d4-bd082ae9fea1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:06.400857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:06.401985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:06.402415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:06.402907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:06.413293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:06.414415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] MFA Rules not processed for user `e92466fea4504554b1bda7cea02b45a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:06.415753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.416533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931c2b94-43f0-4783-a47e-ccfe9739013b service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:06.429627 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1836/3680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:06.594008 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1845/3681] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:06.604359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:06.604652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:06.604907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:06.659452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] MFA Rules not processed for user `e92466fea4504554b1bda7cea02b45a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:06.667073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.689903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1837/3682] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:06.701673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:06.703115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:06.736848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752914e-f60b-49e2-bf58-0e55cbd0e9cf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:06.757481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:06.759032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:06.759496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:06.759773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:06.777718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:06.779380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1fd8e-a356-449f-88ed-540b7f55c73c service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:06.813524 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1846/3683] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:07.017882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:07.022928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:07.062935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45e4f8-dba3-4f03-8087-46b3bf3b254d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:07.080655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:07.081749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.082296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.086641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] PATH_INFO: `/v3/projects/365be44ca75e403d84cec93fbaa4a9b0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.092007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365be44ca75e403d84cec93fbaa4a9b0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:07.094422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:07.386209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365be44ca75e403d84cec93fbaa4a9b0', 'request_id': 'req-e7686e6e-a500-4a1c-8e22-5debfce049e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:07.413568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365be44ca75e403d84cec93fbaa4a9b0', 'request_id': 'req-e7686e6e-a500-4a1c-8e22-5debfce049e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:07.466266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365be44ca75e403d84cec93fbaa4a9b0', 'request_id': 'req-e7686e6e-a500-4a1c-8e22-5debfce049e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:07.649027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] The token cache is being invalidate because project 365be44ca75e403d84cec93fbaa4a9b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:07.649564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:07.651973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e7686e6e-a500-4a1c-8e22-5debfce049e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:07.657480 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1838/3684] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:07 2022] DELETE /identity/v3/projects/365be44ca75e403d84cec93fbaa4a9b0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:07.662125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.663122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.663547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.709739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:07.710992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:07.849851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1847/3685] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:07.850820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280b88a-f5bc-4ff0-93c6-9cb424371526 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.851104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280b88a-f5bc-4ff0-93c6-9cb424371526 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.851984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280b88a-f5bc-4ff0-93c6-9cb424371526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.906084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7280b88a-f5bc-4ff0-93c6-9cb424371526 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:07.908448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7280b88a-f5bc-4ff0-93c6-9cb424371526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:07.938011 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1839/3686] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:07.940959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:07.959689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3139e9-f4e0-4339-b144-ac31b8459b47 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:07.971979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:07.972947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:07.980183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:07.982718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:07.984629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:07.989302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:07.992017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:08.016558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.016921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.017223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.034344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1848/3687] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:45:08.038900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:08.039433 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:08.041176 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:45:08.044297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1840/3688] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:45:08.083748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a904c-1748-456b-889b-70a4484c703d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:08.084617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:08.100553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:08.105897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.106262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.106519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.107351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:08.114139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:08.247355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1849/3689] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:08 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:45:08.251938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:08.388438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:08.496468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301702e7-eee5-4643-a0ab-eb5d476b276f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:08.523265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:08.529439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.530252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.533633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.537347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:08.554742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:08.713931 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1841/3690] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:08 2022] POST /identity/v3/users => generated 300 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:08.720748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:08.752162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27266a5d-9eb5-4764-ad76-3a149d392064 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:08.770290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:08.771121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.771513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.771903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.772711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:08.775451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056796c8-ef4e-4dcb-98b6-9e2732a6a29a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:08.804598 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1850/3691] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:08.818549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:08.858508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49868df-978e-401d-8909-a5dde7b02edc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:08.875936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:08.877486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:08.879202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:08.882840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] PATH_INFO: `/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39/users/7c1edda1c5014c03a7f8edbb6f88eab8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:08.972022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a015c7f36ae4cf0a2e3d89f39394a39, user_id=7c1edda1c5014c03a7f8edbb6f88eab8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:08.985561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:09.029776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:09.029776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:09.030153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:09.049220 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:09.050310 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:45:09.055093 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1851/3692] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:09.133458 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1842/3693] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:08 2022] PUT /identity/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39/users/7c1edda1c5014c03a7f8edbb6f88eab8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:45:09.136087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:09.357235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e6699-e2f2-42f2-b111-9d975ddb77d5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:09.373441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:09.374256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:09.374652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:09.375150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:09.375928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:09.377767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4bf91-e767-4502-a9db-f0551ee4bb02 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:09.401219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1852/3694] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:09.405916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:09.454637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fe4b6-7278-4042-b2e5-dfbfdad4acce admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:09.482235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:09.482997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:09.488752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:09.489077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] PATH_INFO: `/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39/users/7c1edda1c5014c03a7f8edbb6f88eab8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:09.494648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a015c7f36ae4cf0a2e3d89f39394a39, user_id=7c1edda1c5014c03a7f8edbb6f88eab8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:09.502375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774b00-327e-45d6-8eda-2406b7a188d7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:09.544569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1843/3695] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:09 2022] PUT /identity/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39/users/7c1edda1c5014c03a7f8edbb6f88eab8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:09.569632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:09.570188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:09.570575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:09.631858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] MFA Rules not processed for user `7c1edda1c5014c03a7f8edbb6f88eab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:09.633897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:09.809975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985619d3-3035-4919-8393-21623d595b93 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:09.809975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985619d3-3035-4919-8393-21623d595b93 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:09.809975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985619d3-3035-4919-8393-21623d595b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:09.839325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:09.886747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-985619d3-3035-4919-8393-21623d595b93 None None] MFA Rules not processed for user `a10dacce8dd54fdfa16778aefa38e43e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:09.888101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-985619d3-3035-4919-8393-21623d595b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:09.896652 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1853/3696] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:09.904018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.096686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1844/3697] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:10.097660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d622b5-a618-4e91-903e-7e4617636829 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.103823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.104705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.106627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.107174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.107655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.114333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.114934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.116456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.126768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.147899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:10.159441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] MFA Rules not processed for user `a10dacce8dd54fdfa16778aefa38e43e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:10.162958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:10.182871 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1845/3698] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:10.197147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.199292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:10.302159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49460a5-6714-42d9-8416-7a8d2e387a1a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.316422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.317637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.318185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.318666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.338119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1854/3699] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:09 2022] POST /identity/v3/projects => generated 387 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:10.341196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.343360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.344823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.387889 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1846/3700] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:10.437571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.439332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:10.597403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fba19-d936-49ac-a079-293b494d2d27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.609632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.613530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.613988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.614291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.615343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.623941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.636147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea17dc0-fc6a-45b3-bb80-75f680d17ba4 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.766751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1855/3701] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:10 2022] POST /identity/v3/users => generated 294 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:10.768749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.781809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.781967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.782351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.783556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.789486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:10.806970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320496a9-7cfe-4541-8d5b-9d45ef050a0e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.816344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.817235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.817667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.818506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.819611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.823108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.845241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1856/3702] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:10.850867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:10.894009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb63c13-1466-42b6-b899-d64b11d2585e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:10.923941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:10.925577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:10.926043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:10.930449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:10.932206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:10.934559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:10.971681 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1857/3703] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:10.989348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:11.000027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71958699-9662-49bb-a299-252d8f443775 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:11.019076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:11.022407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:11.022701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:11.023399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] PATH_INFO: `/v3/projects/d659e7eb4f2c4cd69f694812c3b1a822/users/57e5fa9a677248cba7ee2b63500c06ec/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:11.025683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:11.031519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb181a-82fd-4efe-8969-7d62e85e9e7c service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:11.073231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1847/3704] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:11.077224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d659e7eb4f2c4cd69f694812c3b1a822, user_id=57e5fa9a677248cba7ee2b63500c06ec, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:11.080963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ae20d-076a-4f58-b2c4-61d5dfc7bb7d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:11.199828 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1858/3705] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:10 2022] PUT /identity/v3/projects/d659e7eb4f2c4cd69f694812c3b1a822/users/57e5fa9a677248cba7ee2b63500c06ec/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:11.223546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:11.224452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:11.224903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:11.301758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] MFA Rules not processed for user `57e5fa9a677248cba7ee2b63500c06ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:11.304448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:11.428446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:11.516071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acb3fa-905d-440f-bc7e-642cfac8b004 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:11.516365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acb3fa-905d-440f-bc7e-642cfac8b004 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:11.516705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acb3fa-905d-440f-bc7e-642cfac8b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:11.550912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:11.576348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-77acb3fa-905d-440f-bc7e-642cfac8b004 None None] MFA Rules not processed for user `3e7652bfbb3b4fcea8d7f6bb127176f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:11.577651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-77acb3fa-905d-440f-bc7e-642cfac8b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:11.595762 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1848/3706] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:11.611734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:11.752354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f19cb-1e8c-423a-8409-6f4ade199c9c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:11.769454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:11.770117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:11.770425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:11.778418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:11.798768 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1859/3707] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:11.810992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:11.811592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:11.812031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:11.830208 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:11.831322 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:45:11.836122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1860/3708] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:11.838923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:11.849785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:11.955600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:11.957116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16933-fbb0-43c4-a724-d54c9e2bd9a1 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:11.987514 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1849/3709] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:45:12.085579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c436092-2eef-4e27-afea-4a64c83c0fdb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:12.098424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:12.099305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:12.099743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:12.100174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:12.109268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:12.249805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:12.251670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:12.302196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:12.323705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1861/3710] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:12.705722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:13.998424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:14.168515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:14.169549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:14.170133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:14.260899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] MFA Rules not processed for user `1dea9e27e67b4fd888fb2c4085ec5bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:14.262764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:14.486833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:14.487015 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1850/3711] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:14.489558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:14.666754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56b865-31bb-4a0f-a709-064d96d86e49 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:14.682138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:14.683371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:14.685660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:14.686874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:14.689334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:14.691853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:14.849783 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1862/3712] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:14 2022] POST /identity/v3/projects => generated 383 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:14.851592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:14.866895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db61a83-8f99-4d9d-bbd6-81cbccade79b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.090978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.096343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.098305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.098833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.099831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.108918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.289510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1851/3713] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:14 2022] POST /identity/v3/users => generated 298 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:15.293672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:15.310738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb3837-3ac6-442b-ba8f-e7da780f3316 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.329816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.331147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.332364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.332912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.333823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.339713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.343907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:15.361597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf53812-dd67-4119-be50-f08bbff1d503 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.388256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.418762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.418762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.418762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] PATH_INFO: `/v3/users/7c1edda1c5014c03a7f8edbb6f88eab8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.418762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1edda1c5014c03a7f8edbb6f88eab8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.419797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1863/3714] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:45:15.420427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.426552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:15.450141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d0a19-7849-415f-98bc-29a11ab2206b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.470831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.472707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.473273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.473651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] PATH_INFO: `/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8/users/357efc23c2104794ba7287d22027c35f/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.521584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c33c2fa756405c8ce8db90ae8ca9a8, user_id=357efc23c2104794ba7287d22027c35f, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.532452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.718337 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1864/3715] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:15 2022] PUT /identity/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8/users/357efc23c2104794ba7287d22027c35f/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:45:15.723743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:15.870207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1edda1c5014c03a7f8edbb6f88eab8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:15.895332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e20120-7118-4d34-96b6-2b6135e0626e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:15.913310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:15.914059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:15.914384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:15.915201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:15.916075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:15.917878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:15.935899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:15.975757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1edda1c5014c03a7f8edbb6f88eab8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:15.984728 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1865/3716] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:15.989101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:16.019933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb62118-44cb-45ec-a7b9-e3551a58a7a2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:16.029811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1edda1c5014c03a7f8edbb6f88eab8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:16.039548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:16.045753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.045753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.045753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] PATH_INFO: `/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8/users/357efc23c2104794ba7287d22027c35f/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.045753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c33c2fa756405c8ce8db90ae8ca9a8, user_id=357efc23c2104794ba7287d22027c35f, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:16.048301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7400542a-e7df-4963-9f71-03c0742d2c69 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:16.054961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1edda1c5014c03a7f8edbb6f88eab8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:16.056704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8bf27f54-b8ec-4d66-ba6d-6a25325f6480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1edda1c5014c03a7f8edbb6f88eab8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:16.085656 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1852/3717] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:15 2022] DELETE /identity/v3/users/7c1edda1c5014c03a7f8edbb6f88eab8 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:16.085656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6003-cdf0-4bcc-b5a8-e1429aff9267 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.085656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6003-cdf0-4bcc-b5a8-e1429aff9267 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.085656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e6003-cdf0-4bcc-b5a8-e1429aff9267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.088226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1866/3718] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:15 2022] PUT /identity/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8/users/357efc23c2104794ba7287d22027c35f/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:16.094160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.097875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.098181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.152016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:16.153434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:16.210867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d81e6003-cdf0-4bcc-b5a8-e1429aff9267 None None] MFA Rules not processed for user `6ba62c421ca94a938534b56430fddd85`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:16.218874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d81e6003-cdf0-4bcc-b5a8-e1429aff9267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:16.316330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:16.463004 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1867/3719] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:16.513346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:16.515027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:16.583321 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1853/3720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:16.600653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.601004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.604300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.663279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] MFA Rules not processed for user `6ba62c421ca94a938534b56430fddd85`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:16.665669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:16.676838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1854/3721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:16.690124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:16.691259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5711c9-64a7-4d32-8205-757f8fa11d82 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:16.692752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:16.701366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:16.702109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.702390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.702656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.740843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:16.745870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8152f-df4b-408e-b51e-52729ac51f44 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:16.779586 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1868/3722] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:16.950827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76378f0-d9fa-4913-8b4f-0ca03864c161 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:16.971617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:16.973314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:16.974506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:16.975069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:16.993866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:16.996385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:17.025554 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1855/3723] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:17.861804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:18.307783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:18.308196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:18.308322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:18.317390 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:18.318355 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:45:18.322091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1869/3724] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:18.996157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:19.628704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:19.630182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:19.656690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13d1eb-2b2a-4dd3-beeb-e742aae6a498 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:19.673189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:19.673841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:19.675524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:19.675984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] PATH_INFO: `/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:19.678770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a015c7f36ae4cf0a2e3d89f39394a39)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:19.684985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:19.965379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:19.969316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a015c7f36ae4cf0a2e3d89f39394a39', 'request_id': 'req-a947e802-5d72-4f11-8b18-f407e5d34bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:19.986399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a015c7f36ae4cf0a2e3d89f39394a39', 'request_id': 'req-a947e802-5d72-4f11-8b18-f407e5d34bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:20.011902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a015c7f36ae4cf0a2e3d89f39394a39', 'request_id': 'req-a947e802-5d72-4f11-8b18-f407e5d34bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:20.110817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] The token cache is being invalidate because project 9a015c7f36ae4cf0a2e3d89f39394a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:20.111115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:20.111860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:20.116994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1856/3725] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:19 2022] DELETE /identity/v3/projects/9a015c7f36ae4cf0a2e3d89f39394a39 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:20.118687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:20.120711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:20.279226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:20.295540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:20.297144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:20.298230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:20.299326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] PATH_INFO: `/v3/users/57e5fa9a677248cba7ee2b63500c06ec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:20.301477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e5fa9a677248cba7ee2b63500c06ec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:20.304325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:20.910245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e5fa9a677248cba7ee2b63500c06ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:21.085176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e5fa9a677248cba7ee2b63500c06ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:21.128464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e5fa9a677248cba7ee2b63500c06ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:21.129798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e5fa9a677248cba7ee2b63500c06ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:21.132648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c32bc1a5-87ed-4556-bdd7-2e39d932f18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e5fa9a677248cba7ee2b63500c06ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:21.176582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1870/3726] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:20 2022] DELETE /identity/v3/users/57e5fa9a677248cba7ee2b63500c06ec => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:21.250514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:22.748920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:23.546527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:24.457566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:24.772007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:24.791415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947e802-5d72-4f11-8b18-f407e5d34bac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:25.024932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:25.025896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.026178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.026449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] PATH_INFO: `/v3/projects/d659e7eb4f2c4cd69f694812c3b1a822` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.028919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d659e7eb4f2c4cd69f694812c3b1a822)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:25.031894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:25.135827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:25.317218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd659e7eb4f2c4cd69f694812c3b1a822', 'request_id': 'req-85c9e900-4100-4942-a29f-8ef50d4245e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:25.366670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd659e7eb4f2c4cd69f694812c3b1a822', 'request_id': 'req-85c9e900-4100-4942-a29f-8ef50d4245e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:25.388566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd659e7eb4f2c4cd69f694812c3b1a822', 'request_id': 'req-85c9e900-4100-4942-a29f-8ef50d4245e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:25.490764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] The token cache is being invalidate because project d659e7eb4f2c4cd69f694812c3b1a822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:25.493868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:25.494371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-85c9e900-4100-4942-a29f-8ef50d4245e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:25.497558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1857/3727] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:24 2022] DELETE /identity/v3/projects/d659e7eb4f2c4cd69f694812c3b1a822 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:25.506385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.506672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.506923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.583855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:25.585279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:25.712115 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1871/3728] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:25.722285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.722579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.723424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.760765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:25.762029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:25.777754 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1858/3729] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:25.783395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:25.797404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ed1f-fb44-4b9a-a740-133a249da778 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:25.803960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:25.805708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.806157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.806585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.807422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:25.807900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:25.810134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:25.827249 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1872/3730] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:25.833185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:25.846398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1df6-7103-4215-a299-0c433a251034 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:25.854486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:25.856400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:25.856891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:25.857514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:25.858682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:25.870513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:26.038557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1859/3731] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:25 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:26.051313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:26.067039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ff9d2-b063-4712-bc2e-df96357a3008 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:26.254549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:26.266455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:26.267142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:26.269561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:26.271851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:26.272822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:26.276349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:26.464221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1873/3732] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:26 2022] POST /identity/v3/users => generated 284 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:26.468515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:26.491567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf4377-b234-493f-8154-3f091530d76b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:26.519463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:26.520111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:26.520559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:26.525384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:26.526138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:26.532415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:26.563461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1860/3733] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:26.572263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:26.586719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8358ce-b1bf-4c65-b460-dbcd48df278d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:26.592738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:26.593716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:26.594349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:26.594825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:26.595633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:26.597738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74f9ce-5f3e-44bc-9e66-d4e9fc802143 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:26.642925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1874/3734] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:26.647875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:26.671010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7cc9a-6f9c-4a7d-9891-0368057d804e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:26.691086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:26.691779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:26.692056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:26.692332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] PATH_INFO: `/v3/projects/c4f34284442f4427b734df26d20b15e9/users/08dc2b6c9b2f4d9f86814da28b96df82/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:26.726556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f34284442f4427b734df26d20b15e9, user_id=08dc2b6c9b2f4d9f86814da28b96df82, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:26.733413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:26.875161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1861/3735] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:26 2022] PUT /identity/v3/projects/c4f34284442f4427b734df26d20b15e9/users/08dc2b6c9b2f4d9f86814da28b96df82/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:45:26.886936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:26.887232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:26.887573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:26.970285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] MFA Rules not processed for user `08dc2b6c9b2f4d9f86814da28b96df82`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:26.995904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:27.207535 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1875/3736] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:27.211621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:27.261175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:27.435827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a1d6c-7e58-4d4b-b4fd-85f8f61493fc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:27.435827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:27.435827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:27.435827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:27.437371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:27.437371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:27.437371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:27.646410 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1862/3737] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:27 2022] POST /identity/v3/projects => generated 367 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:27.650458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:27.694387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c7983-180d-433c-876d-e81dad9186d4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:27.856868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:27.857705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:27.857986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:27.858257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:27.858913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:27.861086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:28.118198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:28.118315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1876/3738] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:27 2022] POST /identity/v3/users => generated 284 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:28.135421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc8ad3-a3b3-4f4b-9ce2-87b38873cf9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:28.175351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:28.182192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.184936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.186157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.189890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:28.198273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:28.237350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1863/3739] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:45:28.241747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:28.258902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad4c34-7fc7-4b1e-a9c7-a31181c931d6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:28.272409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:28.273349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.274311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.274739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.275556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:28.277623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52144a65-efeb-463f-b0d3-c59cff78b0ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:28.307623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1877/3740] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:28.308782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:28.341189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134ba55-a06c-4c27-854d-3a970215e73c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:28.383615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:28.385365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.388316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.388706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] PATH_INFO: `/v3/projects/5fa31a3808174625ac3de0006ebcfcf8/users/ce476920b6c440acaa8e176ab9f55091/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.431852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa31a3808174625ac3de0006ebcfcf8, user_id=ce476920b6c440acaa8e176ab9f55091, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:28.438650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:28.673718 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1864/3741] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:28 2022] PUT /identity/v3/projects/5fa31a3808174625ac3de0006ebcfcf8/users/ce476920b6c440acaa8e176ab9f55091/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:28.681808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:28.681808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:28.681808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:28.713093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:28.757923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] MFA Rules not processed for user `ce476920b6c440acaa8e176ab9f55091`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:28.760418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:29.001129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:29.003540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:29.012709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1878/3742] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:29.160304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ece3-dc15-4dc8-99ec-f55e9586ff4a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:29.167972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:29.173243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:29.173243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:29.173243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:29.269860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:29.439956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:29.460473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:29.486038 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1865/3743] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:29.646988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:29.649657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:29.692052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:29.694337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:29.887293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde223ad-d77a-44c8-9db7-c37e100b986f service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:29.894823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:29.896897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:29.896897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:29.896897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] PATH_INFO: `/v3/users/a10dacce8dd54fdfa16778aefa38e43e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:29.898822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10dacce8dd54fdfa16778aefa38e43e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:29.904956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:29.916526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e33e10-5a32-4d21-ae23-3e54e47fb920 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:29.937623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:29.938607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:29.939273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:29.939723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] PATH_INFO: `/v3/users/e1fd343aed7f4afa811a5a04837e8bc4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:29.947453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fd343aed7f4afa811a5a04837e8bc4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:29.955024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:29.975519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:30.291073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fd343aed7f4afa811a5a04837e8bc4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.303211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10dacce8dd54fdfa16778aefa38e43e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.439013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fd343aed7f4afa811a5a04837e8bc4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.478556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fd343aed7f4afa811a5a04837e8bc4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.481077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fd343aed7f4afa811a5a04837e8bc4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.481985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fd343aed7f4afa811a5a04837e8bc4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.528807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1879/3744] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:29 2022] DELETE /identity/v3/users/e1fd343aed7f4afa811a5a04837e8bc4 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:30.529983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:30.535378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10dacce8dd54fdfa16778aefa38e43e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.538162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:30.587166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10dacce8dd54fdfa16778aefa38e43e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.622490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10dacce8dd54fdfa16778aefa38e43e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.627473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10dacce8dd54fdfa16778aefa38e43e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:30.655679 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1866/3745] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:29 2022] DELETE /identity/v3/users/a10dacce8dd54fdfa16778aefa38e43e => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:30.698713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:30.700371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:30.750001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36048c6-cc01-4e89-b012-f91064e5399e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:30.850753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:30.852356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d73f13-5f48-4bf9-b0e2-20d1d9d51b57 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:30.853513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:30.854674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:30.860123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:30.860123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:30.870329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:30.870988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:30.871260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:30.871533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] PATH_INFO: `/v3/users/e92466fea4504554b1bda7cea02b45a7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:30.872787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92466fea4504554b1bda7cea02b45a7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:30.874753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:31.112027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:31.122528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:31.137320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:31.156433 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1880/3746] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:31.232653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92466fea4504554b1bda7cea02b45a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:31.364890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92466fea4504554b1bda7cea02b45a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:31.387631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92466fea4504554b1bda7cea02b45a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:31.409169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92466fea4504554b1bda7cea02b45a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:31.414196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d0dca6a-3470-4f8d-98ed-c51e0e3a38de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92466fea4504554b1bda7cea02b45a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:31.420834 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1867/3747] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:30 2022] DELETE /identity/v3/users/e92466fea4504554b1bda7cea02b45a7 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:31.536164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:31.542508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:31.566858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339f5be-2f49-4829-baa4-ab6d19798649 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:31.670078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=8,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:31.761473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:31.762150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:31.762424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:31.762704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] PATH_INFO: `/v3/projects/6fcb3622750f4d468efb3f30bd74a498` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:31.770047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcb3622750f4d468efb3f30bd74a498)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:31.773026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:32.046453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcb3622750f4d468efb3f30bd74a498', 'request_id': 'req-ba84d13c-4500-45b4-9c34-e42b375e38c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.060620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcb3622750f4d468efb3f30bd74a498', 'request_id': 'req-ba84d13c-4500-45b4-9c34-e42b375e38c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.272880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcb3622750f4d468efb3f30bd74a498', 'request_id': 'req-ba84d13c-4500-45b4-9c34-e42b375e38c0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.297695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] The token cache is being invalidate because project 6fcb3622750f4d468efb3f30bd74a498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:32.297986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.299301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba84d13c-4500-45b4-9c34-e42b375e38c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.322407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:32.322953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:32.323400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:32.324579 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1881/3748] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:31 2022] DELETE /identity/v3/projects/6fcb3622750f4d468efb3f30bd74a498 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:32.372596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:32.372596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:32.572936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1868/3749] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:32.580824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:32.581099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:32.581440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:32.583711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:32.585702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:32.633763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:32.637029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:32.666241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daca2d8-c487-4d88-bd6b-97ce735727e0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:32.672998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1882/3750] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:32.675136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:32.681387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:32.697292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:32.698046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:32.698386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:32.698803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] PATH_INFO: `/v3/projects/028ae84504c3470795228745c92988ae` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:32.700656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=028ae84504c3470795228745c92988ae)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:32.703649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:32.732021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb65bf-4298-4016-8e5e-8d73ee31b807 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:32.755394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:32.755394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:32.755394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:32.755394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] PATH_INFO: `/v3/users/6ba62c421ca94a938534b56430fddd85` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:32.759167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ba62c421ca94a938534b56430fddd85)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:32.764895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:32.972709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028ae84504c3470795228745c92988ae', 'request_id': 'req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.985583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028ae84504c3470795228745c92988ae', 'request_id': 'req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:32.992883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028ae84504c3470795228745c92988ae', 'request_id': 'req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.683068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] The token cache is being invalidate because project 028ae84504c3470795228745c92988ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:33.684153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ba62c421ca94a938534b56430fddd85'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.684828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.686194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.691322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1869/3751] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:32 2022] DELETE /identity/v3/projects/028ae84504c3470795228745c92988ae => generated 0 bytes in 1105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:33.692948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:33.713967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:33.825141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ba62c421ca94a938534b56430fddd85'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.853633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ba62c421ca94a938534b56430fddd85'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.867101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ba62c421ca94a938534b56430fddd85'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.867101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ba62c421ca94a938534b56430fddd85'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:33.901821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1883/3752] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:32 2022] DELETE /identity/v3/users/6ba62c421ca94a938534b56430fddd85 => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:33.902824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:33.909674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:33.939664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea5a4-8292-4ff2-8485-b5cb0ea05d3c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:34.088289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9b763-ac92-4b84-af7c-898b3588cc87 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:34.094729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:34.095846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.100422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:34.100953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.101506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.102011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.102597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.102925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:34.103040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] PATH_INFO: `/v3/projects/6839662ece854e21ac3002b262fdc52e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.104533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:34.106519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6839662ece854e21ac3002b262fdc52e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:34.109185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:34.125271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8ad8-d235-4432-8087-7dc283e4d54e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:34.158115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1870/3753] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:34.160286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.160603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.160881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.215001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:34.216409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:34.232068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1871/3754] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:34.233041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:34.235975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:34.259850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5bf63-ccd7-42c7-b7a1-1433c3cb56d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:34.267593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:34.268330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.268677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.268999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.269735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:34.272348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20abd3b-e49e-4f33-96c3-0a599377184d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:34.318646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6839662ece854e21ac3002b262fdc52e', 'request_id': 'req-455bcf08-22fe-415c-9094-a0bab51ebcd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:34.328195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6839662ece854e21ac3002b262fdc52e', 'request_id': 'req-455bcf08-22fe-415c-9094-a0bab51ebcd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:34.461049 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1872/3755] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:34 2022] POST /identity/v3/projects => generated 397 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:34.461049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab692b-3cb2-4893-8685-6ada07a3c65c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.461049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab692b-3cb2-4893-8685-6ada07a3c65c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.461049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab692b-3cb2-4893-8685-6ada07a3c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.481107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6839662ece854e21ac3002b262fdc52e', 'request_id': 'req-455bcf08-22fe-415c-9094-a0bab51ebcd3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:34.514682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] The token cache is being invalidate because project 6839662ece854e21ac3002b262fdc52e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:34.514682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:34.518205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:34.523883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1884/3756] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:33 2022] DELETE /identity/v3/projects/6839662ece854e21ac3002b262fdc52e => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:34.541316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:34.541316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:34.541563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4dab692b-3cb2-4893-8685-6ada07a3c65c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:34.547462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4dab692b-3cb2-4893-8685-6ada07a3c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:34.718280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bcf08-22fe-415c-9094-a0bab51ebcd3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:34.811111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1873/3757] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:34.811111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.811111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.811111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.849542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:34.857091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:34.861563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:34.863514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.864727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.865452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.866240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:34.867088 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1874/3758] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:34.869573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:34.871491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596a88b-8228-4ccc-afce-9ad352b5def6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:34.894092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f481a0-5f19-42f5-a396-26ca5c85f710 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:34.929412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:34.934889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:34.934889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:34.934889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:34.934889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:34.934889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:34.936014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:34.973353 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1875/3759] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:34.973353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:34.978655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.004763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4623457-ce4d-4742-a061-8f91cce33fc7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.011184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.011797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.012201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.012462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] PATH_INFO: `/v3/projects/48e7348010084007a1f39fd226ff05d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.013896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e7348010084007a1f39fd226ff05d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.015811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.059005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1885/3760] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:34 2022] POST /identity/v3/users => generated 299 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:35.061257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09450-dec1-426a-822e-c1431b824601 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.061718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09450-dec1-426a-822e-c1431b824601 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.063504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a09450-dec1-426a-822e-c1431b824601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.114311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-91a09450-dec1-426a-822e-c1431b824601 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:35.117913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91a09450-dec1-426a-822e-c1431b824601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.142832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1886/3761] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:35.142832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09450-dec1-426a-822e-c1431b824601 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.168229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a09450-dec1-426a-822e-c1431b824601 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.174218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.181403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.181403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.181403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.181403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.181403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.218418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e7348010084007a1f39fd226ff05d9', 'request_id': 'req-459f94e1-42be-48a3-b7f5-5531cc809bc2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:35.247882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e7348010084007a1f39fd226ff05d9', 'request_id': 'req-459f94e1-42be-48a3-b7f5-5531cc809bc2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:35.247882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e7348010084007a1f39fd226ff05d9', 'request_id': 'req-459f94e1-42be-48a3-b7f5-5531cc809bc2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:35.314822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:35.329355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1887/3762] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:35.331799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.387115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] The token cache is being invalidate because project 48e7348010084007a1f39fd226ff05d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:35.387820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:35.388773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:35.396304 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1876/3763] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:34 2022] DELETE /identity/v3/projects/48e7348010084007a1f39fd226ff05d9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:35.403842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.406139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.453721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4162-52b9-49c4-9374-3a033d23c578 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.480682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.481442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.481618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.481841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.482494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.484117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.518930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1888/3764] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:35.518930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.527940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.573259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e438ca-d83e-4ee5-aa49-e194d85216c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.591304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.591936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.592238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.592527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.593144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.596456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.627523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f94e1-42be-48a3-b7f5-5531cc809bc2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.640549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:35.646240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.646937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.652696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.652696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.652696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:35.652696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.652696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57749d38-4b6d-4f35-9b67-52acc7928b2b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.668036 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1877/3765] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:35.670046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.670460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.670729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.695147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:35.696745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.716416 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1878/3766] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:35.721578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.721578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.747826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d78f61-b33f-4d35-8c24-5f143337d069 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.754258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.755137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.756074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.761649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.761649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.761649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6deb3-68b1-4995-9a38-d73c6bc340bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.762569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1889/3767] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:35.764019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.792125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1879/3768] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:35.794041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.801854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.801854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.809718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d150e9-5505-4b50-a0a0-8b78c6eb0c69 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.824180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:35.826358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:35.837377 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1880/3769] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:35.838575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.849432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ee07d-04b5-4b38-a13a-4d754f23b363 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.854726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.855177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.855626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.855994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.856414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.856982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.857282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.859547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.862546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.868886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.870310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.872576 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1881/3770] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:35.873545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:35.877345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:35.887661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f64da9-ac82-4eb7-a0ad-efc0be903206 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:35.893935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:35.895167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:35.895398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:35.896049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] PATH_INFO: `/v3/projects/9f93f39d26df455292e782018b938219/users/3c0856ee609d41c885755c0f2d12b3f5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:35.918076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f93f39d26df455292e782018b938219, user_id=3c0856ee609d41c885755c0f2d12b3f5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:35.924762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:36.067666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1882/3771] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:35 2022] PUT /identity/v3/projects/9f93f39d26df455292e782018b938219/users/3c0856ee609d41c885755c0f2d12b3f5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:36.069928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:36.130895 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1890/3772] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:36.138833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:36.261202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090f413-6270-419e-9bf6-36a331322e28 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:36.421687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc902e-17bd-466a-a6a7-3ab74183b755 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:36.456294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:36.463189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:36.463189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:36.466645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:36.467876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:36.476226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:36.537533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:36.538350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:36.538859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:36.539385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:36.540621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:36.541155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:36.549193 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1891/3773] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:36.551025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:36.560264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45247fae-9ea3-4536-b9aa-ea5650f46a5a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:36.566243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:36.694306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b37ce-7708-4571-aec7-63c97946cc95 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:36.694454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1883/3774] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:36.694454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:36.694454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:36.694454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:36.695188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:36.695188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:36.695188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:36.695188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] PATH_INFO: `/v3/users/12efbd6f761d49ceb86b035b48c47c7e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:36.696314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] RBAC: Authorizing `identity:delete_user(user_id=12efbd6f761d49ceb86b035b48c47c7e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:36.696314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:36.696763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:36.696763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:36.696763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1884/3775] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:36.696763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:36.696763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e04a0-d808-40c8-a0e8-e5b622e0c026 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:36.711679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:36.713214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:36.713640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:36.713961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:36.716242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:36.724912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:37.999509 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1885/3776] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:36 2022] POST /identity/v3/users => generated 293 bytes in 1325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:38.009783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:38.021077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccac24e-e42c-4581-97c4-f6d76d4ad5fa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:38.026655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:38.027620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.028051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.028474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] PATH_INFO: `/v3/projects/8dd031c413e74d51a02e5d0661123e70/users/b0286c0b1e1948c6af5ec7d763a72bd8/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.051725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd031c413e74d51a02e5d0661123e70, user_id=b0286c0b1e1948c6af5ec7d763a72bd8, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:38.054503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:38.203765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12efbd6f761d49ceb86b035b48c47c7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:38.285748 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1886/3777] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:38 2022] PUT /identity/v3/projects/8dd031c413e74d51a02e5d0661123e70/users/b0286c0b1e1948c6af5ec7d763a72bd8/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:38.286820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:38.403442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8b926-aef5-4a7c-ac25-7594cd46e1a9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:38.409892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:38.410796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.411220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.411635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.412425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:38.415119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286f2fc-99f0-43f0-8ae7-a1065465c9f3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:38.472093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12efbd6f761d49ceb86b035b48c47c7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:38.491332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12efbd6f761d49ceb86b035b48c47c7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:38.492944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12efbd6f761d49ceb86b035b48c47c7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:38.493747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12efbd6f761d49ceb86b035b48c47c7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:38.515226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1892/3778] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:36 2022] DELETE /identity/v3/users/12efbd6f761d49ceb86b035b48c47c7e => generated 0 bytes in 1962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:38.520728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:38.522969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:38.609790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1887/3779] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:38 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:38.613750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.614384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.614813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.652574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644abf68-3e1f-4bdf-8221-add08fdbcead admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:38.654833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] MFA Rules not processed for user `357efc23c2104794ba7287d22027c35f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:38.656242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:38.691574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:38.725372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:38.726356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.726868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.728286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.734087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:38.777232 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1888/3780] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:38.790362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:38.792322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:38.876930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:38.881456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:38.903551 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1893/3781] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:38.905951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:38.912332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:38.939159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cd885-e718-4365-a7c5-b79659c7f100 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:38.942640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1494f-6441-42ef-95a5-433a91e78b92 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:38.945847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:38.946518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.946889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.947223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] PATH_INFO: `/v3/users/08dc2b6c9b2f4d9f86814da28b96df82` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.948506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08dc2b6c9b2f4d9f86814da28b96df82)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:38.951960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:38.954400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:38.955270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.955636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.956118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.957556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:38.958579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc613b-85b5-40c7-83c2-93c3aab08b33 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:38.972452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1889/3782] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:38.973978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:38.974267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:38.974541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:38.998365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:38.999626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.012634 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1890/3783] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:39.012634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.014479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.032423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c5df5-b3e1-4a46-8055-2ad59ca17c07 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.043220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.044101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.044792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.045338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.046521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:39.050401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:39.170371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:39.177648 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1891/3784] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:39 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:39.179506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.183831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.279589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6068e-3beb-4f79-b586-8e0301171008 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.285119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.285719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.285999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.286373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.288952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.308211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08dc2b6c9b2f4d9f86814da28b96df82'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.392681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:39.398167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:39.431556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1892/3785] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:39.432396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08dc2b6c9b2f4d9f86814da28b96df82'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.434235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.437753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.456624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08dc2b6c9b2f4d9f86814da28b96df82'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.459960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08dc2b6c9b2f4d9f86814da28b96df82'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.462775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08dc2b6c9b2f4d9f86814da28b96df82'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.483964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d42f6-dd2f-4d6b-94eb-f1bd3c109ef2 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.495622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.496283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.502218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1894/3786] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:38 2022] DELETE /identity/v3/users/08dc2b6c9b2f4d9f86814da28b96df82 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:39.502432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.502432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] PATH_INFO: `/v3/projects/a62ee57746e345a799a6ddab45624dc9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.502597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.502681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62ee57746e345a799a6ddab45624dc9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:39.504352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:39.504892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.678959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db231cdd-69f5-4399-9008-ad995b4fd4fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.696834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62ee57746e345a799a6ddab45624dc9', 'request_id': 'req-c8a118b2-d52e-4842-9405-8cdf7ba3e834'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.713119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62ee57746e345a799a6ddab45624dc9', 'request_id': 'req-c8a118b2-d52e-4842-9405-8cdf7ba3e834'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.721167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62ee57746e345a799a6ddab45624dc9', 'request_id': 'req-c8a118b2-d52e-4842-9405-8cdf7ba3e834'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.777312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.777949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.778231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.778540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.779336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:39.781381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:39.795011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1895/3787] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:39.796199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.798142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.821277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] The token cache is being invalidate because project a62ee57746e345a799a6ddab45624dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:39.821571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.833208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:39.834601 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1893/3788] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:39 2022] DELETE /identity/v3/projects/a62ee57746e345a799a6ddab45624dc9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:39.835415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:39.836868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.865725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a118b2-d52e-4842-9405-8cdf7ba3e834 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.897753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.897753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.897753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.897753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.898323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:39.898323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969ceda-7593-485a-903e-56247c02a623 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:39.908807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1894/3789] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:39.908807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.908807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.908807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.952178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536ebde-6b79-4f18-ab63-0532078c15cf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:39.972905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:39.978660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:39.978660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:39.978660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:39.979274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:39.979274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:39.979432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.001414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.002079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1895/3790] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:40.003839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.005870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.006880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.047483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad929cb-96ae-4ca4-b12a-0175b9ee231b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.051003 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1896/3791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:40.052016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.053600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.057104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.057464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.057817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] PATH_INFO: `/v3/projects/00ed5eb003f54935aac57465635be43c/users/9e18e70c40094401a17233116cacf60a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.059753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.095049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00ed5eb003f54935aac57465635be43c, user_id=9e18e70c40094401a17233116cacf60a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.097803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.107395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7f149-8b3b-42d7-b6bd-2775db7f1d7b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.120168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.120608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.120895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.122049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] PATH_INFO: `/v3/users/bdf29c3b6214410aafdcb41a23ce317a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.123310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf29c3b6214410aafdcb41a23ce317a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.126854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.227234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1896/3792] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:40 2022] PUT /identity/v3/projects/00ed5eb003f54935aac57465635be43c/users/9e18e70c40094401a17233116cacf60a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:40.227234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.386323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce551a-4d05-4ca7-919e-9fd29e285499 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.392387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf29c3b6214410aafdcb41a23ce317a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:40.393844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.394556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.394876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.395113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.395820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.399713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.416347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1897/3793] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:40.417350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.419900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.536179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967b59-fece-42aa-a403-7823f64358e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.542451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.544465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.545048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.545396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.559980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.561563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d007-6fa6-4f8c-b7a9-d177ff46bc13 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.565330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf29c3b6214410aafdcb41a23ce317a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:40.575022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1898/3794] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:40.576523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.576792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.577089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.593830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf29c3b6214410aafdcb41a23ce317a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:40.594610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf29c3b6214410aafdcb41a23ce317a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:40.595271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf29c3b6214410aafdcb41a23ce317a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:40.604393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:40.609339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.612228 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1897/3795] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:40 2022] DELETE /identity/v3/users/bdf29c3b6214410aafdcb41a23ce317a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:40.613119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.614437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.616013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1899/3796] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:40.648269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:40.650476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:40.713960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e04cc3-347b-4530-96de-7d06cd3a5fca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.784164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00447c0-37d7-494d-963f-5d5da6a73681 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:40.805560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.805560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.805560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.805560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] PATH_INFO: `/v3/projects/d22b69fad22a403dbbc85a36725e2950/users/635d39e48bb24d1c9d494bea38720d5b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.813640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:40.814398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:40.814850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:40.815222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:40.829716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.832343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bce9a0-fe4e-4d28-84df-d7d4c9f4b6f6 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.839812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b69fad22a403dbbc85a36725e2950, user_id=635d39e48bb24d1c9d494bea38720d5b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:40.844953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:40.855514 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1900/3797] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:45:41.022180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1898/3798] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:40 2022] PUT /identity/v3/projects/d22b69fad22a403dbbc85a36725e2950/users/635d39e48bb24d1c9d494bea38720d5b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:41.025154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:41.025850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:41.025850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:41.065483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] MFA Rules not processed for user `635d39e48bb24d1c9d494bea38720d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:41.066880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:41.144045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:41.157857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:41.198316 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1901/3799] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:41.217084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:41.219117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:41.302589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cff2bd-b894-4af7-a7db-5c62a97e07cf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:41.320168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:41.320168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:41.320168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:41.320168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] PATH_INFO: `/v3/projects/d15efd8b3a96452e84f31fe686b088c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:41.320899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15efd8b3a96452e84f31fe686b088c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:41.321924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:41.332791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187f19-f3f2-4707-9c73-b7be6711ea2f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:41.346061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:41.346889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:41.347252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:41.347531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:41.365517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:41.380153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b12c-5c69-408b-90f1-e0a3494b1b31 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:41.413595 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1902/3800] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:41.592934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15efd8b3a96452e84f31fe686b088c1', 'request_id': 'req-156c3a99-1f9a-48c8-95b9-8a089f6295ea'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:41.607437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15efd8b3a96452e84f31fe686b088c1', 'request_id': 'req-156c3a99-1f9a-48c8-95b9-8a089f6295ea'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:41.803573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15efd8b3a96452e84f31fe686b088c1', 'request_id': 'req-156c3a99-1f9a-48c8-95b9-8a089f6295ea'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:41.823154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] The token cache is being invalidate because project d15efd8b3a96452e84f31fe686b088c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:41.826909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:41.830726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:41.838497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1899/3801] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:41 2022] DELETE /identity/v3/projects/d15efd8b3a96452e84f31fe686b088c1 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:41.842160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60bd3-53c8-498d-b378-17d58d2cb65b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:41.842450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60bd3-53c8-498d-b378-17d58d2cb65b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:41.842730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd60bd3-53c8-498d-b378-17d58d2cb65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:41.877917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:41.879214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:41.888582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ddd60bd3-53c8-498d-b378-17d58d2cb65b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:41.897570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ddd60bd3-53c8-498d-b378-17d58d2cb65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:42.101635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156c3a99-1f9a-48c8-95b9-8a089f6295ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:42.110789 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1903/3802] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:42.113905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:42.115403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.115891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.124479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.124975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.125341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.127617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] PATH_INFO: `/v3/projects/c4f34284442f4427b734df26d20b15e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.131388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f34284442f4427b734df26d20b15e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:42.134150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:42.177667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:42.180156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:42.216249 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1904/3803] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:42.224185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:42.245176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f43d0e-12cd-4b6f-972c-ab398f47e6d5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:42.260084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:42.261097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.275183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.275183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.275183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:42.275183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:42.275183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:42.288882 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1905/3804] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:42.301869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:42.324955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbc3bd-a087-476f-9522-5534fdea25b0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:42.330963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:42.331920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.332474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.333099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.334936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:42.337735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:42.545385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f34284442f4427b734df26d20b15e9', 'request_id': 'req-3c0446d3-ef16-4941-a507-f70cb534784b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:42.564322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f34284442f4427b734df26d20b15e9', 'request_id': 'req-3c0446d3-ef16-4941-a507-f70cb534784b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:42.585329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1906/3805] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:42 2022] POST /identity/v3/projects => generated 363 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:42.598392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:42.712136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f34284442f4427b734df26d20b15e9', 'request_id': 'req-3c0446d3-ef16-4941-a507-f70cb534784b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:42.737805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] The token cache is being invalidate because project c4f34284442f4427b734df26d20b15e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:42.738125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:42.739594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:42.744870 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1900/3806] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:41 2022] DELETE /identity/v3/projects/c4f34284442f4427b734df26d20b15e9 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:42.749884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:42.752198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:42.812385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6154e93-2119-498f-bb3e-0224115aa8d3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:42.848410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:42.849073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.849353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.849624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.862489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:42.862489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab221d2-8eb6-4eda-b4d7-b41637d46116 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:42.901155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:42.950758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0446d3-ef16-4941-a507-f70cb534784b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:42.958060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:42.969363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:42.969855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:42.970521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] PATH_INFO: `/v3/users/ce476920b6c440acaa8e176ab9f55091` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:42.984202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce476920b6c440acaa8e176ab9f55091)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:42.987375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:43.027063 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1907/3807] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:42 2022] POST /identity/v3/users => generated 282 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:45:43.028664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.029091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.029536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.104927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] MFA Rules not processed for user `9e18e70c40094401a17233116cacf60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:43.106170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:43.248990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1908/3808] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:43.251102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:43.254899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:43.297639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62709d0-9468-41d4-9e2b-343627f30469 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:43.328525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:43.328525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.328525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.328525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.328910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:43.330198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725dc1f-1ba7-4bef-8a2e-d6cbe691f0b1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:43.331542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce476920b6c440acaa8e176ab9f55091'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:43.363556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1909/3809] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:43.363556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.363556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.363556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.397146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] MFA Rules not processed for user `9e18e70c40094401a17233116cacf60a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:43.398421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:43.417591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1910/3810] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:43.418561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:43.452629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fa1fb-81f4-49e1-a3dc-86d73622e93d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:43.459865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:43.460875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.461161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.461436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.463905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:43.467516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:43.488806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce476920b6c440acaa8e176ab9f55091'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:43.515136 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1911/3811] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:43.515350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:43.519559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:43.524366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce476920b6c440acaa8e176ab9f55091'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:43.525772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce476920b6c440acaa8e176ab9f55091'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:43.527147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce476920b6c440acaa8e176ab9f55091'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:43.565337 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1901/3812] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:42 2022] DELETE /identity/v3/users/ce476920b6c440acaa8e176ab9f55091 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:43.569048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:43.569734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:43.706126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc2e21-872e-46c8-912b-96a84aa1b2ef admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:43.761231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c16d0-d3af-4307-b607-af976961f5e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:43.770462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:43.772641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.773118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.773680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9/users/490c2179fbc6420e8ed58d032c286793/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.792925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:43.802668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc33ed7c067f48a2a3dda4963fbe78d9, user_id=490c2179fbc6420e8ed58d032c286793, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:43.810309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa64248-a6a4-40a8-a5d8-26abe45094d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:43.975542 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1902/3813] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:43 2022] PUT /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9/users/490c2179fbc6420e8ed58d032c286793/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:43.978713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d0cc2-3155-4a0c-bbb3-037877d4cc25 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:43.984877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d0cc2-3155-4a0c-bbb3-037877d4cc25 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:43.984877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d0cc2-3155-4a0c-bbb3-037877d4cc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:43.998004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:43.999502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.000317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.001160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.007820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.014658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:44.075723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-401d0cc2-3155-4a0c-bbb3-037877d4cc25 None None] MFA Rules not processed for user `b0286c0b1e1948c6af5ec7d763a72bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:44.077155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-401d0cc2-3155-4a0c-bbb3-037877d4cc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.272307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:44.276917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b961607-45a7-448e-99f0-64a0622140b2 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:44.279626 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1903/3814] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:44.282513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f4bc-e6a5-447f-9ef4-e845fdc883e0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.283133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f4bc-e6a5-447f-9ef4-e845fdc883e0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.283133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6f4bc-e6a5-447f-9ef4-e845fdc883e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.355516 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1912/3815] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 841 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:44.356696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4c36-e1e5-485a-a698-3b8a5e96a787 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.356982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4c36-e1e5-485a-a698-3b8a5e96a787 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.357263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da4c36-e1e5-485a-a698-3b8a5e96a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.371970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a3c6f4bc-e6a5-447f-9ef4-e845fdc883e0 None None] MFA Rules not processed for user `490c2179fbc6420e8ed58d032c286793`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:44.373721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3c6f4bc-e6a5-447f-9ef4-e845fdc883e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.396183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98da4c36-e1e5-485a-a698-3b8a5e96a787 None None] MFA Rules not processed for user `b0286c0b1e1948c6af5ec7d763a72bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:44.397739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98da4c36-e1e5-485a-a698-3b8a5e96a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.431563 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1913/3816] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:44.433360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.433644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.433923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.472802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] MFA Rules not processed for user `b0286c0b1e1948c6af5ec7d763a72bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:44.474077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.497344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1914/3817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:44.507463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:44.510360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.514080 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1904/3818] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:44.717864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2816ea-c8aa-485e-a681-00d992715877 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:44.732059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:44.732723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.733004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.733273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.754768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:44.756732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:44.778133 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1915/3819] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:45:44.802320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.802861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.803054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.804758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1905/3820] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:45:44.811267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:45:44.830474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:44.856356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:44.858169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:44.861853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3db4ff-a5af-40e8-873a-53742d55f481 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:44.878343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490c2179fbc6420e8ed58d032c286793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:44.879426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.879784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.880097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.883329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorizing `identity:get_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:44.885720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a217e02-3699-431a-a227-e10e8c81a671 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:44.904191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1916/3821] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:45:44 2022] GET /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 363 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:44.907097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f42e6-2bff-430c-950c-16daec767e66 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:44.916230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:44.918086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:44.918279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:44.918531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:44.943685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:44.945946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:44.965890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1906/3822] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:45.026098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:45.168163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.168163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.169541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.172992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1917/3823] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:45:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:45.202299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:45:45.211178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:45.248298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a41877-ec14-4891-8bc3-66ea8de728b1 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:45.257226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490c2179fbc6420e8ed58d032c286793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:45.271556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.271556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.271556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.277242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorizing `identity:get_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:45.279202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820e2cc-c5eb-4c83-8604-9abe26292177 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:45.282573 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1907/3824] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:45:45 2022] GET /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 363 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:45.328512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:45.356989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:45.439085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.441506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.448643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.450903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1908/3825] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:45:45 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:45.456086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:45:45.520734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:45.556187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065aa6e-fe05-498e-afd8-4a1be8b1c10f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:45.570958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490c2179fbc6420e8ed58d032c286793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:45.571838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.572186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.572604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.585440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorizing `identity:get_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:45.588211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988881b1-e17b-4402-95a6-a928e7899cf2 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:45.590461 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1909/3826] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:45:45 2022] GET /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 363 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:45:45.622058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ff8e-c02e-45f5-8280-d10c98aefd62 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:45.635015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.635555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.635988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.637812 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1910/3827] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:45:45.639346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:45.640976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.641479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.642721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] PATH_INFO: `/v3/projects/5fa31a3808174625ac3de0006ebcfcf8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.647418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa31a3808174625ac3de0006ebcfcf8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:45.650145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:45:45.651351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:45.701132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:45.744864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75d19-fd01-4144-9e21-d38a33de4dfb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:45.750066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490c2179fbc6420e8ed58d032c286793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:45.750941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.752001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.752446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.754935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorizing `identity:get_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:45.757478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2cf78-d489-4260-b7f4-1e02a46585f9 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:45.759479 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1911/3828] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:45:45 2022] GET /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 363 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:45:45.789238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206f592-e9c0-4957-beb1-06f127938be7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:45.790029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206f592-e9c0-4957-beb1-06f127938be7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:45.790131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206f592-e9c0-4957-beb1-06f127938be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:45.838508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7206f592-e9c0-4957-beb1-06f127938be7 None None] MFA Rules not processed for user `1dea9e27e67b4fd888fb2c4085ec5bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:45.839777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7206f592-e9c0-4957-beb1-06f127938be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:45.921079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa31a3808174625ac3de0006ebcfcf8', 'request_id': 'req-1bb69dbe-df59-4043-a094-b8dfa3b50701'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:45.943850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa31a3808174625ac3de0006ebcfcf8', 'request_id': 'req-1bb69dbe-df59-4043-a094-b8dfa3b50701'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:45.967156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa31a3808174625ac3de0006ebcfcf8', 'request_id': 'req-1bb69dbe-df59-4043-a094-b8dfa3b50701'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.059477 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1912/3829] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:46.062451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d36f-5e64-4b10-94d6-8940152f1ccb None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.062774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d36f-5e64-4b10-94d6-8940152f1ccb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.063099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78d36f-5e64-4b10-94d6-8940152f1ccb None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.066476 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1913/3830] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 12:45:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 12:45:46.067618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.067901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.077517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:46.092987 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:46.094058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:45:46.122640 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1914/3831] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 38 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:46.122640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:46.122640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:46.158314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] The token cache is being invalidate because project 5fa31a3808174625ac3de0006ebcfcf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:46.158509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.159207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.166643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1918/3832] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:45 2022] DELETE /identity/v3/projects/5fa31a3808174625ac3de0006ebcfcf8 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:46.166643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 12:45:46.181813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:46.276540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b34166-7325-4522-81dc-0cec83d4c2e3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:46.293906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:46.294418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.294698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.294976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] PATH_INFO: `/v3/users/9e18e70c40094401a17233116cacf60a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.296889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e18e70c40094401a17233116cacf60a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:46.299578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:46.376340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:46.381217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:46.561394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb69dbe-df59-4043-a094-b8dfa3b50701 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:46.571955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '490c2179fbc6420e8ed58d032c286793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:46.573321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.573987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.574508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.576864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorizing `identity:get_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:46.580231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed655c-1bde-4f40-b00a-9465fd05125b tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:46.584747 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1919/3833] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 12:45:46 2022] GET /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 363 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:46.588999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.594654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.596141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.618430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e18e70c40094401a17233116cacf60a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.645163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:46.650488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:46.696336 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1920/3834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:46.697817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:46.699560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:46.719033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48977d81-d3fc-4e32-82b4-ef197f36cee9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:46.727654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:46.729622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.729902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.730177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] PATH_INFO: `/v3/users/490c2179fbc6420e8ed58d032c286793` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.737199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490c2179fbc6420e8ed58d032c286793)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:46.737199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:46.763258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e18e70c40094401a17233116cacf60a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.793267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:46.795018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e18e70c40094401a17233116cacf60a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.796958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e18e70c40094401a17233116cacf60a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.812534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9f8783b1-e906-4b72-af12-61db7c3d6170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e18e70c40094401a17233116cacf60a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:46.846137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1915/3835] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:46 2022] DELETE /identity/v3/users/9e18e70c40094401a17233116cacf60a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:46.848126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:46.848577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:46.849006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:46.903542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:46.903542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:47.052723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490c2179fbc6420e8ed58d032c286793'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:47.105866 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1916/3836] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:47.109858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:47.119090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5e749-c78f-4e9a-b2e3-28fff3723040 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:47.124299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:47.125156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.125556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.126048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.126838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:47.127327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:47.129294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:47.167887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1917/3837] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:47.168919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:47.188964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f627116-104d-424e-aef4-6a2c58aa5c0d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:47.194837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490c2179fbc6420e8ed58d032c286793'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:47.268979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:47.272170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.272527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.272794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.276498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490c2179fbc6420e8ed58d032c286793'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:47.280718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:47.290802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1ac9-4f31-4b3a-a3a8-8f03c053e496 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:47.355237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490c2179fbc6420e8ed58d032c286793'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:47.362712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1f883d5-b5e7-48b8-a6a8-f02ffe156373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490c2179fbc6420e8ed58d032c286793'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:47.388612 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1921/3838] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:46 2022] DELETE /identity/v3/users/490c2179fbc6420e8ed58d032c286793 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:47.394419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.394700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.394979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:47.411887 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:47.412815 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:45:47.413688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1922/3839] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:47.414973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.415365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.415640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.475586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:47.477538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:47.550904 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1918/3840] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:47 2022] POST /identity/v3/projects => generated 385 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:47.563058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475299-a300-42ed-8739-0477e823b487 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.569347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475299-a300-42ed-8739-0477e823b487 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.572037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c475299-a300-42ed-8739-0477e823b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.635186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1c475299-a300-42ed-8739-0477e823b487 None None] MFA Rules not processed for user `1dea9e27e67b4fd888fb2c4085ec5bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:47.639449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c475299-a300-42ed-8739-0477e823b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:47.654651 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1923/3841] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:47.656049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:47.662392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:47.681865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f225dc-a42c-46a9-9b4a-89f6c571ee5c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:47.762511 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1919/3842] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:47.763368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475299-a300-42ed-8739-0477e823b487 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:47.768037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c475299-a300-42ed-8739-0477e823b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:47.792587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:47.793980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.794377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.794752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:47.795535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:47.798029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:47.916392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c475299-a300-42ed-8739-0477e823b487 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:47.937317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:47.939847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:47.940138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:47.944964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.000406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:48.002898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:48.019206 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1924/3843] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:47 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:48.021044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:48.045377 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1920/3844] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:48.049192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b8096-4997-45ce-824b-dbbb13a66527 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:48.077937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:48.078601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.078886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.079155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.079805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:48.081473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:48.120674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1925/3845] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:45:48.133998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:48.137228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005dc8e-f65a-4dce-bf6e-9d652407a90f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:48.150024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:48.150798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.151386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.151574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.152294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:48.154143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:48.186716 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1921/3846] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:45:48.189748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:48.221800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52486280-5433-49d3-87ea-f78c637bb210 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:48.243436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:48.255288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:48.256141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:48.259034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:48.261143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.265236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.265592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] PATH_INFO: `/v3/projects/e36225d06ca4473e98ae746b3fa625e4/users/579094f4845f4cca8e14fe2fa489af93/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.275774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e753c72-c13b-4131-88bd-5307872c3af2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:48.285110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:48.286583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.287049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.287901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] PATH_INFO: `/v3/projects/00ed5eb003f54935aac57465635be43c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.291016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00ed5eb003f54935aac57465635be43c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:48.293560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:48.357353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36225d06ca4473e98ae746b3fa625e4, user_id=579094f4845f4cca8e14fe2fa489af93, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:48.360598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8bfe5b-8e99-49ba-90d7-f9a287ec0baf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:48.639517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1926/3847] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:48 2022] PUT /identity/v3/projects/e36225d06ca4473e98ae746b3fa625e4/users/579094f4845f4cca8e14fe2fa489af93/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:48.642412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.642737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.643999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:48.653116 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:48.654059 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:45:48.655149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1927/3848] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:48.659185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00ed5eb003f54935aac57465635be43c', 'request_id': 'req-e078a9ea-20fd-490a-ab73-070ff5c01030'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:48.676674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.676674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.676674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:48.684545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00ed5eb003f54935aac57465635be43c', 'request_id': 'req-e078a9ea-20fd-490a-ab73-070ff5c01030'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:48.729556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] MFA Rules not processed for user `579094f4845f4cca8e14fe2fa489af93`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:48.731119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:48.852858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1928/3849] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:48.855916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:48.917238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00ed5eb003f54935aac57465635be43c', 'request_id': 'req-e078a9ea-20fd-490a-ab73-070ff5c01030'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:48.945232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] The token cache is being invalidate because project 00ed5eb003f54935aac57465635be43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:48.945331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:48.946230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e078a9ea-20fd-490a-ab73-070ff5c01030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:48.948473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1922/3850] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:48 2022] DELETE /identity/v3/projects/00ed5eb003f54935aac57465635be43c => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:48.955917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e94a-e8c2-4846-9b16-a5bf746a2ddd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:48.956358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e94a-e8c2-4846-9b16-a5bf746a2ddd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:48.956671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1e94a-e8c2-4846-9b16-a5bf746a2ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.024928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c5d1e94a-e8c2-4846-9b16-a5bf746a2ddd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:49.028632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5d1e94a-e8c2-4846-9b16-a5bf746a2ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:49.048783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15507f3-f34e-48c6-98cf-0214706745d2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.050486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1923/3851] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:49.058187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.058475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.058761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.066780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.067513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.074762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.075194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.081026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.098552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.116395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:49.117727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:49.158771 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1924/3852] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:45:49.163211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.190789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f39de-741e-4cb4-9a3c-ed450b637ceb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.209498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.210252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.210606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.211501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.212626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:49.213305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.217399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.239965 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1925/3853] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:49.258793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.279418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a186e8-1f08-4d0b-beb3-a199cf888375 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.298557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.299588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.300055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.300481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.301313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.303475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.431652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1929/3854] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:48 2022] POST /identity/v3/projects => generated 383 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:49.435588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.437642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:49.560656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1926/3855] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:49 2022] POST /identity/v3/projects => generated 401 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:45:49.567141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.571512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9cd54-7b97-4aa8-bd5d-aec7133fac2a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.674385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6eb80-fbf8-4116-a409-c0afb0f9a1d3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.677537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.678341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.679016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.679276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.681835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.684160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.689430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.691008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.691743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.693165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.695110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.700157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.879960 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1930/3856] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:49 2022] POST /identity/v3/users => generated 292 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:49.882546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.885948 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1927/3857] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:49 2022] POST /identity/v3/users => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:45:49.887274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:49.892609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:49.893843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:49.911005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16529b14-5a54-418b-bab1-57afb6555138 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.917615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.918290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.918668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.918842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] PATH_INFO: `/v3/users/b0286c0b1e1948c6af5ec7d763a72bd8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.920025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0286c0b1e1948c6af5ec7d763a72bd8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.920934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01761fdc-1e7f-4ced-beaa-2b290a0d36a4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:49.927460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:49.936021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:49.936725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:49.937571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:49.937571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] PATH_INFO: `/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:49.938666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc33ed7c067f48a2a3dda4963fbe78d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:49.943089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.076909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:50.349852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0286c0b1e1948c6af5ec7d763a72bd8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.371441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'request_id': 'req-7898cd7d-c68b-4286-aff1-9942b45b5539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.412755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'request_id': 'req-7898cd7d-c68b-4286-aff1-9942b45b5539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.425874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc33ed7c067f48a2a3dda4963fbe78d9', 'request_id': 'req-7898cd7d-c68b-4286-aff1-9942b45b5539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.445224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0286c0b1e1948c6af5ec7d763a72bd8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.473846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0286c0b1e1948c6af5ec7d763a72bd8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.474596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0286c0b1e1948c6af5ec7d763a72bd8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.483279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0286c0b1e1948c6af5ec7d763a72bd8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.490818 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1928/3858] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:49 2022] DELETE /identity/v3/users/b0286c0b1e1948c6af5ec7d763a72bd8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:50.495928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:50.497601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.624787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7627f34-0d26-4d18-80a2-209387f1f67f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:50.629841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:50.630996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.631428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.631873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.633454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:50.636250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.657415 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1929/3859] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:50.659997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:50.664906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.691230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf9895-de62-4bb4-82ce-a2c7e54582fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:50.697737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:50.698914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.699378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.699795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.700680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:50.702492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.725451 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1930/3860] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:50.727208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:50.749118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4b21-a146-4897-b42c-3e923cf4a9de admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:50.757734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:50.758366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.758643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.758915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.759563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:50.761868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57e3c7-0be6-4ad4-ac61-e23d0565d7a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.778657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] The token cache is being invalidate because project fc33ed7c067f48a2a3dda4963fbe78d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:50.779177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.779922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:50.782085 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1931/3861] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:49 2022] DELETE /identity/v3/projects/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:50.784640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:50.787317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1931/3862] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:50.789503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.790202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.791156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.792865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.828823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:50.830194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.842420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1932/3863] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:50.843369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:50.845168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.859505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6caf90-b758-4bbc-a28d-e082a73bea39 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:50.865568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:50.867969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.867969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.867969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] PATH_INFO: `/v3/projects/56269235ae224044a8710a7117ebdb2c/users/6c0ff5cbff394e75b11ccf0a02904652/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.890462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56269235ae224044a8710a7117ebdb2c, user_id=6c0ff5cbff394e75b11ccf0a02904652, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:50.893509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.905905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898cd7d-c68b-4286-aff1-9942b45b5539 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:50.911314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:50.911934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.912213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.912518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.913459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:50.915422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ff33c-82dc-4442-88b2-e91ff0e69182 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:50.934518 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1932/3864] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:50.934518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:50.934518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:50.934518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:50.968095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:50.969512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:50.982105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1933/3865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:50.982105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.004133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908993d-0542-4d34-a1cb-032a54de5626 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:51.011750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:51.012651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.013005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.013351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] PATH_INFO: `/v3/projects/cbcc9e09182b42709273d2162f3c8729/users/c2590fd697a248efb83d77da0e7fb371/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.032196 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1933/3866] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:50 2022] PUT /identity/v3/projects/56269235ae224044a8710a7117ebdb2c/users/6c0ff5cbff394e75b11ccf0a02904652/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:51.041569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.043484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.054917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcc9e09182b42709273d2162f3c8729, user_id=c2590fd697a248efb83d77da0e7fb371, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:51.074527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:51.151193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99634a6-7dd8-4f0c-8822-50ad28c8001e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:51.158631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:51.159393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.159732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.160069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] PATH_INFO: `/v3/projects/8dd031c413e74d51a02e5d0661123e70` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.161559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd031c413e74d51a02e5d0661123e70)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:51.163673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:51.323834 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1934/3867] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:50 2022] PUT /identity/v3/projects/cbcc9e09182b42709273d2162f3c8729/users/c2590fd697a248efb83d77da0e7fb371/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:51.323834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.403745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd031c413e74d51a02e5d0661123e70', 'request_id': 'req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:51.415829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd031c413e74d51a02e5d0661123e70', 'request_id': 'req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:51.467455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18cd30-76f8-4e2a-b3a9-3bb260e6fb19 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:51.563667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd031c413e74d51a02e5d0661123e70', 'request_id': 'req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:51.579624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:51.580299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.580576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.625126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.625126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:51.625126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:51.626207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] The token cache is being invalidate because project 8dd031c413e74d51a02e5d0661123e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:51.626207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:51.626380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837667-7b79-4df3-afed-16a1c439da32 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:51.626464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ebf5f8d3-06af-4a78-b88f-4a6e5bea2a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:51.626464 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1934/3868] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:51 2022] DELETE /identity/v3/projects/8dd031c413e74d51a02e5d0661123e70 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:51.626464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.626464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.626464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.626781 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1935/3869] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:51.626781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b41e-d303-429f-bc55-b5a10f6f3959 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.626781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b41e-d303-429f-bc55-b5a10f6f3959 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.626781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318b41e-d303-429f-bc55-b5a10f6f3959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.669368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6318b41e-d303-429f-bc55-b5a10f6f3959 None None] MFA Rules not processed for user `c2590fd697a248efb83d77da0e7fb371`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:51.670554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6318b41e-d303-429f-bc55-b5a10f6f3959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.682370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] MFA Rules not processed for user `6c0ff5cbff394e75b11ccf0a02904652`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:51.684090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.854680 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1935/3870] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:51.859793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.859793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.870085 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1936/3871] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:51.872114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.877096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.877982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.903307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83eec8-4c4e-4bd0-b8e3-785aad732173 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:51.918297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:51.919190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:51.919682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:51.920193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:51.921053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:51.923466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:51.931953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:51.934214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:51.963703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1937/3872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:51.965174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:51.967075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.120146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57810ef3-2c24-423f-a1ac-d2710e7ef26e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.124883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.125919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.126474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.126814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.132316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.137166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1936/3873] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:51 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:52.138496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.147214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.270785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.272419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd97d2-2cbf-4d2f-83c3-d3341bee0c66 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.279259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9b7e7-e283-4c92-b898-9f4d97d775b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.286292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.286916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.287308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.287543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.296051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.296188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1938/3874] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:52.296273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aff5a4-41d2-4394-b4fb-0989de92e570 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.296348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.296348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.296348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.331285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:52.333167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.345429 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1939/3875] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:52.346341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.360647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede39ee-597b-499c-aa96-d9c6e982efbe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.365990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.366668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.367032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.367356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.368161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.370844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.561240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1937/3876] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/projects => generated 401 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:52.562749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.563038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.563313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.585001 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1940/3877] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:52.586427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.607379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] MFA Rules not processed for user `3c0856ee609d41c885755c0f2d12b3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:52.611093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.621952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be0791-cf06-49d0-9632-92bee7093fd1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.756133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.756783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.757041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.757461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.758548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:45:52.758830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.760728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.765467 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1938/3878] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:52.766515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.785652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1941/3879] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:52.786578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.797945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a3be3-3b2f-4f91-8869-d0735f141cff None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.813398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.814178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.815196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.815324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.816304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c67e6b-8761-4df2-8a1a-6859d48bfa0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.817588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.822342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.822604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.825258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.825258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.825258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.825258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.826530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f71bd-8a3c-4df1-ad0a-dfe0055603c6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.841332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1942/3880] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:52.842751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.843038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.843475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.875521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] MFA Rules not processed for user `3c0856ee609d41c885755c0f2d12b3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:52.876924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:52.885453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1943/3881] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:52.886298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.906607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42984ca5-d013-4454-ab00-f95fc063c738 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.912978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.913611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.914758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.915042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.915687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.917786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.960538 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1939/3882] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/users => generated 307 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:52.960538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:52.971272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4f7de-af54-4d16-b044-2c109151b75c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:52.976153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:52.978206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:52.978350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:52.979260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:52.979260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:52.980885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:52.993266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1940/3883] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:52.997670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.064776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb454-8136-4c0a-a10f-2e1e21dabe9e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.068736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.069342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.069621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.069891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.157886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:53.158628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1944/3884] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:52 2022] POST /identity/v3/projects => generated 371 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:53.164641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.165736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.166726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:53.167880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.179137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1941/3885] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:53.180683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.200622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668aaed-71fe-4824-94b7-51650e35ecac service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.288607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.289301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.289728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.290136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.290916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.293161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.296464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622717f-146c-4389-b480-8344e44996cc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.307358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.308235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.308725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.309071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.314005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1942/3886] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:53.315062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.327877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5dfe6-9da0-4e31-bb7d-f7c22744f696 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.332866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.333739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.334020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.334297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] PATH_INFO: `/v3/projects/96636882bcf849f59453cc51a66a6cea/users/7e940640d1b84c489aed2a14be5e2fec/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.353081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96636882bcf849f59453cc51a66a6cea, user_id=7e940640d1b84c489aed2a14be5e2fec, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.355941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.362137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:53.381541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.383196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.395364 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1945/3887] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:53.396446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.408254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e933722-11cd-4efe-8464-304357a5df46 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.414777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.416446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.416446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.416689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.417744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.420479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7176a-fa39-4d6b-b0ad-52e2a518f2bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.558961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1943/3888] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:53 2022] PUT /identity/v3/projects/96636882bcf849f59453cc51a66a6cea/users/7e940640d1b84c489aed2a14be5e2fec/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:53.560414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.644428 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1946/3889] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:53 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:53.645880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.646275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.646648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.671274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a93e7c-c4f6-4fb2-a4c0-e6fe232d183a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:53.683633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:53.686793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:53.687618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:53.688328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] PATH_INFO: `/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401/users/66b6852b48ff4c5386e6344dc6c74f73/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:53.732804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525435bc5fbe40f4b1c2c5d39b9e5401, user_id=66b6852b48ff4c5386e6344dc6c74f73, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:53.734809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:53.748606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] MFA Rules not processed for user `7e940640d1b84c489aed2a14be5e2fec`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:53.750022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:53.887502 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1944/3890] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:53 2022] PUT /identity/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401/users/66b6852b48ff4c5386e6344dc6c74f73/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:53.887502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.926681 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1947/3891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:53.935379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:53.950214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42b789-9acc-4f73-b7c4-35545f961685 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.048667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b5f69-d723-4c28-9a06-c6af094bfdc6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.062013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.062566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.062847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.063119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.063855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.065713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.093660 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1945/3892] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:54.096025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.117445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6c14-41bc-4193-802f-29e075de3852 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.129164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.129796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.130143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.130678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.131324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.134628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bbbe6-85f7-492d-9b82-bdeda01ec23e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.136906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.137641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.137928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.140688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.141421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.151911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.174795 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1948/3893] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:54.175764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.196462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d41b81-6b33-455c-883c-cdd6c33f14f2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.196462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.196462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.196462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.196927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.197662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.199386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a384c-381c-4e53-8466-e9c67aa6f1c1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.212465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1949/3894] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:54.213982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.214337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.215349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:45:54.226508 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:45:54.227999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:45:54.250939 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1950/3895] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 37 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:45:54.255252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.271604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3322a6-5ee4-4095-8512-e4cb813e64f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.277917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.278726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.279139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.279549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] PATH_INFO: `/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401/users/66b6852b48ff4c5386e6344dc6c74f73/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.282857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=525435bc5fbe40f4b1c2c5d39b9e5401, user_id=66b6852b48ff4c5386e6344dc6c74f73, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.286427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.326167 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1951/3896] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:54 2022] PUT /identity/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401/users/66b6852b48ff4c5386e6344dc6c74f73/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:54.331839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.354537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1946/3897] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:54.357357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.357642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.363781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.439495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] MFA Rules not processed for user `66b6852b48ff4c5386e6344dc6c74f73`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:54.441387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:54.554761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c5c19-69dd-4c68-bc04-da838f84ccd2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.655435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1947/3898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:54.656306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.711849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.712885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.713321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.714675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] PATH_INFO: `/v3/projects/d143d12bb4b94c3b9da7baa4aaa435a5/users/dbaf52c5888f42f19575e580751ef726/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.749055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d143d12bb4b94c3b9da7baa4aaa435a5, user_id=dbaf52c5888f42f19575e580751ef726, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.751822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.775381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432fd593-b7f8-41e7-b042-0f9fc987626b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:54.780790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:54.781677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:54.782146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:54.782572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:54.783557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:54.785930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:54.898564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1952/3899] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:54 2022] PUT /identity/v3/projects/d143d12bb4b94c3b9da7baa4aaa435a5/users/dbaf52c5888f42f19575e580751ef726/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:54.899882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.942169 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1948/3900] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:54.942476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:54.953598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:54.996808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a5368-11ba-41e7-9d53-9a675afe62c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:55.150030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:55.150908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.151287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.151803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] PATH_INFO: `/v3/users/579094f4845f4cca8e14fe2fa489af93` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.155623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579094f4845f4cca8e14fe2fa489af93)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:55.157970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:55.165800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb5ff-1939-42f9-a0b2-346858c6c947 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:55.181851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b6852b48ff4c5386e6344dc6c74f73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '525435bc5fbe40f4b1c2c5d39b9e5401', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:55.183336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.183617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.183895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.185800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:55.191924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757c1f-45d4-437e-b21b-c16bab8df80b tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:55.363967 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1953/3901] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:45:54 2022] POST /identity/v3/roles => generated 239 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:55.365426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5b87-429f-426e-810f-4e90433861fd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.366987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5b87-429f-426e-810f-4e90433861fd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.366987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de5b87-429f-426e-810f-4e90433861fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.438531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-44de5b87-429f-426e-810f-4e90433861fd None None] MFA Rules not processed for user `dbaf52c5888f42f19575e580751ef726`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:55.441913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-44de5b87-429f-426e-810f-4e90433861fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:55.598905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1954/3902] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:55.599901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5b87-429f-426e-810f-4e90433861fd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:55.620245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44de5b87-429f-426e-810f-4e90433861fd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:55.638612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:55.640027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.641497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.642007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.645789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:55.648865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:55.678455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:55.696414 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1955/3903] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:55 2022] GET /identity/v3/roles => generated 1650 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:55.696414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:55.707172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579094f4845f4cca8e14fe2fa489af93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:55.710300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142b10b-865f-4f78-80e4-8a282ed0b943 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:55.717674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b6852b48ff4c5386e6344dc6c74f73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '525435bc5fbe40f4b1c2c5d39b9e5401', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:55.718515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.718900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.719322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] PATH_INFO: `/v3/projects/cbcc9e09182b42709273d2162f3c8729/users/c2590fd697a248efb83d77da0e7fb371/roles/a2be10bf35534d73bd743b1b26cd945b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.721998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cbcc9e09182b42709273d2162f3c8729, user_id=c2590fd697a248efb83d77da0e7fb371, role_id=a2be10bf35534d73bd743b1b26cd945b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:55.730373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c5329-4803-4474-b163-d25407c2e346 tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:55.855274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579094f4845f4cca8e14fe2fa489af93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:55.865214 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1956/3904] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:55 2022] PUT /identity/v3/projects/cbcc9e09182b42709273d2162f3c8729/users/c2590fd697a248efb83d77da0e7fb371/roles/a2be10bf35534d73bd743b1b26cd945b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:55.865214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:55.865214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:55.865214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:55.879857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579094f4845f4cca8e14fe2fa489af93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:55.881449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579094f4845f4cca8e14fe2fa489af93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:55.884230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579094f4845f4cca8e14fe2fa489af93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:55.898457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] MFA Rules not processed for user `dbaf52c5888f42f19575e580751ef726`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:55.900002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:55.918865 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1949/3905] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:54 2022] DELETE /identity/v3/users/579094f4845f4cca8e14fe2fa489af93 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:55.919641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:55.928084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.046940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1957/3906] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:56.047667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.054672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.119782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccde06-e7a9-44d4-bbdc-d254104c7ed5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.138611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.139357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.139664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.139945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] PATH_INFO: `/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431/users/a32f92ba26cf45d9ba6db750f27cb0b8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.201646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1af2aaba884e4aa55a9d6c78a0b431, user_id=a32f92ba26cf45d9ba6db750f27cb0b8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.204459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37cc0b-78cf-45b7-bf6d-b7df4006434c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.235395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020850-c739-4177-8039-64588fe9aa31 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.344669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2590fd697a248efb83d77da0e7fb371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbcc9e09182b42709273d2162f3c8729', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'tempest-test_role-234938267'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.344669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.345327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.345327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] PATH_INFO: `/v3/users/c2590fd697a248efb83d77da0e7fb371/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.347189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: Authorizing `identity:create_application_credential(user_id=c2590fd697a248efb83d77da0e7fb371)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.349500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.362650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1950/3907] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:55 2022] PUT /identity/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431/users/a32f92ba26cf45d9ba6db750f27cb0b8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:56.363991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.364284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.366830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.407289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:56.411106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.568344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1951/3908] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:56.568344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.568344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.609446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:56.690497 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1958/3909] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:45:56 2022] POST /identity/v3/users/c2590fd697a248efb83d77da0e7fb371/application_credentials => generated 658 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:56.691347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.703029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6bdf4-b64d-4146-bf20-8e57f51d5d97 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.720986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282e8d0-d9b4-4749-8c63-6d336aaf98d8 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.721096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.721096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.721096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.721096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.721438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.721546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.721546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.721546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.722352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.723288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.725593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.754727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1959/3910] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:45:56 2022] GET /identity/v3/roles => generated 1650 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:45:56.756746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.759684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.835811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.838186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064083-d777-4fa0-84d6-93171f1b35e0 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.840257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd93b-20d1-44fb-bb82-7352010c906f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.844402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.845242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.845588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.845938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.863642 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1952/3911] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:56.866618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.866618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.866618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.867936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.869987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:56.901405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1960/3912] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:45:56.906727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:56.944453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] MFA Rules not processed for user `c2590fd697a248efb83d77da0e7fb371`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:56.944634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f35d3d-c4be-4bff-af37-9cfc4e4c6ccf service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:56.944721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:56.949249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:56.950317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:56.950876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:56.952900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] PATH_INFO: `/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431/users/a32f92ba26cf45d9ba6db750f27cb0b8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:56.957562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1af2aaba884e4aa55a9d6c78a0b431, user_id=a32f92ba26cf45d9ba6db750f27cb0b8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:56.967051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba474a40-d265-4b92-9400-583bd5ad26c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:57.019694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1961/3913] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:45:56 2022] PUT /identity/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431/users/a32f92ba26cf45d9ba6db750f27cb0b8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:57.021293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:57.021580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:57.058945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:57.158742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] MFA Rules not processed for user `a32f92ba26cf45d9ba6db750f27cb0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:45:57.160211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:57.373878 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1953/3914] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3393 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 02 12:45:57.379214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:57.389644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1962/3915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:45:57.390904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:57.403644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eaa0d-5fe3-4a40-a60c-fb0913d1d5ed None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:57.415036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:57.415785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:57.416127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:57.416496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:57.420697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:57.422914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:57.571891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54284f6c-549b-475b-a1a5-39a40a680c6a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:57.581438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2590fd697a248efb83d77da0e7fb371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cbcc9e09182b42709273d2162f3c8729', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'tempest-test_role-234938267'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:57.581955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:57.582313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:57.582661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] PATH_INFO: `/v3/users/c2590fd697a248efb83d77da0e7fb371/application_credentials/fc3f5e93b9124a4da8343c3409c32894` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:57.584955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c2590fd697a248efb83d77da0e7fb371, application_credential_id=fc3f5e93b9124a4da8343c3409c32894)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:57.592655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:57.787246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1963/3916] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:45:57 2022] POST /identity/v3/projects => generated 349 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:57.789756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:57.865072 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1954/3917] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:45:57 2022] DELETE /identity/v3/users/c2590fd697a248efb83d77da0e7fb371/application_credentials/fc3f5e93b9124a4da8343c3409c32894 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:57.873463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:57.876481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:57.971190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deef75-1bee-42f4-87d5-636366a80f0d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:57.982697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:57.983340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:57.983629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:57.983907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:57.984578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:57.989968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:58.041783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bf301-a05d-4f0c-a1ab-efc042781614 tempest-ApplicationCredentialsV3AdminTest-356965869 tempest-ApplicationCredentialsV3AdminTest-356965869-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:58.214507 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1964/3918] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:45:57 2022] POST /identity/v3/projects => generated 350 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:45:58.215752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:58.222733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:58.252740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66b6852b48ff4c5386e6344dc6c74f73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '525435bc5fbe40f4b1c2c5d39b9e5401', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:58.253872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.254157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.254435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] PATH_INFO: `/v3/roles/a2be10bf35534d73bd743b1b26cd945b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.258334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a2be10bf35534d73bd743b1b26cd945b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:58.261312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:58.385495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cabc06-839a-4db8-957f-1fc9f1849011 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:58.391448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:58.392282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.392369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.392710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] PATH_INFO: `/v3/projects/e36225d06ca4473e98ae746b3fa625e4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.394081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36225d06ca4473e98ae746b3fa625e4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:58.396279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:58.657378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36225d06ca4473e98ae746b3fa625e4', 'request_id': 'req-39c2bb7d-534e-4d38-8b9b-dca0718bb788'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.669003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36225d06ca4473e98ae746b3fa625e4', 'request_id': 'req-39c2bb7d-534e-4d38-8b9b-dca0718bb788'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.688895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36225d06ca4473e98ae746b3fa625e4', 'request_id': 'req-39c2bb7d-534e-4d38-8b9b-dca0718bb788'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.760662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Invalidating the token cache because role a2be10bf35534d73bd743b1b26cd945b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:58.761324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.762868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.765904 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1955/3919] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:57 2022] DELETE /identity/v3/roles/a2be10bf35534d73bd743b1b26cd945b => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:58.771704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:58.774815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:58.850560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:58.864374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] The token cache is being invalidate because project e36225d06ca4473e98ae746b3fa625e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:45:58.864710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.865797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:58.869124 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1965/3920] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:45:58 2022] DELETE /identity/v3/projects/e36225d06ca4473e98ae746b3fa625e4 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:58.870248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:58.877817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:58.924298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a72720-5bf3-4d03-af5d-87d558a21fda tempest-ApplicationCredentialsV3AdminTest-126007974 tempest-ApplicationCredentialsV3AdminTest-126007974-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:58.930530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:58.931704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:58.931704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:58.932011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/users/7e940640d1b84c489aed2a14be5e2fec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:58.933523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:get_user(user_id=7e940640d1b84c489aed2a14be5e2fec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:58.936221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:58.941708 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1956/3921] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:45:58 2022] GET /identity/v3/users/7e940640d1b84c489aed2a14be5e2fec => generated 288 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:45:58.941708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:58.942627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:59.057953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2bb7d-534e-4d38-8b9b-dca0718bb788 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:59.104806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c49a7-bfab-4a8a-8343-f94a2cbfdb0a tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:45:59.105431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:59.106300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:59.107217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:59.107692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] PATH_INFO: `/v3/users/6c0ff5cbff394e75b11ccf0a02904652` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:59.109388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0ff5cbff394e75b11ccf0a02904652)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:59.111924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:59.232752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:45:59.232752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:45:59.233114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:45:59.234515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] PATH_INFO: `/v3/users/c2590fd697a248efb83d77da0e7fb371` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:45:59.237783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2590fd697a248efb83d77da0e7fb371)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:45:59.242754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:45:59.488268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0ff5cbff394e75b11ccf0a02904652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.710061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2590fd697a248efb83d77da0e7fb371'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.728793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0ff5cbff394e75b11ccf0a02904652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.754057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0ff5cbff394e75b11ccf0a02904652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.762234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0ff5cbff394e75b11ccf0a02904652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.763009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0ff5cbff394e75b11ccf0a02904652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.790051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1957/3922] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:58 2022] DELETE /identity/v3/users/6c0ff5cbff394e75b11ccf0a02904652 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:59.792743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:59.796701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:59.901988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2590fd697a248efb83d77da0e7fb371'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.937244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2590fd697a248efb83d77da0e7fb371'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.953122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2590fd697a248efb83d77da0e7fb371'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.953762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2590fd697a248efb83d77da0e7fb371'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:45:59.964610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1966/3923] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:45:58 2022] DELETE /identity/v3/users/c2590fd697a248efb83d77da0e7fb371 => generated 0 bytes in 1094 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:45:59.965494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:45:59.968567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:45:59.989883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b49f21-f04c-4058-a1da-8bf40d9fb672 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:00.090687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:00.091652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.096791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.096791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.096791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:00.112002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b0a6-0a48-436c-a27b-2ed93bb25a25 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:00.115335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.118799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810f3e2-7c6e-45b4-b596-3ca2432e0a64 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.123729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:00.125035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.125515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.126027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.126936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.129850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa79c0d-c8c3-4e42-8185-959fcc556d58 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.178478 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1958/3924] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:00.178599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.178989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.179095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.235420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] MFA Rules not processed for user `dbaf52c5888f42f19575e580751ef726`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:00.240963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:00.357235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1967/3925] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Nov 2 12:45:59 2022] POST /identity/v3/credentials => generated 429 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:00.359029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.361495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.361977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.444667 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1959/3926] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:00.447093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:00.447299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:00.470965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:00.473742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ac3c6f-e2c7-40ca-92a0-90e9ffda6768 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:00.491547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:00.493019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.493567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.493736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.502404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.516746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.529655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.535668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.708255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1960/3927] 10.222.0.64 () {60 vars in 1358 bytes} [Wed Nov 2 12:46:00 2022] PATCH /identity/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d => generated 436 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:00.716837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:00.738258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8bfbb-3052-4f34-a9c7-b882a2252943 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:00.753208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:00.757063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.757294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1968/3928] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:00.757742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.757742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.758617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.764259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.773936 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1961/3929] 10.222.0.64 () {58 vars in 1335 bytes} [Wed Nov 2 12:46:00 2022] GET /identity/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d => generated 436 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:46:00.780055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:00.780994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:00.783022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:00.795786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54adba99-f7fc-41c6-9222-a153e9e88b89 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:00.806007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:00.810077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:00.810486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:00.810835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:00.817882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:00.822648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:00.940534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:01.003679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f796240-9d0f-4e19-a247-6098d4434e69 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.013747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.014526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.014644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.014907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.037586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1969/3930] 10.222.0.64 () {58 vars in 1338 bytes} [Wed Nov 2 12:46:00 2022] DELETE /identity/v3/credentials/5ea35600475c511c87eaa3fbd342abfc9d8b61ec1be746db50d5810e7b1cdb5d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:01.038363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.039465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.040505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.065978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a7f71-72e5-48dd-8f4e-884fe7b5ccec tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.073280 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1962/3931] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:46:01.079366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.080012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.080293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.080593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.081262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.088572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.215704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.217794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:01.248779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707c05-2bb6-469b-ad00-d7ecb3e17740 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.285118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.285771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.286046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.286318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] PATH_INFO: `/v3/projects/56269235ae224044a8710a7117ebdb2c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.287577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56269235ae224044a8710a7117ebdb2c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.292900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.369814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1970/3932] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Nov 2 12:46:01 2022] POST /identity/v3/credentials => generated 429 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:01.374017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.456446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae63f0c-8441-42f2-b389-a925598222ed tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.476718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.477447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.477732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.478005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.478668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.482317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.719959 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1971/3933] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Nov 2 12:46:01 2022] POST /identity/v3/credentials => generated 431 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:01.723149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.767506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56269235ae224044a8710a7117ebdb2c', 'request_id': 'req-53b877d2-7e96-44df-ae4e-324c3aa1561d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:01.771671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda00b9-8352-45eb-b605-1d72a0842b4d tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:01.782975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56269235ae224044a8710a7117ebdb2c', 'request_id': 'req-53b877d2-7e96-44df-ae4e-324c3aa1561d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:01.928217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:01.930148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:01.930754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:01.931276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:01.932120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.933759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.943685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.947110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.949291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:01.951896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:01.952924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56269235ae224044a8710a7117ebdb2c', 'request_id': 'req-53b877d2-7e96-44df-ae4e-324c3aa1561d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:01.958454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1972/3934] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Nov 2 12:46:01 2022] GET /identity/v3/credentials => generated 945 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:01.959865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:01.976886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b551b4-2d8a-47dc-a09b-c9dd332a4562 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.013011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.015676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.017787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.022464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials/10f7d5abb254d225704721469fbcff0a66cdbe3ff00f187352fbad697d34b574` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.042284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] The token cache is being invalidate because project 56269235ae224044a8710a7117ebdb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:02.042863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:02.045317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=10f7d5abb254d225704721469fbcff0a66cdbe3ff00f187352fbad697d34b574)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.048073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.048549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53b877d2-7e96-44df-ae4e-324c3aa1561d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:02.057619 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1963/3935] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:01 2022] DELETE /identity/v3/projects/56269235ae224044a8710a7117ebdb2c => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:46:02.064599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c638bc-ed6b-4571-b852-4c38965b87d8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.065060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c638bc-ed6b-4571-b852-4c38965b87d8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.067790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c638bc-ed6b-4571-b852-4c38965b87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.135471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d8c638bc-ed6b-4571-b852-4c38965b87d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:02.138014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8c638bc-ed6b-4571-b852-4c38965b87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:02.225958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1973/3936] 10.222.0.64 () {58 vars in 1338 bytes} [Wed Nov 2 12:46:01 2022] DELETE /identity/v3/credentials/10f7d5abb254d225704721469fbcff0a66cdbe3ff00f187352fbad697d34b574 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:02.232004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.240080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:02.323550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538d029-045d-45f9-a0a5-5b525d123fea tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.340074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.341027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.341567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.342048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/credentials/4abedd164b2d39adcbe7cacd8bde94b24f226c7e57b04ea88096de177dbaa67b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.345276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=4abedd164b2d39adcbe7cacd8bde94b24f226c7e57b04ea88096de177dbaa67b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.354520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.369790 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1964/3937] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:02.377773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.378287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.389080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.442900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:02.447739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:02.476687 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1965/3938] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:02.478201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.501502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533ace5-d0a3-49b0-9eca-a2ff64bbe001 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.526917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.530619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.530910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.535334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.537769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:02.538078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.540388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.567838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1966/3939] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:02.575641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.582769 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1974/3940] 10.222.0.64 () {58 vars in 1338 bytes} [Wed Nov 2 12:46:02 2022] DELETE /identity/v3/credentials/4abedd164b2d39adcbe7cacd8bde94b24f226c7e57b04ea88096de177dbaa67b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:02.586954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.598470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec070eb8-4be3-43ef-9a4e-93e313c10fc3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.610450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.610717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.611510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.611510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.612069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.615581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.635770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162158c7-1f7d-4c38-a05c-bf3f7003578e tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:02.661344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:02.662700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:02.663175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:02.663725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/projects/3a577579eba84e249f0ed480c28ffaed` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:02.665974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3a577579eba84e249f0ed480c28ffaed)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:02.671650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:02.784123 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1967/3941] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:02 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:46:02.793162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:02.978997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37255e-2456-4bb4-b0ba-ebf11541bc1d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:03.000167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:03.001086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:03.001763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:03.002292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:03.003227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:03.006433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:03.141704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1968/3942] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:02 2022] POST /identity/v3/users => generated 291 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:03.141704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:03.146424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:03.211726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a577579eba84e249f0ed480c28ffaed', 'request_id': 'req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.212232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c9e83-c918-4188-95ec-ddbf7aa69148 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:03.235115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a577579eba84e249f0ed480c28ffaed', 'request_id': 'req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.253514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a577579eba84e249f0ed480c28ffaed', 'request_id': 'req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.277241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:03.373951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] The token cache is being invalidate because project 3a577579eba84e249f0ed480c28ffaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:03.374332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.376652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.385899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:03.386129 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1975/3943] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:02 2022] DELETE /identity/v3/projects/3a577579eba84e249f0ed480c28ffaed => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:03.390066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:03.392398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:03.392838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:03.393497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] PATH_INFO: `/v3/projects/cbcc9e09182b42709273d2162f3c8729` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:03.397225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcc9e09182b42709273d2162f3c8729)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:03.398942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:03.401819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:03.449185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8b7b-090f-4776-a55b-2d1ce266cb87 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:03.458988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:03.469523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:03.471389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:03.472419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:03.474075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:03.478686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:03.514398 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1976/3944] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:03.515932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:03.520386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:03.650247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcc9e09182b42709273d2162f3c8729', 'request_id': 'req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.680520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcc9e09182b42709273d2162f3c8729', 'request_id': 'req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.709345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02db53-1df5-4848-a108-5d7aa7ce0093 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:03.803275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcc9e09182b42709273d2162f3c8729', 'request_id': 'req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.828549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] The token cache is being invalidate because project cbcc9e09182b42709273d2162f3c8729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:03.828796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.829575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:03.834488 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1969/3945] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:03 2022] DELETE /identity/v3/projects/cbcc9e09182b42709273d2162f3c8729 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:03.834488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:03.836011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:03.864463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a32f92ba26cf45d9ba6db750f27cb0b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:03.881334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:03.881646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:03.884692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] PATH_INFO: `/v3/projects/e1e74a9e2b1f420aaac227855a3596da` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:03.894535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e1e74a9e2b1f420aaac227855a3596da)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:03.909608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:04.163025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb64998-4cd9-4b8d-9a88-e3a882aeed9e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:04.177711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:04.178740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.179813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.180302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.181215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:04.183822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:04.197783 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1970/3946] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:04.199021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:04.216931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:04.269153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:04.295776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a330-2e28-4e2f-8a32-49e635f9c5e8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:04.335299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e74a9e2b1f420aaac227855a3596da', 'request_id': 'req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.366312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e74a9e2b1f420aaac227855a3596da', 'request_id': 'req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.385915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e74a9e2b1f420aaac227855a3596da', 'request_id': 'req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.477912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:04.478970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.479588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.480340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] PATH_INFO: `/v3/users/66b6852b48ff4c5386e6344dc6c74f73` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.491775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b6852b48ff4c5386e6344dc6c74f73)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:04.498637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:04.561533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] The token cache is being invalidate because project e1e74a9e2b1f420aaac227855a3596da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:04.562319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.562836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.566064 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1977/3947] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:03 2022] DELETE /identity/v3/projects/e1e74a9e2b1f420aaac227855a3596da => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:04.567281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:04.573307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:04.620950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d2b9-7a10-4a53-a3c1-8399bdbaae91 tempest-CredentialsTestJSON-1547510741 tempest-CredentialsTestJSON-1547510741-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:04.628972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:04.630130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:04.630888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:04.631383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] PATH_INFO: `/v3/users/3c0856ee609d41c885755c0f2d12b3f5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:04.633794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0856ee609d41c885755c0f2d12b3f5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:04.635944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:04.834042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b6852b48ff4c5386e6344dc6c74f73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.928678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b6852b48ff4c5386e6344dc6c74f73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.949730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b6852b48ff4c5386e6344dc6c74f73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.952443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b6852b48ff4c5386e6344dc6c74f73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.954372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b6852b48ff4c5386e6344dc6c74f73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.963598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0856ee609d41c885755c0f2d12b3f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:04.986482 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1971/3948] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:04 2022] DELETE /identity/v3/users/66b6852b48ff4c5386e6344dc6c74f73 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:04.988041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:04.996258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:05.100751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0856ee609d41c885755c0f2d12b3f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.135679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0856ee609d41c885755c0f2d12b3f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.160394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0856ee609d41c885755c0f2d12b3f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.165595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0856ee609d41c885755c0f2d12b3f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.191471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1978/3949] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:04 2022] DELETE /identity/v3/users/3c0856ee609d41c885755c0f2d12b3f5 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:05.192626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:05.203316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:05.235694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1f91b-2d9e-4644-8c2f-b1662233745f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:05.480357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9ae8f-4cc6-48a5-a75c-ba08e6b871c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:05.498557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:05.499259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:05.499610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:05.499806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] PATH_INFO: `/v3/projects/b4ece0f32add4c23b3a2c79130662082/users/ff68270ee0a5457e92192da5485ec3fe/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:05.503565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:05.504596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:05.505026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:05.508947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] PATH_INFO: `/v3/users/7e940640d1b84c489aed2a14be5e2fec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:05.530442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e940640d1b84c489aed2a14be5e2fec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:05.536931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:05.562808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ece0f32add4c23b3a2c79130662082, user_id=ff68270ee0a5457e92192da5485ec3fe, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:05.567859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee53ca-dded-40f8-bc8f-501c05460ce0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:05.710987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1972/3950] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:04 2022] PUT /identity/v3/projects/b4ece0f32add4c23b3a2c79130662082/users/ff68270ee0a5457e92192da5485ec3fe/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:05.723004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f32f-9675-4256-881f-3d89a717e319 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:05.723364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f32f-9675-4256-881f-3d89a717e319 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:05.723688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f32f-9675-4256-881f-3d89a717e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:05.830133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0ed1f32f-9675-4256-881f-3d89a717e319 None None] MFA Rules not processed for user `ff68270ee0a5457e92192da5485ec3fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:05.831716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ed1f32f-9675-4256-881f-3d89a717e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:05.868519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e940640d1b84c489aed2a14be5e2fec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.970025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e940640d1b84c489aed2a14be5e2fec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:05.995088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e940640d1b84c489aed2a14be5e2fec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.014761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e940640d1b84c489aed2a14be5e2fec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.014761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e940640d1b84c489aed2a14be5e2fec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.033132 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1979/3951] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:05 2022] DELETE /identity/v3/users/7e940640d1b84c489aed2a14be5e2fec => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:06.034787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1973/3952] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:06.036206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.038066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.039157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.039584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.041835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.073286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:06.074775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.152022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae000790-157e-47a4-8776-264cb0daf82b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.156286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.157075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.157348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.157624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.161164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.203694 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1974/3953] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:06.210604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.210604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.222351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfac1d6-be7c-4278-968d-d3e636a6fc33 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.236593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.237340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.238265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.238396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] PATH_INFO: `/v3/projects/9f93f39d26df455292e782018b938219` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.240806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:06.243140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f93f39d26df455292e782018b938219)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.256632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.343628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.346494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.364524 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1980/3954] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:06.365698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.368025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.479609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f93f39d26df455292e782018b938219', 'request_id': 'req-c0df95d7-123f-42be-8a95-c18d66f7deac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.493347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f93f39d26df455292e782018b938219', 'request_id': 'req-c0df95d7-123f-42be-8a95-c18d66f7deac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.524958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9ceeb-6ae1-49ea-8edf-0f43a66949ab service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.606424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.609368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.609368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.609368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.649258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f93f39d26df455292e782018b938219', 'request_id': 'req-c0df95d7-123f-42be-8a95-c18d66f7deac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.669553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] The token cache is being invalidate because project 9f93f39d26df455292e782018b938219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:06.672781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.675361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:06.681420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1975/3955] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:06 2022] DELETE /identity/v3/projects/9f93f39d26df455292e782018b938219 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:06.683675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.688310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.771343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.773598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.790748 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1981/3956] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:06.796424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:06.804895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.831019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54279a28-e110-4a16-bf57-d4ebcff5f3d1 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.843740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.843740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.843740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.843740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.844894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.865714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.868180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5422d3c-c6aa-4976-8128-f3d1df2a741b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.886238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df95d7-123f-42be-8a95-c18d66f7deac admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:06.891331 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1982/3957] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:06.896720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c933a-f404-47e6-b083-73e594e1f3ad None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.897091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c933a-f404-47e6-b083-73e594e1f3ad None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.898182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c933a-f404-47e6-b083-73e594e1f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.898580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:06.901475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.906652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.906652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] PATH_INFO: `/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:06.910166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525435bc5fbe40f4b1c2c5d39b9e5401)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:06.918098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:06.939784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b55c933a-f404-47e6-b083-73e594e1f3ad None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:06.941828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b55c933a-f404-47e6-b083-73e594e1f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:06.988787 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1983/3958] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:06.990862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:06.991196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:06.992197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.070564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:07.071703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.098421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1984/3959] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:07.100012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:07.113533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.120111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bfb58-9c04-45cc-84cd-44a45a86e57b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:07.129842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:07.130995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.131528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.131806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] PATH_INFO: `/v3/users/ff68270ee0a5457e92192da5485ec3fe` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.135795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff68270ee0a5457e92192da5485ec3fe)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:07.137856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:07.183278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525435bc5fbe40f4b1c2c5d39b9e5401', 'request_id': 'req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.193019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525435bc5fbe40f4b1c2c5d39b9e5401', 'request_id': 'req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.332435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525435bc5fbe40f4b1c2c5d39b9e5401', 'request_id': 'req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.359200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] The token cache is being invalidate because project 525435bc5fbe40f4b1c2c5d39b9e5401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:07.359502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.361437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.363940 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1976/3960] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:06 2022] DELETE /identity/v3/projects/525435bc5fbe40f4b1c2c5d39b9e5401 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:07.365151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:07.372522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.479994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff68270ee0a5457e92192da5485ec3fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.509700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71e4e5-4108-4c08-b5aa-daa34ac18b36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:07.523783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:07.524810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.525149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.525443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.526031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:07.526341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:07.528210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bb803-28a5-4372-894e-816fb08886e1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:07.553921 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1977/3961] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:07.553921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.553921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.553921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.587286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:07.588713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.589206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff68270ee0a5457e92192da5485ec3fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.600769 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1978/3962] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:07.602437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:07.607882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff68270ee0a5457e92192da5485ec3fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.618616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff68270ee0a5457e92192da5485ec3fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.620047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b13f347f-ace4-461b-a2b8-ee4b0d3d9106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff68270ee0a5457e92192da5485ec3fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:07.626608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e5a26-05e8-4a6a-94ab-0d93a763d3bb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:07.628973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1985/3963] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:07 2022] DELETE /identity/v3/users/ff68270ee0a5457e92192da5485ec3fe => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:07.630771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.631215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.631643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.648121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:07.648778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.649109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.649305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.653002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:07.659667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:07.660344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fa3d4-00d0-4066-9122-cc92926665fa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:07.661375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.815646 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1979/3964] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:07 2022] POST /identity/v3/projects => generated 401 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:07.815646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:07.815646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:07.816807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:07.833839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1986/3965] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:07.838653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:07.842134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:07.879679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6c89e-b3c6-4320-b84a-9592bdf570d0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:07.885663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:07.890887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.033831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1980/3966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:08.034834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.050615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.067580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c80ea-701e-45db-933f-1b75158d10aa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:08.081727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.082514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.082892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.083311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.084853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.088988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.094631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.095263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.095655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.096037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] PATH_INFO: `/v3/projects/96636882bcf849f59453cc51a66a6cea` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.098178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=96636882bcf849f59453cc51a66a6cea)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.101745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.629405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1981/3967] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:08 2022] POST /identity/v3/users => generated 301 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:08.634075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.666174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96636882bcf849f59453cc51a66a6cea', 'request_id': 'req-c197f109-fd93-493f-ba55-89bc0c75a4eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:08.677766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96636882bcf849f59453cc51a66a6cea', 'request_id': 'req-c197f109-fd93-493f-ba55-89bc0c75a4eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:08.690288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4296c4b-1c97-4691-946b-acf72f8e1d99 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:08.697048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96636882bcf849f59453cc51a66a6cea', 'request_id': 'req-c197f109-fd93-493f-ba55-89bc0c75a4eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:08.747717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:08.823286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.824237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.824710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.825019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.825873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:08.826328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.828355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.832985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] The token cache is being invalidate because project 96636882bcf849f59453cc51a66a6cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:08.833576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:08.835148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:08.840571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1987/3968] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:07 2022] DELETE /identity/v3/projects/96636882bcf849f59453cc51a66a6cea => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:08.840571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.842141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.853565 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1982/3969] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:08.854449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.856388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.871405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f278c6-f2c0-4978-9a4b-f1e4454c0d35 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:08.877587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.878316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.878947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.879295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.880857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.882360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.899304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1983/3970] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:08.900545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.904264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.926651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fccc3-1b52-43fe-a3c3-1027bc52f976 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:08.936574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.937658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.938206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.938692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] PATH_INFO: `/v3/users/a32f92ba26cf45d9ba6db750f27cb0b8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.939740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f109-fd93-493f-ba55-89bc0c75a4eb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:08.941008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32f92ba26cf45d9ba6db750f27cb0b8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.944433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.945443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:08.948621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:08.948621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:08.948621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:08.952953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:08.973724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:08.975238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:08.987274 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1988/3971] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:08.988231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:08.989830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:09.003723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd899-38e2-4016-af35-8e999d9801ed service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.009979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.010751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.011102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.011489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.012692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:09.014963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:09.349819 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1989/3972] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:08 2022] POST /identity/v3/projects => generated 375 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:09.351445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:09.493615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a61666-2480-48e3-8394-3a0c76d90b8d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.519949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.522438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.526200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.529478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.535646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:09.544210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32f92ba26cf45d9ba6db750f27cb0b8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.552274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:09.586372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1990/3973] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:09.587924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:09.592281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:09.624100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae925ac-8f3e-43fd-b408-6f5c1d3840b0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.630124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.631096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.631398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.631671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] PATH_INFO: `/v3/users/1dea9e27e67b4fd888fb2c4085ec5bfb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.633071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dea9e27e67b4fd888fb2c4085ec5bfb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:09.635011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:09.660805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32f92ba26cf45d9ba6db750f27cb0b8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.675560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32f92ba26cf45d9ba6db750f27cb0b8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.676289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32f92ba26cf45d9ba6db750f27cb0b8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.676919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32f92ba26cf45d9ba6db750f27cb0b8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.691959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1984/3974] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:08 2022] DELETE /identity/v3/users/a32f92ba26cf45d9ba6db750f27cb0b8 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:09.695772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:09.701324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:09.777291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:09.825838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce861c64-7068-4640-99b4-1a26069de39f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.833050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.834099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.834396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.834793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.836243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:09.838756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:09.929836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dea9e27e67b4fd888fb2c4085ec5bfb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:09.953354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1985/3975] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:09 2022] POST /identity/v3/users => generated 288 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:09.954288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:09.956898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:09.972203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3fc13c-a010-411a-bcaf-bfecdadc4d33 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:09.978719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:09.979477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:09.979796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:09.980036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] PATH_INFO: `/v3/projects/660dc7bfd4d14513b88879ed72cc3f53/users/2f03f274651f4398bd3bdcbb88b3c315/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:09.998893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660dc7bfd4d14513b88879ed72cc3f53, user_id=2f03f274651f4398bd3bdcbb88b3c315, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:10.015827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:10.060286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dea9e27e67b4fd888fb2c4085ec5bfb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.095351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dea9e27e67b4fd888fb2c4085ec5bfb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.113394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dea9e27e67b4fd888fb2c4085ec5bfb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.114838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dea9e27e67b4fd888fb2c4085ec5bfb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.130903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1991/3976] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:09 2022] DELETE /identity/v3/users/1dea9e27e67b4fd888fb2c4085ec5bfb => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:10.133487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:10.142092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.190858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1986/3977] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:09 2022] PUT /identity/v3/projects/660dc7bfd4d14513b88879ed72cc3f53/users/2f03f274651f4398bd3bdcbb88b3c315/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:10.210307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:10.216669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.296953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffb41a-9138-4501-af93-01e387cbf412 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:10.356042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4220a2e-cce5-4634-a677-8482bb36ca75 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:10.363792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:10.364786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:10.365253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:10.365693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:10.377161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:10.381757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1097203-e78d-4864-a18f-3fe7766c3179 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:10.398128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1987/3978] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:10.401168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:10.401611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:10.402215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:10.428051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:10.428051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:10.428051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:10.428051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] PATH_INFO: `/v3/projects/b4ece0f32add4c23b3a2c79130662082` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:10.430667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ece0f32add4c23b3a2c79130662082)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:10.440566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:10.448209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] MFA Rules not processed for user `2f03f274651f4398bd3bdcbb88b3c315`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:10.453429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.571731 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1988/3979] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:10 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:10.573037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:10.575584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.601827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfd1db-4953-47a0-996b-50dcb306d5e8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:10.659183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ece0f32add4c23b3a2c79130662082', 'request_id': 'req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.700573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ece0f32add4c23b3a2c79130662082', 'request_id': 'req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.712463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ece0f32add4c23b3a2c79130662082', 'request_id': 'req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.728761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:10.728761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:10.728761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:10.728761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] PATH_INFO: `/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:10.729565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1af2aaba884e4aa55a9d6c78a0b431)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:10.729565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:10.827488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] The token cache is being invalidate because project b4ece0f32add4c23b3a2c79130662082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:10.828300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.829444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.831041 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1992/3980] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:10 2022] DELETE /identity/v3/projects/b4ece0f32add4c23b3a2c79130662082 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:10.832122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:10.833627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.849475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dfad8f-5acf-4a71-bc5f-96c5b1d77399 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:10.856470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:10.857394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:10.858043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:10.858466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:10.859280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:10.861368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:10.875915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1993/3981] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:10.877127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:10.881072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:10.914971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'request_id': 'req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:10.944970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'request_id': 'req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.003985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388854db-930c-4681-a4ed-f73cbf268382 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:11.081792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:11.082688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.082965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.083242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.085111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.103186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1af2aaba884e4aa55a9d6c78a0b431', 'request_id': 'req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.129026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] The token cache is being invalidate because project cc1af2aaba884e4aa55a9d6c78a0b431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:11.129746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.131499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.133607 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1989/3982] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:10 2022] DELETE /identity/v3/projects/cc1af2aaba884e4aa55a9d6c78a0b431 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:11.135807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:11.139086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.159540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:11.167847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ef436-f4c9-4f60-b4ae-dcca26b5177d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:11.189698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1994/3983] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:11.195631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.196743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.197071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.225346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:11.227400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.245153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec0d23-f33c-4569-b8e6-7a5d3409ef9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:11.250483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:11.251272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.251575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.251859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] PATH_INFO: `/v3/projects/a444e4c0cab7408b8e6cc8b87398f290` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.253277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a444e4c0cab7408b8e6cc8b87398f290)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:11.255723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:11.271197 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1995/3984] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:11.271197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:11.272514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.295269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b68f66-71c2-42dd-9db1-adfb7a41cf88 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:11.303841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:11.305103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.305752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.306201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] PATH_INFO: `/v3/projects/3df30fbe9aac44fda017263999a32859/users/a9fa2445ec34440aaa1c278141b28c2e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.339395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df30fbe9aac44fda017263999a32859, user_id=a9fa2445ec34440aaa1c278141b28c2e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:11.339395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e80137-1fbe-4c74-a637-e3e33137b56c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:11.488007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:11.497032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1996/3985] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:11 2022] PUT /identity/v3/projects/3df30fbe9aac44fda017263999a32859/users/a9fa2445ec34440aaa1c278141b28c2e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:11.512983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.514024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.514934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.532165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a444e4c0cab7408b8e6cc8b87398f290', 'request_id': 'req-05b27db2-c522-4974-92b5-af4c94104026'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.542267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a444e4c0cab7408b8e6cc8b87398f290', 'request_id': 'req-05b27db2-c522-4974-92b5-af4c94104026'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.549518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:11.551106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.620759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1997/3986] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:11.621889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:11.628238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.637034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a444e4c0cab7408b8e6cc8b87398f290', 'request_id': 'req-05b27db2-c522-4974-92b5-af4c94104026'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.643895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb49d9-d1ea-428b-aa73-330e7be3e534 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:11.650979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:11.651638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.651916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.652191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] PATH_INFO: `/v3/users/2f03f274651f4398bd3bdcbb88b3c315` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.652310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] The token cache is being invalidate because project a444e4c0cab7408b8e6cc8b87398f290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:11.652788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.653408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f03f274651f4398bd3bdcbb88b3c315)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:11.653523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b27db2-c522-4974-92b5-af4c94104026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.655303 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1990/3987] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:11 2022] DELETE /identity/v3/projects/a444e4c0cab7408b8e6cc8b87398f290 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:11.656552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2c0eb-2762-43e1-a56e-eba9055f986e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.656879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2c0eb-2762-43e1-a56e-eba9055f986e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.657213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2c0eb-2762-43e1-a56e-eba9055f986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.658570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:11.688686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-87d2c0eb-2762-43e1-a56e-eba9055f986e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:11.689994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-87d2c0eb-2762-43e1-a56e-eba9055f986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.722777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1991/3988] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:11.731345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b21c-95e0-4015-aaad-37b9069ea7dc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.731345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b21c-95e0-4015-aaad-37b9069ea7dc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.731345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54b21c-95e0-4015-aaad-37b9069ea7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.790628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7d54b21c-95e0-4015-aaad-37b9069ea7dc None None] MFA Rules not processed for user `a9fa2445ec34440aaa1c278141b28c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:11.792122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d54b21c-95e0-4015-aaad-37b9069ea7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.898953 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1992/3989] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:11.899927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.900212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.900673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.925207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:11.926786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.936928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f03f274651f4398bd3bdcbb88b3c315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:11.952612 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1993/3990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:11.952612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:11.952612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:11.956866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616fedb-aeec-4090-b587-7effde4c58b7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:11.964070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:11.976698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:11.976698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:11.976698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] PATH_INFO: `/v3/users/357efc23c2104794ba7287d22027c35f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:11.976698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=357efc23c2104794ba7287d22027c35f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:11.976698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.079809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f03f274651f4398bd3bdcbb88b3c315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.105025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f03f274651f4398bd3bdcbb88b3c315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.115410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f03f274651f4398bd3bdcbb88b3c315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.116255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f03f274651f4398bd3bdcbb88b3c315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.126218 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1998/3991] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:11 2022] DELETE /identity/v3/users/2f03f274651f4398bd3bdcbb88b3c315 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:12.127848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.129847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.227689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '357efc23c2104794ba7287d22027c35f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.251745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c106-3243-41ac-84a1-250687be90ce admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.257310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.258378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.258602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.259140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.259527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:12.259853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.261521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.278463 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 1999/3992] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:12.280508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.283251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.306366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251e61-44ce-4b5b-b224-6b9f74fe4bf9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.321254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.321254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.321254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.321254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.321713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.321713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f224687-03a1-4855-99df-b84072108bcb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.346614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '357efc23c2104794ba7287d22027c35f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.363445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '357efc23c2104794ba7287d22027c35f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.364189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '357efc23c2104794ba7287d22027c35f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.364798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '357efc23c2104794ba7287d22027c35f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:12.379728 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1994/3993] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:11 2022] DELETE /identity/v3/users/357efc23c2104794ba7287d22027c35f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:12.381049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.382144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.463632 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2000/3994] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:12.463632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.463632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.463632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.508114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:12.509666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c93ef0-6525-4479-9363-9dcd0e41a2fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.513080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.665225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2001/3995] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:12.666035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.666865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.667154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.667423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.667781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.668300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:12.668637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.669475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.670744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.686695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd1b0b-1c33-4dc3-85cd-b83d0f0e6b7c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.688800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1995/3996] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:12.689880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.691890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.699536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.703235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.703235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.703235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.703235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.705258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.707567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ba20f-ee08-4648-bc9f-abc8676c61d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.713913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:12.715195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:12.715472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:12.715742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:12.716661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:12.718654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:12.861429 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2002/3997] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:12.861429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.867968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:12.900840 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1996/3998] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:12.900840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:12.910455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a2faaf-06f0-4a3a-b866-79108c6d0429 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:12.996877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.000940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958bea3-7a2a-4e9e-ac7e-7b690ed9efaf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.001100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.001100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.001100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.001100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.001702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.002685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.003589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.004035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.004643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.021085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.023546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.038121 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2003/3999] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:13.039465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.045777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.063525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05731a75-9941-4f6b-a2d4-3bd5a51c9307 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.069400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.070713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.070982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.071314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] PATH_INFO: `/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.072532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c33c2fa756405c8ce8db90ae8ca9a8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.074401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.096420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1997/4000] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:12 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:13.097430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.169114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe4c70-ffa4-4976-8d33-5c4a68858b22 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.174310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.174933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.175223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.175485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.176118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.178130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.247595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c33c2fa756405c8ce8db90ae8ca9a8', 'request_id': 'req-d58f9e35-cc29-4344-bb46-6c813d7f8cac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:13.254244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c33c2fa756405c8ce8db90ae8ca9a8', 'request_id': 'req-d58f9e35-cc29-4344-bb46-6c813d7f8cac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:13.261222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c33c2fa756405c8ce8db90ae8ca9a8', 'request_id': 'req-d58f9e35-cc29-4344-bb46-6c813d7f8cac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:13.394131 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1998/4001] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:13 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:13.397629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.408721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dda7-a21d-4b83-9ec9-117e88a29c8c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.427222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] The token cache is being invalidate because project b4c33c2fa756405c8ce8db90ae8ca9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:13.427711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:13.429532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:13.439092 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2004/4002] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:13 2022] DELETE /identity/v3/projects/b4c33c2fa756405c8ce8db90ae8ca9a8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:13.442993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.442993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.505425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.508397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.509405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.509789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.511446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.514064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.547068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 1999/4003] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:13.548420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.552072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.608876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8a8d-6207-4718-852f-1b8fa5968acd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.611591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:13.618815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f9e35-cc29-4344-bb46-6c813d7f8cac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.628439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.629110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.632868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.632868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.632868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.633189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25f73e-17aa-4cbb-be1c-cc83bd272ff8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.643030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.643685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.643958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.644222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.644901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.647111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.668116 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2000/4004] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:13.669555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.669834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.670134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.706663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:13.708905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.728226 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2001/4005] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:13.729717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.731475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.754078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf5d8-be03-4542-8e50-10b3a4b7278c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.764118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.764701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.765124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.765647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] PATH_INFO: `/v3/projects/79202f8392be45df9ffbe31563b59fa8/users/2ea1cc880c0d4ed7b99316ee659fbcf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.786500 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2005/4006] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:13 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:13.787555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.814649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79202f8392be45df9ffbe31563b59fa8, user_id=2ea1cc880c0d4ed7b99316ee659fbcf4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.822048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.830152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a7090-3435-465a-99c8-fc5f31e7119c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:13.837217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:13.838167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.838901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.838901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.839576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:13.841349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424738e-3e8c-4118-bd28-da78281fb981 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:13.854963 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2006/4007] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:13.856669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:13.856952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:13.857225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:13.909967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:13.912365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:13.921015 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2007/4008] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:13.922037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.943702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2002/4009] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:13 2022] PUT /identity/v3/projects/79202f8392be45df9ffbe31563b59fa8/users/2ea1cc880c0d4ed7b99316ee659fbcf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:13.949223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:13.972856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090125fb-98a5-4299-8433-e06cc5aa5cb8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.062960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d18c2-f0d7-4207-ad9e-c62d51a88168 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.068788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.070730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.071013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.072914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] PATH_INFO: `/v3/projects/5d8990b6bd3745c0ac8f4c6446ee808e/users/100ee95a043b46738d71ed446f41d3f0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.080138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.081287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.081825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.082633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.083784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.087438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.094769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8990b6bd3745c0ac8f4c6446ee808e, user_id=100ee95a043b46738d71ed446f41d3f0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.098254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.123761 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2008/4010] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:14.125518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.128821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.155513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e226-a055-4a98-99c1-a8a31247e8db admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.164946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.166331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.167337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.168391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] PATH_INFO: `/v3/users/635d39e48bb24d1c9d494bea38720d5b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.170866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635d39e48bb24d1c9d494bea38720d5b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.175165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.244594 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2003/4011] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:13 2022] PUT /identity/v3/projects/5d8990b6bd3745c0ac8f4c6446ee808e/users/100ee95a043b46738d71ed446f41d3f0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:14.245960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.372470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83e1c0-0ecd-43f7-a203-46949cbaf747 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.375616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.377885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.378277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.378749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.379527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:14.379931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.382627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.411408 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2004/4012] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:14.411408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.416553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.433846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c114e-096b-4e82-bccf-da8056eff940 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.440975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.445577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.447607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.450621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] PATH_INFO: `/v3/projects/660dc7bfd4d14513b88879ed72cc3f53` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.456897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=660dc7bfd4d14513b88879ed72cc3f53)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.460083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.471168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635d39e48bb24d1c9d494bea38720d5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.551045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635d39e48bb24d1c9d494bea38720d5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.566319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635d39e48bb24d1c9d494bea38720d5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.573658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635d39e48bb24d1c9d494bea38720d5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.574402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635d39e48bb24d1c9d494bea38720d5b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.580818 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2009/4013] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:14 2022] DELETE /identity/v3/users/635d39e48bb24d1c9d494bea38720d5b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:14.581709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.583070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.619870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660dc7bfd4d14513b88879ed72cc3f53', 'request_id': 'req-a3c734e3-7093-4784-bb06-12685e29ec7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.632044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660dc7bfd4d14513b88879ed72cc3f53', 'request_id': 'req-a3c734e3-7093-4784-bb06-12685e29ec7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.661169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b0e5e-e3f3-43d4-aa0f-f28a40c1d015 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.705750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660dc7bfd4d14513b88879ed72cc3f53', 'request_id': 'req-a3c734e3-7093-4784-bb06-12685e29ec7e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.733857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] The token cache is being invalidate because project 660dc7bfd4d14513b88879ed72cc3f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:14.736160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.737294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:14.739383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.744088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.744320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2005/4014] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:14 2022] DELETE /identity/v3/projects/660dc7bfd4d14513b88879ed72cc3f53 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:14.744421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.744421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.744421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.744690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.745752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a95181-6cd6-42c4-9132-a9df77a871ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.746205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.759678 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2010/4015] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:14.761390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcc60-7a45-4ce7-8ddd-1461f56f3a7e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.762043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcc60-7a45-4ce7-8ddd-1461f56f3a7e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.762476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dcc60-7a45-4ce7-8ddd-1461f56f3a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.769280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c734e3-7093-4784-bb06-12685e29ec7e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.780207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.780878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.781344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.781745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.782419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.784554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.797691 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2006/4016] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:14.798725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.800988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.811122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ed6dcc60-7a45-4ce7-8ddd-1461f56f3a7e None None] MFA Rules not processed for user `100ee95a043b46738d71ed446f41d3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:14.813490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ed6dcc60-7a45-4ce7-8ddd-1461f56f3a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.817781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfea59-85c3-4981-a873-ab7133278458 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:14.824139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:14.824955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.825256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.826166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.826865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:14.829104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:14.889450 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2011/4017] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:14.890667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358f22-e825-4224-898d-bc34f0f9558c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.890947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358f22-e825-4224-898d-bc34f0f9558c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.891218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358f22-e825-4224-898d-bc34f0f9558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.911658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-35358f22-e825-4224-898d-bc34f0f9558c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:14.913708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35358f22-e825-4224-898d-bc34f0f9558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.920756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2012/4018] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:14.922608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:14.922890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:14.923166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:14.944396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:14.946340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.950622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2007/4019] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:14 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:14.951466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.956243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:14.956394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2013/4020] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:14.957857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:14.968848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214990d5-a49a-4151-bf55-88f7f44cd541 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.034042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.034728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.035006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.035281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] PATH_INFO: `/v3/projects/843cfbc8d00e4e10926a0ce125f83fb4/users/e9570b0583654cb8b55cf2e267d20503/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.036963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bcf3d-2de1-4816-8687-92675ee5fd2a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.041978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.042646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.042920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.043193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] PATH_INFO: `/v3/projects/79202f8392be45df9ffbe31563b59fa8/users/2ea1cc880c0d4ed7b99316ee659fbcf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.045286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79202f8392be45df9ffbe31563b59fa8, user_id=2ea1cc880c0d4ed7b99316ee659fbcf4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.047893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.051644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=843cfbc8d00e4e10926a0ce125f83fb4, user_id=e9570b0583654cb8b55cf2e267d20503, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.065282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.065463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2008/4021] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:14 2022] PUT /identity/v3/projects/79202f8392be45df9ffbe31563b59fa8/users/2ea1cc880c0d4ed7b99316ee659fbcf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:15.065463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.065463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:15.129597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea27532-40d6-4a3f-a2f7-233b283a737b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.134755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.135362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.135646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.135913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.136568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.138468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.232879 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2014/4022] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:14 2022] PUT /identity/v3/projects/843cfbc8d00e4e10926a0ce125f83fb4/users/e9570b0583654cb8b55cf2e267d20503/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:15.233652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.235343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:15.303588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591d27-8218-46fa-af70-4b7d6aa31a8c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.308729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.309378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.309727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.319622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.403171 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2009/4023] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:15.403171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.434676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.437439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3666aa-fdfe-43cc-af13-60756b9b1101 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.455701 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2015/4024] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:15.458354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0155ae-3385-4dc1-864d-3b51876eec7b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.458814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0155ae-3385-4dc1-864d-3b51876eec7b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.459323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0155ae-3385-4dc1-864d-3b51876eec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.501809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5b0155ae-3385-4dc1-864d-3b51876eec7b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:15.503014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b0155ae-3385-4dc1-864d-3b51876eec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:15.535930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04279c02-7b6c-4045-97d1-d6a1699c2e1d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.543882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.543882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.543882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.544301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.544927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.547223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ae489-5feb-4379-8aa0-b735f9b2b337 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.610418 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2016/4025] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:15.612140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.612677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.613150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.651188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] MFA Rules not processed for user `2ea1cc880c0d4ed7b99316ee659fbcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:15.652981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:15.679446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2010/4026] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:15.679446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.679446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.679446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.713166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] MFA Rules not processed for user `e9570b0583654cb8b55cf2e267d20503`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:15.718206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:15.729231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:15.767859 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2017/4027] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:15.768759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.783289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec783fc3-a4fa-4b82-9173-07ad15c44fc9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.789194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.789890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.790168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.790515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.791623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.794008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.817305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2011/4028] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:15.818459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.834024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af15252-2d7b-4238-a492-1e2c26d53680 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.839456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.840104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.840384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.840700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.841387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:15.841682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.843346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.860459 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2012/4029] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:15.860459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.871208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f0d0-767e-45e8-a46d-72966f5557a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.876589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.877228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.877507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.877781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.878457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.880377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.893216 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2013/4030] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:15.893956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.903207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2018/4031] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:15.903940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:15.906511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7a636-0aa1-4889-8684-74e149bf3c9f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.911661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.912274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.912590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.912861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.913766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.915499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:15.916645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b75b-de58-495d-bbfd-079292eb1fd4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:15.922653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:15.923272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:15.923542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:15.923834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:15.924594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:15.926610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.018912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2014/4032] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/domains => generated 245 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:16.019805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.096200 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2019/4033] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:15 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:16.097263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.148912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3a024-e17a-4885-9950-2506a747e3ed tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.216375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471075e-a411-47ba-9a1c-a9e07ea01465 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.225382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.227700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.230144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.230144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.230144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.231706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.251688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2020/4034] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:16.251688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.253196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.254026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.254313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.254581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.255542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.259053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.268948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc136f4-a16f-4b0e-aef7-833da7af5acb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.278145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.280007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.280462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.280777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.281654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.284366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.299370 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2021/4035] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:16.300269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.372864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855542-e5b2-4d82-8467-11eb51563e0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.377764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.378385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.378665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.378939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.379576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.381810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.424408 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2015/4036] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:16 2022] POST /identity/v3/projects => generated 375 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:16.424408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.536431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2022/4037] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:16 2022] POST /identity/v3/projects => generated 408 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:16.540402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.556150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36b4eb-7385-4a55-8d18-c1a13c135587 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.665851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.666471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.666752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.667020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.667660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.669823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.671940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c78651-1284-4ed9-a941-f012aa0f7cef tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.677374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.678354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.678586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.678902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] PATH_INFO: `/v3/projects/445482b5acc24f018ca5337882bae30e/users/fe54cc37cbe341ae8a4ccff43b17cb33/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.698118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=445482b5acc24f018ca5337882bae30e, user_id=fe54cc37cbe341ae8a4ccff43b17cb33, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.700824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.827280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2023/4038] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:16 2022] PUT /identity/v3/projects/445482b5acc24f018ca5337882bae30e/users/fe54cc37cbe341ae8a4ccff43b17cb33/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:16.827653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.842518 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2016/4039] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:16 2022] POST /identity/v3/users => generated 292 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:16.843410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:16.853458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2798f-3654-43f1-93db-8881d2671957 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.937429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6624bd-ee2d-4acd-a02f-d8a753d50912 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:16.943145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.943901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.944200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.944520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] PATH_INFO: `/v3/projects/7957cb94e3904c3ba1dac5837d539506/users/9e5f9b458c9a4f61b0e621aad918b1bd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.955771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:16.956836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:16.957966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:16.958326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:16.959097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.962165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:16.965335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7957cb94e3904c3ba1dac5837d539506, user_id=9e5f9b458c9a4f61b0e621aad918b1bd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:16.968407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.080949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2024/4040] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:16 2022] PUT /identity/v3/projects/7957cb94e3904c3ba1dac5837d539506/users/9e5f9b458c9a4f61b0e621aad918b1bd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:17.081750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.086062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.124454 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2017/4041] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:16 2022] POST /identity/v3/users => generated 288 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:17.126218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.162195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc9560-08c4-49c9-bbc9-3534dd5b2dd1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.168252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.169125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.169440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.169716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] PATH_INFO: `/v3/projects/d22b69fad22a403dbbc85a36725e2950` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.171047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22b69fad22a403dbbc85a36725e2950)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.173240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.210794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828fb17-6a05-478a-a6b7-ffbf33e1a3ff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.277836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.278615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.278894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.279231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.279932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.281981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81890c75-007d-4946-81ab-17ca75c5d30c tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.422382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22b69fad22a403dbbc85a36725e2950', 'request_id': 'req-554c2422-0424-4ffb-aeba-583f6ec19cfe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:17.434896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22b69fad22a403dbbc85a36725e2950', 'request_id': 'req-554c2422-0424-4ffb-aeba-583f6ec19cfe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:17.443314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22b69fad22a403dbbc85a36725e2950', 'request_id': 'req-554c2422-0424-4ffb-aeba-583f6ec19cfe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:17.452018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2018/4042] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:17 2022] POST /identity/v3/users => generated 347 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:17.456043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.456043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.456043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.481613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:17.482862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.599395 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2019/4043] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:17.599395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.614814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943dd254-03ed-45ef-9e49-b3dcfe3830fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.621094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.622103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.622398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.622679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.623349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.625279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.633609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] The token cache is being invalidate because project d22b69fad22a403dbbc85a36725e2950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:17.634178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:17.634815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:17.641050 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2025/4044] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:17 2022] DELETE /identity/v3/projects/d22b69fad22a403dbbc85a36725e2950 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:17.641050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.641050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.649342 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2020/4045] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:17.652991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.655738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.657725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c2422-0424-4ffb-aeba-583f6ec19cfe admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.663433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.664255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.664986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.664986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.665475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.667298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.678711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc3ef5-016f-40d1-9fd4-f46026781673 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.680806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2026/4046] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:17.682072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.684036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.689856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.689856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.689856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.689856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.690281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.690512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.704020 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2021/4047] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:17.705959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.711508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.839470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908eb705-f8d3-4206-9f43-db774fe0cf71 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.841350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec7d01-3f83-4395-a663-568f089c284e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.844909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.845832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.845941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.846361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.846906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.847540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.847872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.848164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.848897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.849645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.850566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590df6ef-107b-4b4f-95bc-dbf7dfd8b96a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.863352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.864765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.869701 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2027/4048] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:17.869701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.870597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.871975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.878717 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2022/4049] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:17.879856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.881567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.895419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6efbb2-e72d-4fa0-b0fb-bf8d0a8d44f4 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.902168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.902841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.903146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.903903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] PATH_INFO: `/v3/projects/836f9e3a3ee745e9b13942392c5408be/users/e969cdc2196c4878be92297b172a7d0e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.911521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:17.913265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:17.928346 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2028/4050] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:17.929985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:17.942179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=836f9e3a3ee745e9b13942392c5408be, user_id=e969cdc2196c4878be92297b172a7d0e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.943497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b01990-dda9-4a68-ba18-1a492cfac31e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:17.949130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:17.956243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:17.956243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:17.956243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] PATH_INFO: `/v3/projects/7957cb94e3904c3ba1dac5837d539506/users/9e5f9b458c9a4f61b0e621aad918b1bd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:17.956243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7957cb94e3904c3ba1dac5837d539506, user_id=9e5f9b458c9a4f61b0e621aad918b1bd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:17.956697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.956829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:17.968822 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2029/4051] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:17 2022] PUT /identity/v3/projects/7957cb94e3904c3ba1dac5837d539506/users/9e5f9b458c9a4f61b0e621aad918b1bd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:17.969784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.071002 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2023/4052] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:17 2022] PUT /identity/v3/projects/836f9e3a3ee745e9b13942392c5408be/users/e969cdc2196c4878be92297b172a7d0e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:18.076750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.099677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819660-580d-4825-8a1f-e4ffce099641 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:18.205804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:18.219886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:18.221798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.223861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.224268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.225094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:18.228899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a1f63-b814-4c54-8596-714f2b794917 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:18.255501 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2030/4053] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:18.255501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e95f-9b28-4ada-9b0b-142ec54d2087 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.255861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e95f-9b28-4ada-9b0b-142ec54d2087 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.257543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0e95f-9b28-4ada-9b0b-142ec54d2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.282663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d78e-6590-4aec-9f16-0b89dadcf90c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:18.295047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:18.297708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.298005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.298282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/projects/3ee49da8ece24c8abf45a5aa7aa506a6/users/867c57a1e2cf46b6a8c7cd865e358564/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.372721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ee49da8ece24c8abf45a5aa7aa506a6, user_id=867c57a1e2cf46b6a8c7cd865e358564, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:18.378622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78f0e95f-9b28-4ada-9b0b-142ec54d2087 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:18.379091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:18.382531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78f0e95f-9b28-4ada-9b0b-142ec54d2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:18.401133 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2031/4054] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:18.402437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.402713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.402981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.452926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] MFA Rules not processed for user `9e5f9b458c9a4f61b0e621aad918b1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:18.454399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:18.494712 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2024/4055] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:18 2022] PUT /identity/v3/projects/3ee49da8ece24c8abf45a5aa7aa506a6/users/867c57a1e2cf46b6a8c7cd865e358564/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:18.494712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.646439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2032/4056] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:18.649746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.658147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:18.660935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fef7c-079a-41eb-82d8-2b4932efd195 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:18.666487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:18.667111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.667389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.667658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.668303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:18.669946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:18.674750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d458780-647e-4214-83b6-cc07d60c38d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:18.684021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:18.684735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.685009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.685279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] PATH_INFO: `/v3/projects/243fce1f12b344609d5c493e72b65119/users/a521c14dd3a94d40abf3fffec6100b8a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.700837 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2025/4057] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:18.701637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.720072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cf2ef-f1e3-45d5-9268-7264ce93e83d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:18.725533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:18.726242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.727766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.728072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.728818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:18.729131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:18.730815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5074b-cde8-4443-afff-211ac8c1b831 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:18.732751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=243fce1f12b344609d5c493e72b65119, user_id=a521c14dd3a94d40abf3fffec6100b8a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:18.735688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:18.746995 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2026/4058] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:18.748427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:18.748742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:18.749011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:18.849972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2033/4059] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:18 2022] PUT /identity/v3/projects/243fce1f12b344609d5c493e72b65119/users/a521c14dd3a94d40abf3fffec6100b8a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:18.851556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.858358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:18.928200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] MFA Rules not processed for user `867c57a1e2cf46b6a8c7cd865e358564`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:18.928200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:18.976684 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2027/4060] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:18.979648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:18.994480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524b86b-12c4-4e3f-8089-363ca6dadb27 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.003521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0274f61-7818-4649-9a98-fdad30f0fb14 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.012181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.013382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.013833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.014106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.091867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.092448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.092768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.093033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] PATH_INFO: `/v3/projects/836f9e3a3ee745e9b13942392c5408be/users/e969cdc2196c4878be92297b172a7d0e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.097902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=836f9e3a3ee745e9b13942392c5408be, user_id=e969cdc2196c4878be92297b172a7d0e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.103001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.117374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2028/4061] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:18 2022] PUT /identity/v3/projects/836f9e3a3ee745e9b13942392c5408be/users/e969cdc2196c4878be92297b172a7d0e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:19.119369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.145132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.147070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717fe79-e1bd-419f-8465-d8d99518d92e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.166173 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2034/4062] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:19.168269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c546-7bd2-46fb-a6df-7786b539b448 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.168776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c546-7bd2-46fb-a6df-7786b539b448 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.169240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c546-7bd2-46fb-a6df-7786b539b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.223644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6237c546-7bd2-46fb-a6df-7786b539b448 None None] MFA Rules not processed for user `a521c14dd3a94d40abf3fffec6100b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:19.228461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0da92-3633-4d54-9798-b412745a2acc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.229420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6237c546-7bd2-46fb-a6df-7786b539b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:19.238591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.239313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.239682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.240029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.240772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.243145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00c71-a250-46f2-9fc0-66ed5fcfdf38 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.376915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2035/4063] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:19.378667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.379090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.379446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.417489 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2029/4064] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:19.422081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.422303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.426916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.488756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] MFA Rules not processed for user `e969cdc2196c4878be92297b172a7d0e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:19.490042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:19.508871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] MFA Rules not processed for user `867c57a1e2cf46b6a8c7cd865e358564`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:19.510528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:19.535776 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2036/4065] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/auth/tokens => generated 3359 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:19.536681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.540204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:19.605055 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2030/4066] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:19.606305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.649516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5daeb9-ad5d-4dd9-877b-6c1ae59608c3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.741996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac91100-17ec-4710-8aa4-06855c860150 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.742499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.743352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.743721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.744586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.748618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.749479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.750506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.751645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.752584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.756153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.835485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.837275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.848975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2037/4067] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:19.849665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.931637 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2031/4068] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:19.933017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:19.955088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e120a3-08c0-4c9d-9a22-bee76f00c57f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:19.967938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:19.968683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:19.969125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:19.980058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:19.980992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:19.982648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:19.995469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391a3f-330b-4151-8e25-a040639424ee service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.011080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '867c57a1e2cf46b6a8c7cd865e358564', 'user_domain_id': 'd1d3f12292334eaab339525ec519865c', 'system_scope': None, 'project_id': '3ee49da8ece24c8abf45a5aa7aa506a6', 'project_domain_id': 'd1d3f12292334eaab339525ec519865c', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.011708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.011991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.012249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.032729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.034499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.057119 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2038/4069] 10.222.0.64 () {56 vars in 1284 bytes} [Wed Nov 2 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3359 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:20.057320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.080672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2032/4070] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:19 2022] POST /identity/v3/services => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:20.081884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.093258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a082ca6-e623-47d7-bdfc-0d3ccb6603a0 tempest-test_project-412432241 tempest-user-449394899] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.172594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.173684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.173957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.174276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.174921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.179528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.237741 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2039/4071] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:20.241000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.296304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95878ee7-cc85-4336-8316-4fe85dcd9202 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.303093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.305260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.305835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.306324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/users/867c57a1e2cf46b6a8c7cd865e358564` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.307848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:delete_user(user_id=867c57a1e2cf46b6a8c7cd865e358564)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.310109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.328956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d60f0-546f-40b0-9fa1-4935ffc99f64 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.358470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.359198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.359491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.359768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.360446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.361561 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:20.361561 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:20.361561 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:20.362465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.461306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:20.525007 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2112400859. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:20.525007 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:20.525007 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:20.606347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867c57a1e2cf46b6a8c7cd865e358564'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:20.677218 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2040/4072] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:46:20 2022] POST /identity/v3/endpoints => generated 361 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:20.677894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.728355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867c57a1e2cf46b6a8c7cd865e358564'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:20.752941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf519-0562-43c2-a6e0-4bba05c653a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.760116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867c57a1e2cf46b6a8c7cd865e358564'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:20.764971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867c57a1e2cf46b6a8c7cd865e358564'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:20.766550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867c57a1e2cf46b6a8c7cd865e358564'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:20.774060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.775393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.775673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.775948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.778492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.784295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.803854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2033/4073] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:20 2022] DELETE /identity/v3/users/867c57a1e2cf46b6a8c7cd865e358564 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:20.806723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.819933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:20.820228 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2041/4074] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:20.820228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.820228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:20.857448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f710b-f49f-40c2-b35d-1784407e3be3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.940913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c5189-c7b7-4058-94e9-bee97446833b tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:20.949410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.950169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.950559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.950930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/projects/3ee49da8ece24c8abf45a5aa7aa506a6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.952344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ee49da8ece24c8abf45a5aa7aa506a6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.965754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.965983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:20.965983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:20.966343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:20.967076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-2112400859` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:20.967836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2112400859)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:20.969782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:20.977219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2034/4075] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:46:20 2022] GET /identity/v3/regions/tempest-region-2112400859 => generated 180 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:20.978653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:20.990072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:21.096335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0f019-e12b-48a4-8a10-4ac432938836 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:21.104446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:21.105559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:21.106019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:21.106450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] PATH_INFO: `/v3/projects/3bc54a0ddc544dea833bd073bdc58062/users/35349c72cfd9471a94d480d007033cc0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:21.125891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc54a0ddc544dea833bd073bdc58062, user_id=35349c72cfd9471a94d480d007033cc0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:21.128862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:21.228286 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2035/4076] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:20 2022] PUT /identity/v3/projects/3bc54a0ddc544dea833bd073bdc58062/users/35349c72cfd9471a94d480d007033cc0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:21.237622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:21.242861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee49da8ece24c8abf45a5aa7aa506a6', 'request_id': 'req-a11e643f-cfef-4730-92c5-5529d80c0b76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.249659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee49da8ece24c8abf45a5aa7aa506a6', 'request_id': 'req-a11e643f-cfef-4730-92c5-5529d80c0b76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.258789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee49da8ece24c8abf45a5aa7aa506a6', 'request_id': 'req-a11e643f-cfef-4730-92c5-5529d80c0b76'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.337686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec586cfc-ea11-47a7-8b8e-9d65bbca91c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:21.351480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:21.358261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] The token cache is being invalidate because project 3ee49da8ece24c8abf45a5aa7aa506a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:21.358700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.360990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a11e643f-cfef-4730-92c5-5529d80c0b76 tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.364247 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2042/4077] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:20 2022] DELETE /identity/v3/projects/3ee49da8ece24c8abf45a5aa7aa506a6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:21.365752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:21.372199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:21.372199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:21.437078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] MFA Rules not processed for user `35349c72cfd9471a94d480d007033cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:21.439550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:21.458584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:21.461462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:21.461963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:21.462249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:21.462922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:21.467823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:21.568980 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2036/4078] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:21 2022] POST /identity/v3/services => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:21.568980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:21.572841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:21.610492 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2043/4079] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:21 2022] POST /identity/v3/auth/tokens => generated 3698 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:21.611310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:21.615152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:21.671626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fb02-133a-4a09-856e-e76423925033 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:21.696627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:21.697427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:21.697768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:21.698179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:21.698984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:21.700778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:21.769794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602313e7-0639-4915-ac66-e94346e34168 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:21.786712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:21.788140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:21.789033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:21.789361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/domains/d1d3f12292334eaab339525ec519865c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:21.791266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d1d3f12292334eaab339525ec519865c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:21.791957 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:21.791957 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:21.791957 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:21.793184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:21.820126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.822380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.859519 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1265740464. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:21.859519 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:21.859519 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:21.942188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.945672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:21.951392 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2037/4080] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:46:21 2022] PATCH /identity/v3/domains/d1d3f12292334eaab339525ec519865c => generated 246 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:21.951392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:21.951639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.009849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2044/4081] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:46:21 2022] POST /identity/v3/endpoints => generated 361 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:22.011025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.019190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.062314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbf302-4b83-461b-9863-88a49f8bf47a tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.066955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c05db-737b-4941-8310-3955f98504a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.100374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.101224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.101566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.101768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.102418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.104405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.221261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ea1cc880c0d4ed7b99316ee659fbcf4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '79202f8392be45df9ffbe31563b59fa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.221922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.222201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.222472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] PATH_INFO: `/v3/domains/d1d3f12292334eaab339525ec519865c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.237481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d1d3f12292334eaab339525ec519865c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.239114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.286069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.291086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd1d3f12292334eaab339525ec519865c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.369179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2038/4082] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:21 2022] POST /identity/v3/projects => generated 373 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:22.369179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.369854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.478897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.486196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a72194a-bc4a-4d21-a7c9-a08daebeb8dc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.490228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.496916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.571623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.572374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.572739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.573021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-1265740464` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.573630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1265740464)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.576614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.586026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] The token cache is being invalidate because project d1d3f12292334eaab339525ec519865c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:22.586348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.587925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.588934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2039/4083] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:46:22 2022] GET /identity/v3/regions/tempest-region-1265740464 => generated 180 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:22.590149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.595055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.599158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.603275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.604392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd1d3f12292334eaab339525ec519865c', 'request_id': 'req-efa06894-865e-4524-a4f7-57b927609fde'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:22.614197 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2045/4084] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:46:22 2022] DELETE /identity/v3/domains/d1d3f12292334eaab339525ec519865c => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:22.615884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.619110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.652343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06894-865e-4524-a4f7-57b927609fde tempest-TestDefaultProjectId-1477959715 tempest-TestDefaultProjectId-1477959715-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.663828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.665889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.666340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.666744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.667682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.669687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.695143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8dfb8-8c49-40e3-8967-26170fb6c9b4 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.700219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.700858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.701135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.701404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.702062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.704177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.739328 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-494882680. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:22.739328 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:22.739328 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:22.800459 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2040/4085] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:22 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:22.800459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.802401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.816295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f5916-a4f6-4ef7-90f3-3fde47f30768 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.836975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.837624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.837900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.838170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] PATH_INFO: `/v3/users/a9fa2445ec34440aaa1c278141b28c2e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.839395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fa2445ec34440aaa1c278141b28c2e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.841743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.861340 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2046/4086] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:46:22 2022] POST /identity/v3/endpoints => generated 359 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:22.862231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.865755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:22.901174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aeb-847f-4698-ab9f-d673c819ec41 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.908380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.909564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.910131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.910657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.911629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.913829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.928534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2047/4087] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:22.930176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.968523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e16573-bdae-440e-88d0-920b942dc771 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:22.974924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:22.975671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:22.975953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:22.989963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-494882680` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:22.989963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-494882680)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:22.989963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:22.989963 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2048/4088] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:46:22 2022] GET /identity/v3/regions/tempest-region-494882680 => generated 178 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:22.989963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:22.998396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc9ac-4768-41c4-8aef-b0fff450a3f3 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.006109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.006888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.007856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.008130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] PATH_INFO: `/v3/projects/4bee8296d03c4988a338fef45622c6cc/users/ed07780bfab64f719f76d16a106940c3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.029108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bee8296d03c4988a338fef45622c6cc, user_id=ed07780bfab64f719f76d16a106940c3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.031977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.076775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fa2445ec34440aaa1c278141b28c2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.156692 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2049/4089] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:22 2022] PUT /identity/v3/projects/4bee8296d03c4988a338fef45622c6cc/users/ed07780bfab64f719f76d16a106940c3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:23.156692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.158515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.180938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fa2445ec34440aaa1c278141b28c2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.198609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fa2445ec34440aaa1c278141b28c2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.199347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fa2445ec34440aaa1c278141b28c2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.199988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fa2445ec34440aaa1c278141b28c2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.229340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2041/4090] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:22 2022] DELETE /identity/v3/users/a9fa2445ec34440aaa1c278141b28c2e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:23.230354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.233451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.251443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbab6e-0161-49bd-b8fa-a29dfa4c2692 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.346443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:23.371169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.371829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.372109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.372378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] PATH_INFO: `/v3/users/100ee95a043b46738d71ed446f41d3f0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.373893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] RBAC: Authorizing `identity:delete_user(user_id=100ee95a043b46738d71ed446f41d3f0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.376263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.446933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad542-640d-41bd-ad3a-dc3ed30987de admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.459837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.462114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.462407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.462687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.465148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.466256 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:23.466256 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:23.466256 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:23.467176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.477502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:23.484645 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2042/4091] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:46:23 2022] GET /identity/v3/endpoints => generated 4395 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:23.489351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.489351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.516292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdd491-eaaf-47da-bec7-e41ab4c12ce5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.531322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.532986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.532986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.532986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.533426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.535074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57212c0-6839-498e-b619-fdf6620b6aae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.549708 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2043/4092] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:23.549708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.549708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.549708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.583535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:23.584945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.596140 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2044/4093] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:23 2022] POST /identity/v3/auth/tokens => generated 4053 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:23.597907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.610160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc47d7-49f0-4dff-b8bf-ce5632ec4011 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.615712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.616014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.616346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.617367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.630524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=77d055f98f3b4befbe9ad7ddc03f8692)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.631587 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:23.631587 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:23.631587 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:23.632656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.633870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100ee95a043b46738d71ed446f41d3f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.638273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2045/4094] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:23 2022] GET /identity/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692 => generated 359 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:23.638273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.662162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63c201-b3cc-4583-a9bb-606e81afa195 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.669076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.672735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.673339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.682154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] PATH_INFO: `/v3/projects/4bee8296d03c4988a338fef45622c6cc/users/ed07780bfab64f719f76d16a106940c3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.682154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bee8296d03c4988a338fef45622c6cc, user_id=ed07780bfab64f719f76d16a106940c3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.683015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.705904 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2046/4095] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:23 2022] PUT /identity/v3/projects/4bee8296d03c4988a338fef45622c6cc/users/ed07780bfab64f719f76d16a106940c3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:23.705904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.705904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.751825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100ee95a043b46738d71ed446f41d3f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.777352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100ee95a043b46738d71ed446f41d3f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.796775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100ee95a043b46738d71ed446f41d3f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.807059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100ee95a043b46738d71ed446f41d3f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:23.823777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2050/4096] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:23 2022] DELETE /identity/v3/users/100ee95a043b46738d71ed446f41d3f0 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:23.824925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:23.828146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.861552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14fd71-78b6-4f2f-96ac-81744f826be5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.952210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1e45f-2fc3-43ff-9f7b-9f5339a2535f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:23.957588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.958355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.958708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.959512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.965157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:23.973881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:23.974501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:23.974782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:23.975064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] PATH_INFO: `/v3/users/a521c14dd3a94d40abf3fffec6100b8a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:23.976320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a521c14dd3a94d40abf3fffec6100b8a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.979493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:23.984916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:23.986400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.009805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2051/4097] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:23 2022] GET /identity/v3/auth/tokens => generated 4053 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:24.010764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.013034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.118172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec17e47-7851-44d3-aabb-dc23e5fbb672 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:24.120133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:24.120952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.121332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.121704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.123448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=77d055f98f3b4befbe9ad7ddc03f8692)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:24.124625 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:24.124625 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:24.124625 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:24.125753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.322135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '77d055f98f3b4befbe9ad7ddc03f8692', 'request_id': 'req-ec0f1e72-db05-4481-a446-6c0e6bdd1e07'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.333786 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2052/4098] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:24 2022] DELETE /identity/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:24.335772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97322-4222-4746-b05d-21eda2437fb5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.336180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97322-4222-4746-b05d-21eda2437fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.336454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead97322-4222-4746-b05d-21eda2437fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.367209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ead97322-4222-4746-b05d-21eda2437fb5 None None] MFA Rules not processed for user `ed07780bfab64f719f76d16a106940c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:24.379601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ead97322-4222-4746-b05d-21eda2437fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.386944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a521c14dd3a94d40abf3fffec6100b8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.466829 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2053/4099] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/auth/tokens => generated 3948 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:24.468575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.469095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.469501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.490009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a521c14dd3a94d40abf3fffec6100b8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.495604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:24.498566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.528141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a521c14dd3a94d40abf3fffec6100b8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.529113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a521c14dd3a94d40abf3fffec6100b8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.529823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a521c14dd3a94d40abf3fffec6100b8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:24.543699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2054/4100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/auth/tokens => generated 3870 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:24.544645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.563797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2047/4101] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:23 2022] DELETE /identity/v3/users/a521c14dd3a94d40abf3fffec6100b8a => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:24.565393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.567516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.583589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f381f-fcee-4cc8-b21f-a3e6af2034b8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:24.633669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:24.682805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:24.683439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.683720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.684453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.684643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:24.685669 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:24.685669 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:24.685669 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:24.687098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.691013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a6c66-3919-443b-8acd-260ee5f47091 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:24.701003 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2055/4102] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:46:24 2022] GET /identity/v3/endpoints => generated 4049 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:24.702301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:24.702463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.702567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.702567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.702567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.702567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:24.702897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.703004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aa012-b38d-446e-b647-c201789caf67 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.781707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ef8d7-72a1-4905-a31a-702d2f4487db tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:24.785857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:24.786524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.786799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.787068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.789030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.821943 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2048/4103] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/services => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:24.823278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.823574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.823926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.876313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:24.879715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.897075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:24.899766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79f8fd-71d2-4a9d-911c-43c8dbeffbfb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:24.910657 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2056/4104] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:24 2022] GET /identity/v3/auth/tokens => generated 3870 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:24.911799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:24.912083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:24.912356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:24.933480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] MFA Rules not processed for user `f113dfb7876f43c293443ba1bce61302`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:24.934725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:24.978833 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2049/4105] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/auth/tokens => generated 4003 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:24.978833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:24.980270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.020264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa80e4-72f3-4469-802a-0e7e34fd9f9f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.035063 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2057/4106] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:24 2022] POST /identity/v3/auth/tokens => generated 4020 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:25.035063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.035063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.038362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.038362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.038362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.038643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.044685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:46:25.050858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d77335-ead7-4836-a0cd-43a062880d88 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.055982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Could not find endpoint: 77d055f98f3b4befbe9ad7ddc03f8692.: keystone.exception.EndpointNotFound: Could not find endpoint: 77d055f98f3b4befbe9ad7ddc03f8692. Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._iter().one() Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._only_one_row( Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exc.NoResultFound( Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:46:25.056886 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 77d055f98f3b4befbe9ad7ddc03f8692. Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:46:25.058144 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:46:25.059527 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 77d055f98f3b4befbe9ad7ddc03f8692. Nov 02 12:46:25.066401 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:46:25.067421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.067421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.067421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] PATH_INFO: `/v3/projects/3df30fbe9aac44fda017263999a32859` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.067421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df30fbe9aac44fda017263999a32859)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:25.067421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:25.067815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2050/4107] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:24 2022] DELETE /identity/v3/endpoints/77d055f98f3b4befbe9ad7ddc03f8692 => generated 114 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:46:25.067815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.105410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf8213-f419-41f3-b689-b89014935919 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.111423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.112344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.112544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.112961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.113702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:25.115615 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:25.115615 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:25.115615 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:25.115996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:25.200283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df30fbe9aac44fda017263999a32859', 'request_id': 'req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:25.207830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df30fbe9aac44fda017263999a32859', 'request_id': 'req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:25.215999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df30fbe9aac44fda017263999a32859', 'request_id': 'req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:25.264128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2051/4108] 10.222.0.64 () {60 vars in 1213 bytes} [Wed Nov 2 12:46:25 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:25.264926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.271012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.309375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3af2c-9dbe-44b8-8075-48ba6cc7cf20 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.360573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.361193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.361467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.361738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.443440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] The token cache is being invalidate because project 3df30fbe9aac44fda017263999a32859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:25.443908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:25.448010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7637e99c-f9d6-4298-8c0a-a4ca4d0b0c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:25.453203 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2058/4109] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:25 2022] DELETE /identity/v3/projects/3df30fbe9aac44fda017263999a32859 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:25.454894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.455540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.455975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.460830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:25.463549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:25.485130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] MFA Rules not processed for user `f113dfb7876f43c293443ba1bce61302`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:25.486614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.488081 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2052/4110] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:25 2022] GET /identity/v3/auth/tokens => generated 4003 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:25.489474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.607290 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2059/4111] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:25 2022] POST /identity/v3/auth/tokens => generated 4020 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:25.609033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.611227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.639139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030ebf9-64ce-42ee-883a-9cc374fc5c60 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.652260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.653305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.653595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.654422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-494882680` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.654706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-494882680)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:25.655820 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:25.655820 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:25.655820 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:25.656931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:25.738689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead715a3-1fc1-4f4c-9c15-5981b7417dfd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:25.743435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:25.744055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:25.744337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:25.744647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:25.745369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:25.746979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:25.888607 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-494882680. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:25.888607 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:25.888607 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:25.909671 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2053/4112] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:46:25 2022] DELETE /identity/v3/regions/tempest-region-494882680 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:25.912689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.915611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:25.926919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2060/4113] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:25 2022] POST /identity/v3/services => generated 288 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:25.951685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:25.961587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:26.043677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d984815-d6e5-4378-a4a7-a9f4dff33ee1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:26.065537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88829a80-d24d-4e41-b9ee-fd8416e6d6b3 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:26.082471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:26.082471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:26.082471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:26.082471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] PATH_INFO: `/v3/projects/5d8990b6bd3745c0ac8f4c6446ee808e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:26.082822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:26.082822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:26.082822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:26.082822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] PATH_INFO: `/v3/users/2ea1cc880c0d4ed7b99316ee659fbcf4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:26.083103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8990b6bd3745c0ac8f4c6446ee808e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:26.084702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea1cc880c0d4ed7b99316ee659fbcf4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:26.087755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:26.089663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:26.346420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:26.452874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8990b6bd3745c0ac8f4c6446ee808e', 'request_id': 'req-4d877228-7883-4d8f-9ad9-18c1f7259cfa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.455974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea1cc880c0d4ed7b99316ee659fbcf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.463159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8990b6bd3745c0ac8f4c6446ee808e', 'request_id': 'req-4d877228-7883-4d8f-9ad9-18c1f7259cfa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.472035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8990b6bd3745c0ac8f4c6446ee808e', 'request_id': 'req-4d877228-7883-4d8f-9ad9-18c1f7259cfa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.591308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea1cc880c0d4ed7b99316ee659fbcf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.591694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:26.621466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea1cc880c0d4ed7b99316ee659fbcf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.622343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea1cc880c0d4ed7b99316ee659fbcf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.623128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea1cc880c0d4ed7b99316ee659fbcf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.638271 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2054/4114] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:25 2022] DELETE /identity/v3/users/2ea1cc880c0d4ed7b99316ee659fbcf4 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:26.639228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:26.640753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:26.706209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] The token cache is being invalidate because project 5d8990b6bd3745c0ac8f4c6446ee808e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:26.707961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.712480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:26.723138 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2061/4115] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:25 2022] DELETE /identity/v3/projects/5d8990b6bd3745c0ac8f4c6446ee808e => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:26.724056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:26.725748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:26.798779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55221ded-6b52-4fe1-9a7f-da08e07309ee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:26.805296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:26.805926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:26.806226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:26.806506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:26.807206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:26.808855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:26.818270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2055/4116] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:46:26 2022] GET /identity/v3/endpoints => generated 4049 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:26.820561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:26.822685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:26.844660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d877228-7883-4d8f-9ad9-18c1f7259cfa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:26.916358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:26.917202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:26.917320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb98e3-92ed-46f0-b288-caa71765f3e5 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:26.917657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:26.918053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:26.918993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:26.920129 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:26.920129 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:26.920129 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:26.921435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42df370-83a7-4f7d-b9e4-3e78e89729f2 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:26.926257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:26.927138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:26.927491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:26.927828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] PATH_INFO: `/v3/projects/243fce1f12b344609d5c493e72b65119` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:26.931494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243fce1f12b344609d5c493e72b65119)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:26.936452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.077970 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2062/4117] 10.222.0.64 () {60 vars in 1213 bytes} [Wed Nov 2 12:46:26 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:27.080000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.080581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.081053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:46:27.089721 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:46:27.092416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:46:27.106716 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2063/4118] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:46:27 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:46:27.108477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:27.132640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:27.160443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec6074-720c-4b54-81dd-db8be2d5aa30 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:27.171380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243fce1f12b344609d5c493e72b65119', 'request_id': 'req-32723cda-517e-4aca-83c7-ef446a56ea29'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.180367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243fce1f12b344609d5c493e72b65119', 'request_id': 'req-32723cda-517e-4aca-83c7-ef446a56ea29'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.248466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:27.249568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.250445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.250605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] PATH_INFO: `/v3/users/9e5f9b458c9a4f61b0e621aad918b1bd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.253011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5f9b458c9a4f61b0e621aad918b1bd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:27.256684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.340140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243fce1f12b344609d5c493e72b65119', 'request_id': 'req-32723cda-517e-4aca-83c7-ef446a56ea29'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.364308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] The token cache is being invalidate because project 243fce1f12b344609d5c493e72b65119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:27.367277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.368140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.370086 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2056/4119] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:26 2022] DELETE /identity/v3/projects/243fce1f12b344609d5c493e72b65119 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:27.370920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:27.372774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:27.514758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723cda-517e-4aca-83c7-ef446a56ea29 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:27.531489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:27.532105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.532512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.532895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.533972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Adding query filter params (service_id=f22c58b029a643bb879df3f88f31d8ba) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:27.534100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:27.536382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.546982 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2057/4120] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:46:27 2022] GET /identity/v3/endpoints?service_id=f22c58b029a643bb879df3f88f31d8ba => generated 503 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:27.546982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:27.570008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:27.637742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3a1e5-23f8-4137-928d-32b70d1ee98e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:27.645662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:27.646294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.646765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.647906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.648766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:27.650116 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:27.650116 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:27.650116 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:27.651373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.659433 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2058/4121] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:46:27 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:27.660869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:27.662994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:27.681333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c333b3-b666-41ca-827d-bfc78fb16b6f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:27.686729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:27.687378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.687677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.687958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] PATH_INFO: `/v3/projects/79202f8392be45df9ffbe31563b59fa8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.689182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79202f8392be45df9ffbe31563b59fa8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:27.691168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:27.800851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5f9b458c9a4f61b0e621aad918b1bd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.910776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5f9b458c9a4f61b0e621aad918b1bd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.924903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5f9b458c9a4f61b0e621aad918b1bd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.931739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5f9b458c9a4f61b0e621aad918b1bd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.932588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ada0b042-1ea4-4f1f-a9a7-dba2dda0802a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5f9b458c9a4f61b0e621aad918b1bd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:27.939112 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2064/4122] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:27 2022] DELETE /identity/v3/users/9e5f9b458c9a4f61b0e621aad918b1bd => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:27.942149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:27.942149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:27.942149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:27.965575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:27.966998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.000455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79202f8392be45df9ffbe31563b59fa8', 'request_id': 'req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:28.018241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79202f8392be45df9ffbe31563b59fa8', 'request_id': 'req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:28.058078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2065/4123] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:27 2022] POST /identity/v3/auth/tokens => generated 4136 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:28.059618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.062841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.117015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79202f8392be45df9ffbe31563b59fa8', 'request_id': 'req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:28.140755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] The token cache is being invalidate because project 79202f8392be45df9ffbe31563b59fa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:28.141087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:28.141804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:28.144979 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2059/4124] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:27 2022] DELETE /identity/v3/projects/79202f8392be45df9ffbe31563b59fa8 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:28.145666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.150545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.170631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9de5-a7b2-43d1-b501-0539d4a19ba2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.175855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.176470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.177161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.177766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.178835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Adding query filter params (service_id=a24cfa7a879b4fe185a5c983fef24da2) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:28.179293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.181319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e513437-42b2-4deb-b364-d625091ee8fb tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.192055 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2066/4125] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/endpoints?service_id=a24cfa7a879b4fe185a5c983fef24da2 => generated 503 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:28.195020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.195499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.195986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.278469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] MFA Rules not processed for user `fe54cc37cbe341ae8a4ccff43b17cb33`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:28.279715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.303039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4749f9-3d6d-4712-a17b-e27dfd5d964c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.310652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.311594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.312189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.312819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.313581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a10e7a2fb1c84f61a6854f06fd07cff0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.314774 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:28.314774 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:28.314774 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:28.316792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2927d97-80e1-4bef-855a-7d18236cc1aa tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.328658 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2060/4126] 10.222.0.64 () {58 vars in 1290 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0 => generated 332 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:28.332939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59897d-733b-46d5-bb6a-c6ca3316215b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.333556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59897d-733b-46d5-bb6a-c6ca3316215b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.334010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59897d-733b-46d5-bb6a-c6ca3316215b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.374063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cb59897d-733b-46d5-bb6a-c6ca3316215b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:28.379353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb59897d-733b-46d5-bb6a-c6ca3316215b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.402090 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2061/4127] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/auth/tokens => generated 4136 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:28.405268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.406880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.408862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.446917 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2067/4128] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/auth/tokens => generated 4149 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:28.449246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.453942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.459150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:28.464987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.474600 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2062/4129] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/auth/tokens => generated 4136 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:28.474811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2d1e9-c4f9-46aa-a0fa-457f52c89bf6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.476357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.481325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.482077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.482456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.482848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.483609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:28.484030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.485858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.496533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3bce9-f28e-4768-9969-9fb573d19491 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.501301 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2068/4130] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:28.501301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.507816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.509014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.509470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.510697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.511498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=a10e7a2fb1c84f61a6854f06fd07cff0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.514709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.515030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaf3f0-b2b0-41c6-9a4b-6791bff3a24f tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.523910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.524696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.525076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.525449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.526369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:28.526782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.528664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f66a7-a40b-4bc6-8475-5bdb56df4b3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.557714 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2063/4131] 10.222.0.64 () {58 vars in 1291 bytes} [Wed Nov 2 12:46:28 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 02 12:46:28.562658 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2069/4132] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:28.563262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.564833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.565450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.565735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.569787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.590885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:28.592230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:28.605318 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2070/4133] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/auth/tokens => generated 4136 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:28.606448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.622164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38a4bf-c3db-44dd-93bd-33b4b349dcd0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.641536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.642164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.642442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.642712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.643628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:28.643774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.650498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.657813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2071/4134] 10.222.0.64 () {58 vars in 1171 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:28.663795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.682035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d62f1-503a-452d-80b7-47e159942ba1 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.695480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.696891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.697158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.697434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.698019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a10e7a2fb1c84f61a6854f06fd07cff0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.699361 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:28.699361 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:28.699361 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:28.700256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.705735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4590b3-bde6-4fd8-bdf0-2d2ffa7d8c1f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.712985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.713842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.713989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.714143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.724691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.728353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.740946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2064/4135] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/auth/tokens => generated 4149 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:28.743292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.767774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19e1dc-4cda-403d-ac5d-a1a9897f17c9 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.779341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.779994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.780278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.781931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.781931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.783346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.791091 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2072/4136] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:46:28 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:28.795225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.802766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:28.817863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b9b00-cd97-4055-b65a-97efd614cfbc tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.824824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.825571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.825916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.826266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.826983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:28.827769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.829190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.847024 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2073/4137] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:28.847024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.860445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a38401-c6b3-4001-8cc4-be932dde85b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:28.865974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:28.866898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:28.867418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:28.867760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:28.868504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:28.870335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:28.980693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2065/4138] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/projects => generated 389 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:28.980693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:28.980693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.015088 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2074/4139] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:28 2022] POST /identity/v3/services => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:29.016266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.038219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c951edf-5022-4f52-b4ed-72d8dcb72c7d tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.049693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d52e0-5806-49dd-9cca-82c010fc6402 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.070334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.071593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.072046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.072473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] PATH_INFO: `/v3/projects/7957cb94e3904c3ba1dac5837d539506` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.073912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7957cb94e3904c3ba1dac5837d539506)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.076167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.114123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.115182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.115497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.115799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.117000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.118026 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:29.118026 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:29.118026 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:29.119681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.126939 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2075/4140] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:46:29 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:29.128085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.142167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088175a3-3b33-44e6-9c91-b7ac0395872f tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.149074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.150307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.150744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.151805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.152742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.154716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.221621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7957cb94e3904c3ba1dac5837d539506', 'request_id': 'req-46ee629b-f3b5-4bdf-b1fc-535393cb5172'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:29.229319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7957cb94e3904c3ba1dac5837d539506', 'request_id': 'req-46ee629b-f3b5-4bdf-b1fc-535393cb5172'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:29.258435 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2076/4141] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:29.260292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.351207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7957cb94e3904c3ba1dac5837d539506', 'request_id': 'req-46ee629b-f3b5-4bdf-b1fc-535393cb5172'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:29.367921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a00a51-9963-4eaa-8114-6a0d7e4dce75 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.370131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] The token cache is being invalidate because project 7957cb94e3904c3ba1dac5837d539506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:29.370432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:29.372869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:29.377948 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2066/4142] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:28 2022] DELETE /identity/v3/projects/7957cb94e3904c3ba1dac5837d539506 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:29.377948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.384947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.387624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.388257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.388560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.388833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.389501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.391609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.489216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee629b-f3b5-4bdf-b1fc-535393cb5172 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.570572 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2077/4143] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:29.571519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.572676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.573146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.583236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.583236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.583236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.583236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.583647 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:29.583647 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:29.583647 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:29.583647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.603874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:29.650423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579e0fb-3649-4d75-a5a7-677550b9457f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.655469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.656129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.656410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.656719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.657317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=a10e7a2fb1c84f61a6854f06fd07cff0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.658920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Could not find Endpoint Group: a10e7a2fb1c84f61a6854f06fd07cff0.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a10e7a2fb1c84f61a6854f06fd07cff0. Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Nov 02 12:46:29.677504 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: a10e7a2fb1c84f61a6854f06fd07cff0. Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2078/4144] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:46:29 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/a10e7a2fb1c84f61a6854f06fd07cff0 => generated 120 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.683731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.699333 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-4f68eb27-8681-4e67-a467-d480aae0ed01 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-311405652. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:29.699333 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:29.699333 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:29.700367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a666a-0a3c-4c09-a28c-6a07a2213e34 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.732627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.733387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.733672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.740917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.741899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.744907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.814671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:29.823576 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2067/4145] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/endpoints => generated 359 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:29.823576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.823576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.823576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.843369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:29.844687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.888693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2068/4146] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/auth/tokens => generated 4452 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:29.888693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.890236 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2079/4147] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:29 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:29.891886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.893151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:29.912409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0dc48-8ac7-4987-8992-d2c0344ec905 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.918874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.919544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.919976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.920957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.921294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.922990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.938119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2069/4148] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:29.939075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:29.944293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457c2d-6fb2-4346-b472-a55e8db943c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.983590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.984415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.984564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.984850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services/07915e019dd941ff9ed403409985c8d4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.985752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=07915e019dd941ff9ed403409985c8d4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.987657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26e2b7-8491-43d9-9fbf-d62e4f9fbc45 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:29.989190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:29.993726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:29.994387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:29.994671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:29.995061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-311405652` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:29.995664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-311405652)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:29.996777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f9b6c-5907-4d5a-bbdb-2cb1d9117b51 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.003613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2070/4149] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:46:29 2022] GET /identity/v3/regions/tempest-region-311405652 => generated 178 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:30.005407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.005689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.005958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.059931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:30.061985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:30.089237 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2071/4150] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:30 2022] POST /identity/v3/auth/tokens => generated 4452 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:30.090608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.125700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a38869-4a9a-46a4-81bb-a30f2acd9424 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.131252 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2080/4151] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:29 2022] DELETE /identity/v3/services/07915e019dd941ff9ed403409985c8d4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:30.132755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.148715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.150075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.151649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.151649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.151649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.153697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.162242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9236c-c311-4029-a294-9833f647a9a8 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.180388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2072/4152] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:30.181611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.185048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.185957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.186242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.186515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.187160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.188819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.218529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2081/4153] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:30.218529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.230309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ade4c-1f1e-465d-95c0-fd8ae03872a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.239110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.240571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.241092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.241787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.242865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:30.243408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.244107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4203f-e332-4628-b764-3a537420ec48 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.246933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.253663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.254469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.254900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.255605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/22b0b3cb80f3456cab7d3cf52eb3d658` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.269415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=22b0b3cb80f3456cab7d3cf52eb3d658)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.272221 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:30.272221 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:30.272221 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:30.275194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.287488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2082/4154] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:30.289189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.329461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40961502-1866-4e1f-abec-d394889ea238 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.342063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.342839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.343297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.343676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.344465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.347934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.414351 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-57107028. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:30.414351 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:30.414351 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:30.455868 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2083/4155] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:30 2022] POST /identity/v3/services => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:30.456989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.501770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2073/4156] 10.222.0.64 () {60 vars in 1256 bytes} [Wed Nov 2 12:46:30 2022] PATCH /identity/v3/endpoints/22b0b3cb80f3456cab7d3cf52eb3d658 => generated 360 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:30.502929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.511146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1f9f7-02b6-447c-9916-22b74b1c7d30 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.549392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.550006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.550328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.551957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.551957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.553197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.553788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab5942-0631-4ad5-85bd-0155e118511a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.572048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2084/4157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:30.574465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.586801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.587524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.587809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.588067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f741bd1-a16f-44aa-91c8-ab195d4ec223 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.588175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] PATH_INFO: `/v3/projects/8f45f7b86c104af5a07c40034429278c/users/e2be048b612348bc8645e2ff12890db6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.594892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.595701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.595894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.596241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.597008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.599488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.609047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f45f7b86c104af5a07c40034429278c, user_id=e2be048b612348bc8645e2ff12890db6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.613035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.740748 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2074/4158] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:30 2022] PUT /identity/v3/projects/8f45f7b86c104af5a07c40034429278c/users/e2be048b612348bc8645e2ff12890db6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:30.742261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.754760 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2085/4159] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:30 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:30.759287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:30.888931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08de25-b74e-4e8f-9b5c-972c295cf50f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.953593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee0bda-3510-492f-b4b5-3b372e2f64b3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:30.962172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:30.962933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:30.963289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:30.963659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-57107028` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:30.965472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-57107028)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:30.966517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:30.969028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2086/4160] 10.222.0.64 () {58 vars in 1200 bytes} [Wed Nov 2 12:46:30 2022] GET /identity/v3/regions/tempest-region-57107028 => generated 176 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:30.969932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.017927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.018643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.021674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.021674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.021674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.021674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9446bc-41b7-4804-930a-0cd24b1d8eb6 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.086632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363ce9e-e2da-42f0-8172-0f0e94d39fa9 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.092348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.093352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.093844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.094436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] PATH_INFO: `/v3/projects/dfb573e521b54a43903005fde9cbf83c/users/bbe56d3d716d445cb7182ff25e87714f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.106838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2075/4161] 10.222.0.64 () {60 vars in 1213 bytes} [Wed Nov 2 12:46:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:31.107964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.108241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.108562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.115341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb573e521b54a43903005fde9cbf83c, user_id=bbe56d3d716d445cb7182ff25e87714f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.120345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.143243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:31.144481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:31.159532 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2076/4162] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:31 2022] POST /identity/v3/auth/tokens => generated 4270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:31.160143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.170988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d600d-624a-4895-af01-7cc2afd0bd1e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.177572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.178020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.178301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.178681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.179301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.181648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.203945 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2087/4163] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:30 2022] PUT /identity/v3/projects/dfb573e521b54a43903005fde9cbf83c/users/bbe56d3d716d445cb7182ff25e87714f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:31.205096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.331581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2077/4164] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:31 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:31.337837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.341318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825833c-cd4d-4352-804d-80e5155b8f95 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.351396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e379e-4144-4109-a475-b1b05142cfbe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.355708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.356992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.362249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.362249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/22b0b3cb80f3456cab7d3cf52eb3d658` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.363096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:31.370899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=22b0b3cb80f3456cab7d3cf52eb3d658)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.373591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.450506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.451143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.451423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.451696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.452593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.454418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.521995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d946656b-45c0-406d-9bd4-773b72208626 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '22b0b3cb80f3456cab7d3cf52eb3d658', 'request_id': 'req-d946656b-45c0-406d-9bd4-773b72208626'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:31.556530 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2078/4165] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:31 2022] POST /identity/v3/services => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:31.557322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.561715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:31.565669 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2088/4166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:31 2022] DELETE /identity/v3/endpoints/22b0b3cb80f3456cab7d3cf52eb3d658 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:31.568085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.568363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.568664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.642416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] MFA Rules not processed for user `bbe56d3d716d445cb7182ff25e87714f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:31.646142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:31.652360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:31.688200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559a561-8207-4472-aa63-dae28d8b7de4 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.707557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.708874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.708874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.708874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.810987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2089/4167] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:31 2022] POST /identity/v3/auth/tokens => generated 4409 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:31.813490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.848163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.849664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.897076 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2079/4168] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:31 2022] GET /identity/v3/auth/tokens => generated 4402 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:31.898182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:31.947730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88131-d0bd-40c1-8c11-30f608908430 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.947934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141346e2-701e-4343-8d3c-695d9fe34b5b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:31.948780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.948928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:31.949788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.950268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.950731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.951732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.953512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:31.953869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.953983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:31.954317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ef2f4a16f8084af783896352707909ab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:31.955752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=ef2f4a16f8084af783896352707909ab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:31.956985 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:31.956985 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:31.956985 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:31.958095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:31.968982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2090/4169] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:31.970265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.003423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575995d7-86f0-400e-9dff-8a288d41e845 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.009927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.010610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.010937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.011214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-57107028` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.011822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-57107028)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.012857 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:32.012857 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:32.012857 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:32.013742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.058013 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2080/4170] 10.222.0.64 () {60 vars in 1313 bytes} [Wed Nov 2 12:46:31 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/ef2f4a16f8084af783896352707909ab => generated 333 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:32.060917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.079362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3c9bc-8763-43ff-85ec-1e1742fc7540 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.094418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.094418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.094418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.094418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.096674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.104741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.157004 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-57107028. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:32.157004 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:32.157004 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:32.167938 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2091/4171] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:46:31 2022] DELETE /identity/v3/regions/tempest-region-57107028 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:32.168867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.212699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d920242-2f93-4b3e-a2e5-77a1ba6281aa tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.223581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.224212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.224696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.225124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.226519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.228136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.245692 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2081/4172] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:32 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:32.245692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.269177 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2092/4173] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:32.269177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.308208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46eea28-bf5e-4de9-95bb-5055fd02d5ac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.431549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786da17d-7818-42cf-9faf-60d3894962d3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.470183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.472271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.473046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.473331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.473604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-311405652` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.474209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-311405652)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.475118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.475421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.475694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services/8376b751319e4ab6afeb7ed4aef3aa0f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.476946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8376b751319e4ab6afeb7ed4aef3aa0f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.478181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.481458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.602177 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-311405652. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:46:32.602177 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:46:32.602177 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:32.624013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2093/4174] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:46:32 2022] DELETE /identity/v3/regions/tempest-region-311405652 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:32.625007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.642512 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2082/4175] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:32 2022] DELETE /identity/v3/services/8376b751319e4ab6afeb7ed4aef3aa0f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:32.642512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:32.813546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b47cd-5823-4dc6-9160-67418f55bb52 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.817967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa34f4e-b115-4e4c-ba34-e1ed82f5a55e tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:32.821552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.822985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.822985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.822985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] PATH_INFO: `/v3/projects/5120a465cc644d3fb82f9addd1ce1485/users/df8f2e2918d74ad0b181080e10a45cbc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.831735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:32.831735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:32.836475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:32.837959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:32.840632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.842927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5120a465cc644d3fb82f9addd1ce1485, user_id=df8f2e2918d74ad0b181080e10a45cbc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:32.844223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:32.846442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.005651 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2094/4176] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:32 2022] POST /identity/v3/users => generated 291 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:33.009721 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2083/4177] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:32 2022] PUT /identity/v3/projects/5120a465cc644d3fb82f9addd1ce1485/users/df8f2e2918d74ad0b181080e10a45cbc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.010586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.011138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.042563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a2f2d-6326-4c2b-aaff-02a664d67ee4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.109250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bea3b3-282f-4e80-ad60-4c0241e484d6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.122963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.124107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.124597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.125653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/ef2f4a16f8084af783896352707909ab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.126615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=ef2f4a16f8084af783896352707909ab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.127964 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:33.127964 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:33.127964 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:33.129079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.129702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.130842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.131804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.131804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services/5444c01d05db4aefb2de6f9597192aa1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.133148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5444c01d05db4aefb2de6f9597192aa1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.135069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71094ebc-1052-4cd8-9640-8584acde9984 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.243945 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2084/4178] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/ef2f4a16f8084af783896352707909ab => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.247599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.291157 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2095/4179] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/services/5444c01d05db4aefb2de6f9597192aa1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.292149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.293142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.293142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.333006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b32a2-7b64-446d-b784-9f7ec921118e tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.347648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] MFA Rules not processed for user `df8f2e2918d74ad0b181080e10a45cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:33.350053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:33.352063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.353459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.353459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.353459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.354149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.356628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.394800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2085/4180] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:33.395796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.439873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23805c8-6fa9-4728-9799-006e820e90d5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.447014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.447842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.448259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.449394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services/2f30930d7e744ae68cdf18396d7d0285` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.450126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2f30930d7e744ae68cdf18396d7d0285)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.452145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.507235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2096/4181] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:33 2022] POST /identity/v3/auth/tokens => generated 4142 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:33.508217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.541206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d92e6-ac7b-40e7-b3fa-463b1d8ea5ab None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.546377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.546856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.547221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.547447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/570026946db14451a9ed7085f1f5ba92` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.562683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=570026946db14451a9ed7085f1f5ba92)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.562683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.644338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2086/4182] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/services/2f30930d7e744ae68cdf18396d7d0285 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.649342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.672271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ecc9c-1e24-436f-82bd-8e6090bbf0c5 tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.677855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.678669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.679012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.679236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] PATH_INFO: `/v3/projects/ae2358cc8c4f40caab1b4add5256632e/users/a6214be88770440b83020586a2e1ce87/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.688475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '570026946db14451a9ed7085f1f5ba92', 'request_id': 'req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:33.693049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:33.699408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2358cc8c4f40caab1b4add5256632e, user_id=a6214be88770440b83020586a2e1ce87, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.702046 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2097/4183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/endpoints/570026946db14451a9ed7085f1f5ba92 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.702434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.702889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.728401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf60d94-3c91-4c56-b0cd-c858ad8076a7 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.734492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.735111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.735392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.735666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.736357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.738402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:33.869797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2087/4184] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:33 2022] PUT /identity/v3/projects/ae2358cc8c4f40caab1b4add5256632e/users/a6214be88770440b83020586a2e1ce87/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:33.870094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2098/4185] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:33 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:33.870663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.870784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:33.962931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd2478-4b0f-40e8-a664-1f10ac7adbe0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.968007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeccc73-b12f-4b98-8b28-aa7f16323b39 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:33.973894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:33.974594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:33.975062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:33.975186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-1265740464` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:33.975932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1265740464)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:33.977617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.037361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:34.073761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.073761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.073761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.074490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/d7e72cf7d33841569dae6a588c83370c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.074490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=d7e72cf7d33841569dae6a588c83370c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.075889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.088159 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2099/4186] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/regions/tempest-region-1265740464 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.095705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.177503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5045f6f-3123-4025-96bf-07d6043c9639 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.183490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.184112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.184391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.184711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.185362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.187114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.201283 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2100/4187] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:34.201283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.205448 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2088/4188] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:46:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/d7e72cf7d33841569dae6a588c83370c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.206780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.227193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cf4aa-9aa5-4080-879c-9ef63e9ea4ea tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.230119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e28779-f628-47a0-bcf2-3e6594d05b08 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.243359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.243867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.244153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.244430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.245152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.253331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.253433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.254057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.254550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.255898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services/a24cfa7a879b4fe185a5c983fef24da2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.256974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a24cfa7a879b4fe185a5c983fef24da2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.259449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.435674 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2101/4189] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:34 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:34.437780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.447513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2089/4190] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:34 2022] DELETE /identity/v3/services/a24cfa7a879b4fe185a5c983fef24da2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.449074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.488050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1c917-b600-46fc-bd7a-33dceb187d69 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.488289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83570088-dd66-46cb-b388-b614df0d2c29 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.488413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed07780bfab64f719f76d16a106940c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bee8296d03c4988a338fef45622c6cc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.488413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.488413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.488721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] PATH_INFO: `/v3/services/ec9b9b0b5a0f4784a2b98fea4d649254` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.488721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ec9b9b0b5a0f4784a2b98fea4d649254)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.488721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.517273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.519246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.520019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.520652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] PATH_INFO: `/v3/projects/ae2358cc8c4f40caab1b4add5256632e/users/a6214be88770440b83020586a2e1ce87/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.524378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2358cc8c4f40caab1b4add5256632e, user_id=a6214be88770440b83020586a2e1ce87, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.527482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.555703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2102/4191] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:34 2022] PUT /identity/v3/projects/ae2358cc8c4f40caab1b4add5256632e/users/a6214be88770440b83020586a2e1ce87/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.556845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.593428 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2090/4192] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:34 2022] DELETE /identity/v3/services/ec9b9b0b5a0f4784a2b98fea4d649254 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.594597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.624524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2bc39-3626-4685-92ee-c06dcab8271c tempest-EndPointGroupsTest-1756498150 tempest-EndPointGroupsTest-1756498150-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.742689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.743357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.743639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.743912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/endpoints/d5201dad33a9440cb5dde7b4fa718852` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.759040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a89a60-5112-4141-a3e9-bab8be576b68 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.766372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d5201dad33a9440cb5dde7b4fa718852)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.767602 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:34.767602 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:34.767602 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:34.768546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.808121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.809840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.810540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.810841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.812820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.816839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dd16b-a0aa-4603-b426-8baeee270389 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:34.836560 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2103/4193] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:34.836560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.836560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.836560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.853202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd5201dad33a9440cb5dde7b4fa718852', 'request_id': 'req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:34.870730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] MFA Rules not processed for user `a6214be88770440b83020586a2e1ce87`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:34.874310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:34.874781 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2091/4194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:46:34 2022] DELETE /identity/v3/endpoints/d5201dad33a9440cb5dde7b4fa718852 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:34.880902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:34.885373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:34.972864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ea2a-a7e5-4a67-ba6a-52ff69f8f422 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:34.987041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:34.988034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:34.988472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:34.988918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] PATH_INFO: `/v3/users/35349c72cfd9471a94d480d007033cc0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:34.993659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35349c72cfd9471a94d480d007033cc0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:34.999164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2104/4195] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:34 2022] POST /identity/v3/auth/tokens => generated 3445 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:34.999886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:35.005441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:35.017194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fa481-b2b7-40d3-a3e9-22322636f247 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:35.023911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:35.025138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:35.025441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:35.025721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] PATH_INFO: `/v3/projects/b96dfe51bf034e1c86187beade49c456/users/b4f3ccedd3204935a0fe16c7c2e28deb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:35.050199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfe51bf034e1c86187beade49c456, user_id=b4f3ccedd3204935a0fe16c7c2e28deb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:35.053289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:35.185473 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2105/4196] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:34 2022] PUT /identity/v3/projects/b96dfe51bf034e1c86187beade49c456/users/b4f3ccedd3204935a0fe16c7c2e28deb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:35.186443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:35.265154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35349c72cfd9471a94d480d007033cc0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:35.299867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db02f20-9332-4dc8-89ad-0788dc057f2e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:35.306350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:35.307020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:35.307346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:35.307627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/regions/tempest-region-2112400859` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:35.308289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2112400859)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:35.310449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:35.368905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35349c72cfd9471a94d480d007033cc0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:35.395039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35349c72cfd9471a94d480d007033cc0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:35.396152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35349c72cfd9471a94d480d007033cc0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:35.398346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35349c72cfd9471a94d480d007033cc0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:35.666428 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2092/4197] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:34 2022] DELETE /identity/v3/users/35349c72cfd9471a94d480d007033cc0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:35.666428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:35.666428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:35.666428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae8794-99ea-47c1-a431-cf6c7afc4046 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:35.668401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:35.668401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:35.668401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:35.675429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:35.675429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:35.675429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cb00e-904d-41d0-8403-014781bce5d2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:35.676295 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2106/4198] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:46:35 2022] DELETE /identity/v3/regions/tempest-region-2112400859 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:35.676295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:35.676295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:35.711787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2093/4199] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:46:35 2022] POST /identity/v3/domains => generated 274 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:35.716144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:35.716747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:35.717198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:35.778345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:35.782728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:35.798369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:35.855082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a44ca-3767-421a-856e-d5ec6a31c29a tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:35.940944 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2094/4200] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:35 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:35.949005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:35.952071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:35.972099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:35.973137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:35.973770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:35.975939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:35.976533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:35.982383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.010831 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2107/4201] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:36.013829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:36.154277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:36.175007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6ec6-772f-4db1-aa6a-446531dba482 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:36.182185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e969cdc2196c4878be92297b172a7d0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '836f9e3a3ee745e9b13942392c5408be', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:36.182495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:36.182776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:36.183048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] PATH_INFO: `/v3/services/f22c58b029a643bb879df3f88f31d8ba` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:36.183691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f22c58b029a643bb879df3f88f31d8ba)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:36.185385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.207738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7e2fc-0266-44f4-b10f-9e7e897c766b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:36.224268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:36.229733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:36.232852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:36.233208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:36.234305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:36.236542 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:36.236542 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:36.236542 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:36.238345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.319354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2095/4202] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:35 2022] DELETE /identity/v3/services/f22c58b029a643bb879df3f88f31d8ba => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:36.322943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:36.327796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:36.457233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2108/4203] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:36 2022] POST /identity/v3/groups => generated 281 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:36.458915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:36.475174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce529-35a4-4385-9ac4-089ab033ea69 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:36.527482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:36.528196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:36.528453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:36.536988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] PATH_INFO: `/v3/projects/b96dfe51bf034e1c86187beade49c456/users/b4f3ccedd3204935a0fe16c7c2e28deb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:36.544738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96dfe51bf034e1c86187beade49c456, user_id=b4f3ccedd3204935a0fe16c7c2e28deb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:36.552971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.589059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b6e51-c99b-4495-a312-4c43d023e179 tempest-EndPointsTestJSON-1755066582 tempest-EndPointsTestJSON-1755066582-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:36.597194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2109/4204] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:36 2022] PUT /identity/v3/projects/b96dfe51bf034e1c86187beade49c456/users/b4f3ccedd3204935a0fe16c7c2e28deb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:36.601938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:36.608501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:36.724527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d921-89e3-465c-9f63-fe4d8225198a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:36.731833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:36.732778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:36.733169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:36.733602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] PATH_INFO: `/v3/users/e9570b0583654cb8b55cf2e267d20503` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:36.735195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9570b0583654cb8b55cf2e267d20503)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:36.738917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.767836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:36.768467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:36.768962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:36.769235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:36.806480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:36.806480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:36.815362 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2096/4205] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:36.832767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.009423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094f36e-45a8-442a-ab44-2ec2dea77f57 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.024619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.025539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.026056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.026491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/6f73ce158bd5425889344da363440d1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.029934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9570b0583654cb8b55cf2e267d20503'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:37.038226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:update_group(group_id=6f73ce158bd5425889344da363440d1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.038226 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:37.038226 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:37.038226 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:37.038681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10118e4-d4e3-4943-b3ae-354b45642001 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:37.134051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9570b0583654cb8b55cf2e267d20503'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:37.146436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2097/4206] 10.222.0.64 () {60 vars in 1247 bytes} [Wed Nov 2 12:46:36 2022] PATCH /identity/v3/groups/6f73ce158bd5425889344da363440d1e => generated 292 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:37.153082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292934-2216-453d-9d39-d1f953660e2b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.153236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292934-2216-453d-9d39-d1f953660e2b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.153604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76292934-2216-453d-9d39-d1f953660e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.166718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9570b0583654cb8b55cf2e267d20503'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:37.186392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9570b0583654cb8b55cf2e267d20503'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:37.187792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9570b0583654cb8b55cf2e267d20503'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:37.207839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-76292934-2216-453d-9d39-d1f953660e2b None None] MFA Rules not processed for user `b4f3ccedd3204935a0fe16c7c2e28deb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:37.208238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2110/4207] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:36 2022] DELETE /identity/v3/users/e9570b0583654cb8b55cf2e267d20503 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:37.209243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.209381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76292934-2216-453d-9d39-d1f953660e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:37.217608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:37.345141 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2098/4208] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:37.349058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.349784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.350442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.375141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66cf7-e69f-48d9-ad47-c95b48f7f7f3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.390037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.391054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.391473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.391863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/6f73ce158bd5425889344da363440d1e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.407763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:get_group(group_id=6f73ce158bd5425889344da363440d1e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.409856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:37.414856 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2111/4209] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:37 2022] GET /identity/v3/groups/6f73ce158bd5425889344da363440d1e => generated 292 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:37.414856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.422113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:37.425933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:37.432683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:37.543218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:37.566950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09d927-23b0-4577-a2ac-623bab9a9260 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.581355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.582152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.582542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.582913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.586266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:37.608099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.609752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:37.632147 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2112/4210] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:37.633204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.640999 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2099/4211] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:37.663299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd033186-90f5-4f2b-bf43-b4063972c5db service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.672916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.673457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.673796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.674132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/6f73ce158bd5425889344da363440d1e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.695237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:update_group(group_id=6f73ce158bd5425889344da363440d1e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.698427 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:37.698427 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:37.698427 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:37.698861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:37.719209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.738647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35dd39f-a938-45cc-8044-139da2efaf84 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.750112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.750112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.750112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.750112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.782776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.788592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:37.810348 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2100/4212] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:46:37.857776 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2113/4213] 10.222.0.64 () {60 vars in 1246 bytes} [Wed Nov 2 12:46:37 2022] PATCH /identity/v3/groups/6f73ce158bd5425889344da363440d1e => generated 309 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:37.858322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:37.887977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040a4d2-60f6-4cb8-805a-c83308cc631e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:37.905547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:37.910949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:37.913973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:37.914162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/6f73ce158bd5425889344da363440d1e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:37.946466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6f73ce158bd5425889344da363440d1e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:37.955172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:38.262265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2101/4214] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:37 2022] DELETE /identity/v3/groups/6f73ce158bd5425889344da363440d1e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:38.263374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:38.275019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f34bd-f9a0-4986-83f0-d2db7e7e33a3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:38.385994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:38.386550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:38.386851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:38.387086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:38.387777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:38.395845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:38.525437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:38.527799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:38.545975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2114/4215] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:38 2022] POST /identity/v3/groups => generated 326 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:38.547425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:38.583087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d4b4-bb47-4b0e-8443-bd0a99052e17 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:38.597581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:38.598515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:38.598996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:38.599984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:38.601631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:38.604556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:38.619364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f9e4b-8a54-49b1-b485-d3b2011ae004 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:38.626168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:38.627024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:38.627396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:38.627762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] PATH_INFO: `/v3/projects/3bc54a0ddc544dea833bd073bdc58062` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:38.629610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc54a0ddc544dea833bd073bdc58062)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:38.635682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:38.783252 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2115/4216] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:38 2022] POST /identity/v3/users => generated 323 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:38.786423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:38.810079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad2985-59ec-4558-907b-96bc300ae0db tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:38.824093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:38.825123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:38.825123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:38.825444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:38.841690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc54a0ddc544dea833bd073bdc58062', 'request_id': 'req-eaac73bc-a259-48eb-b9dc-86c19074d886'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:38.863132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc54a0ddc544dea833bd073bdc58062', 'request_id': 'req-eaac73bc-a259-48eb-b9dc-86c19074d886'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:38.934135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=0ac478d8061444b280f952db38e3fe3b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:38.934135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:39.145879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc54a0ddc544dea833bd073bdc58062', 'request_id': 'req-eaac73bc-a259-48eb-b9dc-86c19074d886'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.153948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2116/4217] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:46:38 2022] PUT /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:39.155238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:39.161181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:39.164912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] The token cache is being invalidate because project 3bc54a0ddc544dea833bd073bdc58062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:39.165821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.166939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.169237 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2102/4218] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:38 2022] DELETE /identity/v3/projects/3bc54a0ddc544dea833bd073bdc58062 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:39.170317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:39.174873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:39.307954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac73bc-a259-48eb-b9dc-86c19074d886 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:39.346030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:39.376519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310de89-d4ee-46f6-9ba8-1edf741a803c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:39.393457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:39.398385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:39.398385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:39.398385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] PATH_INFO: `/v3/projects/843cfbc8d00e4e10926a0ce125f83fb4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:39.398385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843cfbc8d00e4e10926a0ce125f83fb4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:39.399470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:39.488196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:39.488851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:39.489143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:39.489422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:39.490076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:39.494346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:39.649394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843cfbc8d00e4e10926a0ce125f83fb4', 'request_id': 'req-0c8d4810-eefe-492c-9d50-4922e9997f22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.657975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843cfbc8d00e4e10926a0ce125f83fb4', 'request_id': 'req-0c8d4810-eefe-492c-9d50-4922e9997f22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.669873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843cfbc8d00e4e10926a0ce125f83fb4', 'request_id': 'req-0c8d4810-eefe-492c-9d50-4922e9997f22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.680024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2103/4219] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:39 2022] POST /identity/v3/users => generated 321 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:39.681503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:39.683979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:39.708982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f659c8a-316c-44c9-ad69-20f23a7855fd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:39.781997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:39.783283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:39.783753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:39.784361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] PATH_INFO: `/v3/users/ed07780bfab64f719f76d16a106940c3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:39.786014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed07780bfab64f719f76d16a106940c3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:39.788727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:39.820879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] The token cache is being invalidate because project 843cfbc8d00e4e10926a0ce125f83fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:39.821640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.824111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:39.826695 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2117/4220] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:39 2022] DELETE /identity/v3/projects/843cfbc8d00e4e10926a0ce125f83fb4 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:39.828640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:39.832420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:39.934066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d4810-eefe-492c-9d50-4922e9997f22 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:39.939258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:39.946202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:39.954449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:39.954449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:39.954449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:39.968826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=e8b4ccecd26e4ec8ab4b20b61fb91942)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:39.971496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:40.151051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2118/4221] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:46:39 2022] PUT /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:40.151051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:40.155065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:40.160385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed07780bfab64f719f76d16a106940c3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:40.299637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed07780bfab64f719f76d16a106940c3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:40.321818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed07780bfab64f719f76d16a106940c3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:40.322765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed07780bfab64f719f76d16a106940c3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:40.324169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed07780bfab64f719f76d16a106940c3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:40.348459 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2104/4222] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:39 2022] DELETE /identity/v3/users/ed07780bfab64f719f76d16a106940c3 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:40.349564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:40.353987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:40.392206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de2819-a1aa-434c-b2d8-8b2a26156e1c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:40.541430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386344b8-27e2-4939-ab4f-72434463cdfe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:40.543528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:40.544693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:40.544693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:40.544952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] PATH_INFO: `/v3/users/e969cdc2196c4878be92297b172a7d0e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:40.549381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e969cdc2196c4878be92297b172a7d0e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:40.559038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:40.567828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:40.568715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:40.569892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:40.570274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:40.571013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:40.573496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:40.717193 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2105/4223] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:40 2022] POST /identity/v3/users => generated 321 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:40.722051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:40.746025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df5963-b532-47b8-a14b-4743a82db7f6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:40.761823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:40.763675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:40.766936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:40.767242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:40.800988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=203622ea052a4fe6b212ddf5d89df295)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:40.803292 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:40.803292 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:40.803292 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:40.806093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:40.889682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e969cdc2196c4878be92297b172a7d0e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:41.117931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e969cdc2196c4878be92297b172a7d0e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:41.138849 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2106/4224] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:46:40 2022] PUT /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:41.141343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:41.180447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e969cdc2196c4878be92297b172a7d0e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:41.202671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e969cdc2196c4878be92297b172a7d0e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:41.204367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e969cdc2196c4878be92297b172a7d0e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:41.224466 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2119/4225] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:40 2022] DELETE /identity/v3/users/e969cdc2196c4878be92297b172a7d0e => generated 0 bytes in 1076 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:41.317029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fe87e-5ef1-4dcb-9ea1-60f964e834e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:41.553594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:41.555481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:41.583035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:41.585327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:41.586029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:41.588020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:41.592414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c03f3100db5041af88b559745cd41f59)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:41.597053 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:41.597053 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:41.597053 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:41.600218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:41.663866 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2107/4226] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:46:41 2022] GET /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users => generated 1081 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:41.670652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:41.680634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:41.754071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219408a-5d90-425c-9a1b-f3563be5deb9 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:41.784181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:41.791341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:41.791341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:41.791341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:41.793297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=0ac478d8061444b280f952db38e3fe3b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:41.794529 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:41.794529 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:41.794529 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:41.796103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:41.801847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a751eaf-ce60-44a3-9de0-d0a03ab37a20 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:41.815338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:41.818528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:41.819757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:41.820781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] PATH_INFO: `/v3/projects/4bee8296d03c4988a338fef45622c6cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:41.828942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bee8296d03c4988a338fef45622c6cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:41.857345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:41.864701 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2108/4227] 10.222.0.64 () {58 vars in 1342 bytes} [Wed Nov 2 12:46:41 2022] HEAD /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:41.871012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:41.904943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9f9b7-928c-4301-9e67-9c43689acc08 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:41.911582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:41.922833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:41.923499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:41.923781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:41.924056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:41.926589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=0ac478d8061444b280f952db38e3fe3b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:41.929838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:42.082026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.115414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bee8296d03c4988a338fef45622c6cc', 'request_id': 'req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.131970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bee8296d03c4988a338fef45622c6cc', 'request_id': 'req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.149238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bee8296d03c4988a338fef45622c6cc', 'request_id': 'req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.227867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2109/4228] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:46:41 2022] DELETE /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/0ac478d8061444b280f952db38e3fe3b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:42.240400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.316031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] The token cache is being invalidate because project 4bee8296d03c4988a338fef45622c6cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:42.316729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.318765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9b191a18-bb7b-4ef1-868b-0a0d1edebea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.321692 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2120/4229] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:41 2022] DELETE /identity/v3/projects/4bee8296d03c4988a338fef45622c6cc => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:42.326695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef49e8-4a50-41ed-ae42-dda57f57df2f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.327251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef49e8-4a50-41ed-ae42-dda57f57df2f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.328810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef49e8-4a50-41ed-ae42-dda57f57df2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.374754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f1ef49e8-4a50-41ed-ae42-dda57f57df2f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:42.378971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f1ef49e8-4a50-41ed-ae42-dda57f57df2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:42.450940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837b83-3206-493d-b5b1-fd77c3c8efd3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:42.467936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:42.468934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.469381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.469822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.472843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=e8b4ccecd26e4ec8ab4b20b61fb91942)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:42.474972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:42.500891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2121/4230] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:46:42.503079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.504006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.504382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.527803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2110/4231] 10.222.0.64 () {58 vars in 1342 bytes} [Wed Nov 2 12:46:42 2022] HEAD /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:42.529108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.531054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:42.549013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:42.551170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:42.561584 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2122/4232] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:42.565342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd312d8e-7c8b-410d-b534-ae51715ffdc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:42.565582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.578476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:42.578783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.579068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.579488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.581084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=e8b4ccecd26e4ec8ab4b20b61fb91942)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:42.583026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:42.588783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8be60-e89e-465a-8003-c93e6ce66cef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:42.595154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:42.596217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.596749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.597215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.598045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:42.598513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:42.602160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:42.636395 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2123/4233] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:42.638051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.660996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda7619-24ea-4bc5-85bc-af3da98d8069 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:42.673385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:42.674149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:42.674437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:42.674752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:42.675476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:42.677542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:42.693537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:42.810934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2111/4234] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:46:42 2022] DELETE /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/e8b4ccecd26e4ec8ab4b20b61fb91942 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:42.816507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.891115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2124/4235] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:42 2022] POST /identity/v3/projects => generated 389 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:42.901823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:42.961464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17b89c-d541-4b1c-a9d2-44374aa81a3c tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.118038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.119156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.119156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.119384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.121847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=203622ea052a4fe6b212ddf5d89df295)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.124220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:43.135011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf87e1-a74d-48c6-a1cc-8823b351fa28 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.149225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.149885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.154167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.154755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.155796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.162764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:43.173630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2112/4236] 10.222.0.64 () {58 vars in 1342 bytes} [Wed Nov 2 12:46:42 2022] HEAD /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:43.179735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:43.195897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7581740f-d58f-4104-aa01-102d61cc05d4 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.219365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.219365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.219365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.219622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.222428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=c03f3100db5041af88b559745cd41f59, user_id=203622ea052a4fe6b212ddf5d89df295)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.226276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:43.317315 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2125/4237] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:42 2022] POST /identity/v3/users => generated 295 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:43.317315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:43.320230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:43.353606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb120f2-9f10-41eb-abc2-1c0c8bc88ed9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.372087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.372858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.373139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.373504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] PATH_INFO: `/v3/projects/836f9e3a3ee745e9b13942392c5408be` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.375416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=836f9e3a3ee745e9b13942392c5408be)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.378018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:43.403672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.551688 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2113/4238] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:46:43 2022] DELETE /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users/203622ea052a4fe6b212ddf5d89df295 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:46:43.552863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:43.593384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836f9e3a3ee745e9b13942392c5408be', 'request_id': 'req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.627228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836f9e3a3ee745e9b13942392c5408be', 'request_id': 'req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.645787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836f9e3a3ee745e9b13942392c5408be', 'request_id': 'req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.717350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280e638-343c-47ed-9fdd-49e3fef22540 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.767920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] The token cache is being invalidate because project 836f9e3a3ee745e9b13942392c5408be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:43.768250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.769168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:43.772702 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2126/4239] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:43 2022] DELETE /identity/v3/projects/836f9e3a3ee745e9b13942392c5408be => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:43.773650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:43.779584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:43.783421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:43.906925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.908275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.908796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.909298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.910185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.912213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d27b3-964f-4eeb-aa07-2e7faf7ee09d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:43.941544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e71b-0cee-407e-82e2-95dd5f23a6b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:43.949886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2114/4240] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:43.952393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513625-9d26-486d-8493-795fcdb8542f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.955859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513625-9d26-486d-8493-795fcdb8542f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.956527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15513625-9d26-486d-8493-795fcdb8542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.958269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:43.959044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:43.959327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:43.959666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:43.963999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=c03f3100db5041af88b559745cd41f59)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:43.968330 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:43.968330 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:43.968330 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:43.969411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:44.002312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-15513625-9d26-486d-8493-795fcdb8542f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:44.007397 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2127/4241] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:46:43 2022] GET /identity/v3/groups/c03f3100db5041af88b559745cd41f59/users => generated 145 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:44.007397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.018191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.018304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-15513625-9d26-486d-8493-795fcdb8542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.039807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2115/4242] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:44.040636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48272c97-81a8-4204-bfad-4c23f32338f2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:44.040957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15513625-9d26-486d-8493-795fcdb8542f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.046703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:44.048511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.048511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.048511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.049213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:44.050894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73413a-28f5-46fc-986e-a64cf31c4a9a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:44.087158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15513625-9d26-486d-8493-795fcdb8542f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:44.087158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:44.087158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.088437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.088437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users/203622ea052a4fe6b212ddf5d89df295` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.089523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_user(user_id=203622ea052a4fe6b212ddf5d89df295)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:44.091617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:44.105329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2128/4243] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:44.110079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.110709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.111077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.135648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:44.162923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:44.166180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.182166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2129/4244] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:44.183158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.202698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da43686-6249-4260-a48e-cafd5289f6fd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:44.213663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:44.214659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.214941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.215213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] PATH_INFO: `/v3/projects/b103bb7c440443ae945c37163c6d3fc2/users/4a91cd4d0c59435ba2842f163d9b37f5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.255936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b103bb7c440443ae945c37163c6d3fc2, user_id=4a91cd4d0c59435ba2842f163d9b37f5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:44.262051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:44.357391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:44.439023 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2130/4245] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:44 2022] PUT /identity/v3/projects/b103bb7c440443ae945c37163c6d3fc2/users/4a91cd4d0c59435ba2842f163d9b37f5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:44.439936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.470482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:44.547731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:44.548521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:44.549264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d38f5b98-95fe-46a3-b579-20a9308a8371 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '203622ea052a4fe6b212ddf5d89df295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:44.589735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2116/4246] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:44 2022] DELETE /identity/v3/users/203622ea052a4fe6b212ddf5d89df295 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:44.593428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.593721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.593999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.615836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc1469-af4c-431b-b805-16669e00b33c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:44.720148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] MFA Rules not processed for user `4a91cd4d0c59435ba2842f163d9b37f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:44.721552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.770355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:44.771188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.771307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.772668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.773340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:44.773644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:44.775457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:44.808088 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2131/4247] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:44.809071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.812785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.940970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371febd7-7ce0-4e7e-ae5d-3c19f913b051 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:44.942438 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2117/4248] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:44.943380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:44.953102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:44.956898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:44.957771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:44.969550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:44.969550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users/e8b4ccecd26e4ec8ab4b20b61fb91942` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:44.969550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e8b4ccecd26e4ec8ab4b20b61fb91942)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:44.969550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:45.000010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeff80a-b084-4ea5-b5a2-101d8b0d755a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:45.013475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:45.015365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:45.015365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:45.015365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:45.015792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:45.017980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:45.167654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:45.209296 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2118/4249] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:44 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:45.213976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:45.221458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:45.305867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:45.326707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:45.349261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:45.351443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b4ccecd26e4ec8ab4b20b61fb91942'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:45.376590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2132/4250] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:44 2022] DELETE /identity/v3/users/e8b4ccecd26e4ec8ab4b20b61fb91942 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:45.376590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:45.376590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:45.398944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79462d-4edb-403c-a9b6-33aaf71650b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:45.550066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a03f1b-f3a5-4a08-b8d0-400652bd0ed6 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:45.567984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:45.568643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:45.568815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:45.569510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:45.569787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:45.570336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:45.570449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:45.570797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:45.571177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:45.571926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:45.574341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4814a-3b8e-453b-a358-80273c4b6814 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:45.574502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:45.774085 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2119/4251] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:45 2022] POST /identity/v3/projects => generated 387 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:45.775635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:45.781529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:45.798330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:45.808526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2133/4252] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:45 2022] POST /identity/v3/users => generated 286 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:45.808526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:45.808526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:45.808526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:45.899369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] MFA Rules not processed for user `e2be048b612348bc8645e2ff12890db6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:45.900635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:45.912375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5188c-3692-4a06-9095-fcfd9a8c9c9c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:45.945696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:45.946600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:45.947291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:45.948157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users/0ac478d8061444b280f952db38e3fe3b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:45.952810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ac478d8061444b280f952db38e3fe3b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:45.963921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:46.044092 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2134/4253] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:46.044800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:46.048672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:46.197707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:46.243541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:46.250529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ef98f-877e-4cd8-94b0-6d916118af7e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:46.269656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:46.270303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:46.270582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:46.270848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:46.277560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:46.291838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:46.383469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:46.427550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:46.431389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:46.433527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac478d8061444b280f952db38e3fe3b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:46.457416 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2135/4254] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:46 2022] POST /identity/v3/users => generated 300 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:46.458670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:46.466546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:46.504269 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2120/4255] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:45 2022] DELETE /identity/v3/users/0ac478d8061444b280f952db38e3fe3b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:46.509573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:46.528853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:46.546546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2979bff-72d4-4b6c-a3ce-0beda544f181 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:46.791514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:46.792383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:46.792782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:46.793126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:46.794164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:46.796253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:46.811566 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2136/4256] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:46.812787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:46.819456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:46.820691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2eda04-28c9-41ee-a51d-22e35ac30032 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:46.828861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:46.830380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:46.830844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:46.831189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:46.832064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:46.834189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:46.836243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbc55-c7ab-4f2f-bb22-eba727d9c6a2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:46.841870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:46.843231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:46.843810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:46.844282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:46.845147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:46.848514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:46.873531 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2137/4257] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:46.874397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:46.876467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:47.014058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2121/4258] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:46 2022] POST /identity/v3/projects => generated 387 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:47.015007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.019025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6358ac1-6a4a-4508-a068-9f5f3e93c89d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.129637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.131603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.132942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.133891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c03f3100db5041af88b559745cd41f59` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.138123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c03f3100db5041af88b559745cd41f59)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.140805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:47.142373 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:47.142373 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:46:47.142373 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:46:47.144771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.170251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a780-3476-4b43-abe0-43d2ce09165a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.177230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.179008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.179412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.179722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.180677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.183074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.203217 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2122/4259] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:47.203217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.218147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e1b89-d7fe-418e-aca2-e3921c7644cf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.225406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.226468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.226922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.227416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] PATH_INFO: `/v3/projects/36afadfa4590450e8ea17f32f258f25d/users/b5654ad957e148168f369e582959273b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.253216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36afadfa4590450e8ea17f32f258f25d, user_id=b5654ad957e148168f369e582959273b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.257229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.404747 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2138/4260] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:46 2022] DELETE /identity/v3/groups/c03f3100db5041af88b559745cd41f59 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:47.409886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.489422 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2123/4261] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:47 2022] PUT /identity/v3/projects/36afadfa4590450e8ea17f32f258f25d/users/b5654ad957e148168f369e582959273b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:47.489422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.529443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbc9a5-9c0d-429e-bf81-55537d61cfc0 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.630460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b4b14-9bc5-452e-8908-d2c7c958b636 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.639791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.640441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.643686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.643686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.644437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.647462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.654994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.656672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.656672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.656672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] PATH_INFO: `/v3/projects/64bc74b60c984c3390bb4f31447da199/users/b38eb2c459b147bb93d28abb3d11f5fa/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.683409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bc74b60c984c3390bb4f31447da199, user_id=b38eb2c459b147bb93d28abb3d11f5fa, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.687365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.803276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2139/4262] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:47 2022] POST /identity/v3/users => generated 300 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:47.808952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.814069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:47.851269 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2124/4263] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:47 2022] PUT /identity/v3/projects/64bc74b60c984c3390bb4f31447da199/users/b38eb2c459b147bb93d28abb3d11f5fa/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:47.852079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:47.943285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7921bd8-35c3-4ffb-988a-42522743f38e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:47.951301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:47.952147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:47.952432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:47.952767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:47.953418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:47.955652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:47.970326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bce79e-4cfd-4d52-9946-6176f8bad08b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.047334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.048217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.048840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.049230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.054774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:48.067494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.069800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.088844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2140/4264] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:48.088844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.132913 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2125/4265] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:47 2022] POST /identity/v3/groups => generated 325 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:48.141332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.161627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:48.336739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e224d96-dc0b-4d76-b7fd-bce68602efb9 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.344675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.345564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.345938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.347326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.347688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.349769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.358659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3d535-c58f-42f4-9221-f8a3d3a520d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.367241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.377828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.377828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.377828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] PATH_INFO: `/v3/users/fe54cc37cbe341ae8a4ccff43b17cb33` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.378180 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2141/4266] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:48.378388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe54cc37cbe341ae8a4ccff43b17cb33)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.378476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.378579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.387004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8523e7-c99f-482b-9b40-3c527e2b1d9f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.392656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.393682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.394055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.394441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.395318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.397197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23aa89-0169-4d60-a486-8d8051764b4d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.423703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2142/4267] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:48.423703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.423703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.423703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.465431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] MFA Rules not processed for user `b38eb2c459b147bb93d28abb3d11f5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:48.466695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:48.566039 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2143/4268] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:48.566889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.581042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b151523-e050-4f3e-b364-3da62e8d0f37 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.586616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.587226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.587501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.587771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.588396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.590513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.749239 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2144/4269] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:48 2022] POST /identity/v3/groups => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:48.750223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.764010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fd35e-73ed-4cf9-b61e-647a93e9dcce tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.769851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.770711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.770980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.771327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] PATH_INFO: `/v3/projects/36afadfa4590450e8ea17f32f258f25d/users/b5654ad957e148168f369e582959273b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:48.774030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36afadfa4590450e8ea17f32f258f25d, user_id=b5654ad957e148168f369e582959273b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:48.776862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:48.803078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe54cc37cbe341ae8a4ccff43b17cb33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:48.806042 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2145/4270] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:48 2022] PUT /identity/v3/projects/36afadfa4590450e8ea17f32f258f25d/users/b5654ad957e148168f369e582959273b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:48.807087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.894045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe54cc37cbe341ae8a4ccff43b17cb33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:48.947665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe54cc37cbe341ae8a4ccff43b17cb33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:48.948408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe54cc37cbe341ae8a4ccff43b17cb33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:48.949157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe54cc37cbe341ae8a4ccff43b17cb33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:48.967528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdff4-26e9-435b-99c4-ccdeb736b89b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:48.976907 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2126/4271] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:48 2022] DELETE /identity/v3/users/fe54cc37cbe341ae8a4ccff43b17cb33 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:48.976907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:48.976907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:48.979856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:48.981852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:48.982298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:48.988150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] PATH_INFO: `/v3/projects/ab06f83e0a424658bff125858b807de3/users/a891741a9d294fa1b565c18b7c67c887/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.023387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab06f83e0a424658bff125858b807de3, user_id=a891741a9d294fa1b565c18b7c67c887, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.025778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.097021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db815-3528-4dd9-93b2-4bf6038753df admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.109785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.110423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.110708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.113959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.114477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.116611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dca93-5918-44a1-a584-04dd898660b4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.175072 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2146/4272] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:48 2022] PUT /identity/v3/projects/ab06f83e0a424658bff125858b807de3/users/a891741a9d294fa1b565c18b7c67c887/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:49.175912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.186377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:49.214740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:49.302286 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2127/4273] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:48 2022] POST /identity/v3/projects => generated 373 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:49.308636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.308948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.309253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.316836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbb27a-c001-420a-b70e-fda533f2ce97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.396413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] MFA Rules not processed for user `b5654ad957e148168f369e582959273b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:49.401202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:49.419823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:49.480369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.481798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.482796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.483273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.484257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.487005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.593118 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2128/4274] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:49.594161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.595769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:49.599950 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2147/4275] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:49 2022] POST /identity/v3/groups => generated 327 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:49.601697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.749656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34761d80-afd3-4ff4-8214-2efd2d302e7c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.759278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.759897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.760170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.760441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.761118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.762741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.768273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7134e7-1e70-4bf7-b5a0-49c09b24496e tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.777810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.778653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.779034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.786698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.787602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.790076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.795174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2129/4276] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:49.795174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.812303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc11df9-822f-4bd8-b4c2-45a4ce78e059 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.833538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.834341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.835129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.835358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects/b103bb7c440443ae945c37163c6d3fc2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.837806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:get_project(project_id=b103bb7c440443ae945c37163c6d3fc2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.839884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.845803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2130/4277] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:46:49 2022] GET /identity/v3/projects/b103bb7c440443ae945c37163c6d3fc2 => generated 389 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:49.846757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.869385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933d1c5-f969-4345-a487-b96e376b0963 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.874894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.875513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.875849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.876122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.876955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.878014 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:49.878014 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:49.878014 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:49.879340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.889376 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2131/4278] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Nov 2 12:46:49 2022] GET /identity/v3/groups => generated 1489 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:49.893622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.905531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599438dc-d4ee-43b8-a12a-b4c913b6f779 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:49.910227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:49.911046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:49.911167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:49.911418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] PATH_INFO: `/v3/projects/ab06f83e0a424658bff125858b807de3/users/a891741a9d294fa1b565c18b7c67c887/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:49.919624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab06f83e0a424658bff125858b807de3, user_id=a891741a9d294fa1b565c18b7c67c887, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:49.925420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:49.932768 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2148/4279] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:49 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:49.934908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:49.941500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:49.945663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2132/4280] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:49 2022] PUT /identity/v3/projects/ab06f83e0a424658bff125858b807de3/users/a891741a9d294fa1b565c18b7c67c887/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:49.946956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.003489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053459d9-7783-4f92-b6b5-8db67a5d2a40 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.119517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1453e3-b33c-45e1-8767-f993e70a0aae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.124663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.127700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.128098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.128472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.130549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.134127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.178899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.179210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.179508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.179763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] PATH_INFO: `/v3/projects/445482b5acc24f018ca5337882bae30e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.187018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445482b5acc24f018ca5337882bae30e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.189014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.288143 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2133/4281] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:46:49 2022] POST /identity/v3/projects => generated 337 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:50.289350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.442128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f8735-7b09-4b23-b4d2-c0e727ed5936 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.457294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.459144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.460190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.462837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/2fa880bf670a4d27a1687016f8ad3dec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.472888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2fa880bf670a4d27a1687016f8ad3dec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.483892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445482b5acc24f018ca5337882bae30e', 'request_id': 'req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:50.484759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.500311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445482b5acc24f018ca5337882bae30e', 'request_id': 'req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:50.529568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445482b5acc24f018ca5337882bae30e', 'request_id': 'req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:50.677708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] The token cache is being invalidate because project 445482b5acc24f018ca5337882bae30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:50.681955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:50.686221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:50.689855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2149/4282] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:49 2022] DELETE /identity/v3/projects/445482b5acc24f018ca5337882bae30e => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:50.690724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.695576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:50.706291 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2134/4283] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:50 2022] DELETE /identity/v3/groups/2fa880bf670a4d27a1687016f8ad3dec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:50.710687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.710687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:50.797995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2f180-f4c4-43bf-bdf2-6d94d2fe0b9a tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.803072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.804583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.804583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.805183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.805616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.807640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857fc89-6ff6-4037-9925-c739a6c79bbf tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.825492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d40df-6e6d-4d0c-81d5-d3255f7c8b78 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:50.838317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2135/4284] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:46:50 2022] GET /identity/v3/projects => generated 7619 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:50.839794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.840219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.840732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.893325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:50.894559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:50.941289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:50.941712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:50.942040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:50.942586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:50.943105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:50.951971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:50.972841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2150/4285] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:50.975824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:50.983437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:51.032787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2136/4286] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:51.033770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.058623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e37dd-fb0c-43cc-9bc3-e61171169aca None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.072210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.073579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.073957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.078387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects/b103bb7c440443ae945c37163c6d3fc2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.078387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:get_project(project_id=b103bb7c440443ae945c37163c6d3fc2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.078387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.088756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2137/4287] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/projects/b103bb7c440443ae945c37163c6d3fc2 => generated 389 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:51.088756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.109617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f6998-81c8-4ce3-80a3-0802cec42992 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.111133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074968c-af43-415d-9482-34a16c9c57a0 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.127244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.128057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.128436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.128757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.128930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] PATH_INFO: `/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590/users/4ca7355ecdbc4c2d9ec1c836434f5893/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.129983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.130429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.130866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/c12f94335a5c4351a8fbb05d6ebefc06` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.139794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=c12f94335a5c4351a8fbb05d6ebefc06)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.141211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.167566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbbe08c209948969b6ac2e8e1f0d590, user_id=4ca7355ecdbc4c2d9ec1c836434f5893, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.171770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72b3b-8146-46a2-84cf-5ae7e2ef441e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.256330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:51.318461 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2138/4288] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:51 2022] PUT /identity/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590/users/4ca7355ecdbc4c2d9ec1c836434f5893/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:51.323452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.323989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.324555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.340419 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2151/4289] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:50 2022] DELETE /identity/v3/groups/c12f94335a5c4351a8fbb05d6ebefc06 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:51.341996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.379040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:51.386854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:51.482437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283c639-7850-4153-9f40-71e7a027e280 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.492514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.496267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.496654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.496942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects/b3dc2a74debc4b499d62d8429b2f5bda` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.501027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:get_project(project_id=b3dc2a74debc4b499d62d8429b2f5bda)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.503139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.510928 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2152/4290] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/projects/b3dc2a74debc4b499d62d8429b2f5bda => generated 337 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:51.513300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.527143 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2139/4291] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:51.534010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.540950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a3582-daed-40c1-ba47-417b6f085743 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.547885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.548538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.548882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.549177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.549909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.551461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.567790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2153/4292] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:51.569395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.582708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b6259-42d7-49fe-8d0f-38155ee93717 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.592176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.593100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.594843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.595230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.595995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.599289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.618760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aab47-b52a-47db-a455-06d77689e3ac None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.625601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.626809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.627265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.627700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/08b8934487e34287a878f8f9f2420cf1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.635109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2154/4293] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/projects => generated 7619 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:51.636647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.650757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=08b8934487e34287a878f8f9f2420cf1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.651296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8fddb-086c-481b-8917-e2717751276d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.654259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.656909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.657688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.658072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.658443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.659354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:51.660064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.662611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.676587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2155/4294] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:51.677673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.690077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4177e-9889-450a-87b2-fa416694fae5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.697556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.698517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.698890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.699294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] PATH_INFO: `/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590/users/4ca7355ecdbc4c2d9ec1c836434f5893/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.702812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbbe08c209948969b6ac2e8e1f0d590, user_id=4ca7355ecdbc4c2d9ec1c836434f5893, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.706539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.747649 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2156/4295] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:51 2022] PUT /identity/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590/users/4ca7355ecdbc4c2d9ec1c836434f5893/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:51.749410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.774715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:51.817529 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2140/4296] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:51 2022] DELETE /identity/v3/groups/08b8934487e34287a878f8f9f2420cf1 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:51.818976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:51.873990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d994-918e-46a7-923a-58ef7b0613af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.949059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855ace-4fee-48a5-9a5d-f289b59a0ccd tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:51.954857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.955540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:51.955853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.956152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.956409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.956979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.957105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.957585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.958151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:51.959036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:51.959176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.960175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:51.962351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88c428-fe70-4cd0-8094-a4e2e2cbfab8 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:51.992977 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2157/4297] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Nov 2 12:46:51 2022] GET /identity/v3/projects?domain_id=default => generated 7288 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:51.995155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:51.995450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:51.995729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.037907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] MFA Rules not processed for user `4ca7355ecdbc4c2d9ec1c836434f5893`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:52.039136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:52.084358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2141/4298] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:51 2022] POST /identity/v3/projects => generated 373 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:52.086005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.174876 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2158/4299] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:52.175917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.204988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f329e-9ec3-4e2b-8e63-bcdd1d54de10 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.365408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a315f-9f15-4176-aac9-887d91f1ace0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.387441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.407788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.407788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.407788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.413588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.419139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.442054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.446054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.446054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.446054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.448656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.457153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.487538 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2159/4300] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:46:52 2022] GET /identity/v3/projects => generated 7980 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:52.489538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.580481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2142/4301] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:52 2022] POST /identity/v3/users => generated 321 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:52.581969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.682742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb6398-e327-45d8-9428-984a8d91ecd2 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.697891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.701512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.701512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.701512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.702399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.708032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.759547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6acee-88ec-43d7-95d6-3016d2d3e30f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.767618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.768632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.769598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.769598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.770134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.772577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.884725 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2160/4302] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:52 2022] POST /identity/v3/users => generated 287 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:52.885519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.898717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b8cb-cde0-4bb2-966d-66e824be218a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:52.903990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:52.905080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:52.905080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:52.905391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:52.906188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:52.906560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:52.909183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:52.929722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2143/4303] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:46:52 2022] POST /identity/v3/domains => generated 276 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:52.931167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.963048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2161/4304] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Nov 2 12:46:52 2022] GET /identity/v3/projects?domain_id=default => generated 7649 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:52.969034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:52.995322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db3136-e874-4507-bfbe-4312eef0e36e tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.042155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c423fb-323a-4ae2-9289-8cbadad3564e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.054543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.057998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.059330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.061321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.062342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.068863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.122494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.123203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.123553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.123896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.126434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.129663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.158186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2162/4305] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:53.161521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.205502 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2144/4306] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:52 2022] POST /identity/v3/groups => generated 325 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:53.205502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.241109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:53.333838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef18b8e-db86-4145-b53d-3c29d2ab87b0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.347098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.348063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.348592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.349301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.351839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.356084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bc78b-912c-40ae-966c-41fc39e21230 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.356750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.364436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.365100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.365378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.370451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.370451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.370451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.419776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2145/4307] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:46:53 2022] GET /identity/v3/projects => generated 7980 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:53.420524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.441743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be39bf0-16c4-4fd4-9041-f1491a3bb15d tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.447056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.447841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.448120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.448393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.449136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.451707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.464405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2146/4308] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:46:53.465074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.496209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aafb52f-d84e-49c6-a34d-b11e6a1fdf29 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.501917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.502930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.503603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.504072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/a76754d83466451dbdfe82171cfec295/users/2f83ea9f068a4401bb6b6007eece3ff1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.530253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a76754d83466451dbdfe82171cfec295, user_id=2f83ea9f068a4401bb6b6007eece3ff1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.532580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.556972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2163/4309] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:53 2022] POST /identity/v3/projects => generated 403 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:53.558383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.660354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73184-3429-48e2-b5f7-9e25bfe0cd79 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.670081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.670770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.671055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.671383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.672066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1277174164) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:53.672425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.674935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.697949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2164/4310] 10.222.0.64 () {58 vars in 1232 bytes} [Wed Nov 2 12:46:53 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1277174164 => generated 537 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:53.699089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.713953 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2147/4311] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:46:53 2022] PUT /identity/v3/groups/a76754d83466451dbdfe82171cfec295/users/2f83ea9f068a4401bb6b6007eece3ff1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:53.713953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:53.731822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:53.830120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7059b-58b5-49f6-81ad-9512a0f24509 tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.878635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8427b-baff-4341-af66-1463394a798f tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:53.900891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.905558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.905970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.907772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:53.912299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:53.912299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:53.969815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:53.970834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:53.971442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:53.972101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] PATH_INFO: `/v3/projects/762ab703cd6b4d41ac9eddd7baa56c69/users/9d131de9b82a4c0692b6e33542361bda/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:54.004556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762ab703cd6b4d41ac9eddd7baa56c69, user_id=9d131de9b82a4c0692b6e33542361bda, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:54.009766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:54.056153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2148/4312] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:53 2022] POST /identity/v3/groups => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:54.056153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:54.203576 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2165/4313] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:46:53 2022] PUT /identity/v3/projects/762ab703cd6b4d41ac9eddd7baa56c69/users/9d131de9b82a4c0692b6e33542361bda/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:54.209113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:54.213595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576a2d-fe3d-4676-9c5a-4caa12b8fd92 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:54.378406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca11ebf-012a-421d-97c4-17d6cb285b18 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:54.396999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5654ad957e148168f369e582959273b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36afadfa4590450e8ea17f32f258f25d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:54.397901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:54.398705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:54.398969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] PATH_INFO: `/v3/projects/b3dc2a74debc4b499d62d8429b2f5bda` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:54.400599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b3dc2a74debc4b499d62d8429b2f5bda)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:54.402585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:54.414151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:54.417561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:54.417929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:54.418217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:54.418899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:54.420884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:54.566229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3dc2a74debc4b499d62d8429b2f5bda', 'request_id': 'req-bb2e07a6-9807-4564-ac0a-a92081d12acc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:54.573324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3dc2a74debc4b499d62d8429b2f5bda', 'request_id': 'req-bb2e07a6-9807-4564-ac0a-a92081d12acc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:54.597467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2166/4314] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:46:54 2022] POST /identity/v3/groups => generated 326 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:54.602486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:54.677611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3dc2a74debc4b499d62d8429b2f5bda', 'request_id': 'req-bb2e07a6-9807-4564-ac0a-a92081d12acc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:54.704938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] The token cache is being invalidate because project b3dc2a74debc4b499d62d8429b2f5bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:54.707115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:54.707647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb2e07a6-9807-4564-ac0a-a92081d12acc tempest-ListProjectsStaticTestJSON-948558224 tempest-ListProjectsStaticTestJSON-948558224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:54.710584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2149/4315] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:54 2022] DELETE /identity/v3/projects/b3dc2a74debc4b499d62d8429b2f5bda => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:54.716983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:54.717284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:54.717565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:54.763477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:54.767291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:54.783189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02483f6b-f17a-4295-be96-0eae55107e80 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:54.904672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:54.908117 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2150/4316] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:54.909207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:54.910103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:54.912022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:54.912357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:54.914305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:54.920397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:54.925175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.043213 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2167/4317] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:46:54 2022] POST /identity/v3/users => generated 439 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:55.044061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17733525-6c6a-4882-9bb6-fc9e29dc78c5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.047639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.051866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:55.057216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f3ccedd3204935a0fe16c7c2e28deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b96dfe51bf034e1c86187beade49c456', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.057857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.058140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.058415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.059137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:55.059454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.061151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.092051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2151/4318] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:55.092051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.096869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:55.134356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b22dd-3b7b-4896-8277-0c6708a13da4 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.139832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:55.145690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.146344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.146626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.149860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] PATH_INFO: `/v3/users/4a91cd4d0c59435ba2842f163d9b37f5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.150133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a91cd4d0c59435ba2842f163d9b37f5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.152123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.214237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4786fa8-ce9d-4e29-97df-6f9e3e6a9982 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.235885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.237129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.237623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.238090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/89de0377aa69447ba6080647be3ff291/users/2f83ea9f068a4401bb6b6007eece3ff1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.251104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=89de0377aa69447ba6080647be3ff291, user_id=2f83ea9f068a4401bb6b6007eece3ff1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.259013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.412048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2168/4319] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:46:55 2022] PUT /identity/v3/groups/89de0377aa69447ba6080647be3ff291/users/2f83ea9f068a4401bb6b6007eece3ff1 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:55.413725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.417444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:55.488160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a91cd4d0c59435ba2842f163d9b37f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:55.570555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da385-edbb-40ea-94b2-db4400c31d15 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.578836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a91cd4d0c59435ba2842f163d9b37f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:55.593446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.594094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.596523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.597391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.606889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a91cd4d0c59435ba2842f163d9b37f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:55.608710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a91cd4d0c59435ba2842f163d9b37f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:55.609756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a91cd4d0c59435ba2842f163d9b37f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:55.668102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2152/4320] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:55 2022] DELETE /identity/v3/users/4a91cd4d0c59435ba2842f163d9b37f5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:55.678731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.680988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:55.816392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.817671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fd034-b569-43af-b06e-eb8dd73c0a34 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.818487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.827814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:55.828442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:55.828776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:55.829052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:55.829785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:55.831341 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2169/4321] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:55.832519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.842392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:55.953273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eee34-ea85-4dd9-9472-a2b788780615 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:55.974403 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2153/4322] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:46:55 2022] POST /identity/v3/roles => generated 239 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:55.975808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:55.978481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:56.062262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f3ccedd3204935a0fe16c7c2e28deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b96dfe51bf034e1c86187beade49c456', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.062803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.063150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.063426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.064237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:56.075355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db6f3b-64f1-44da-91ed-ff51c2837408 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.081571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:56.085458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.086413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.088243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.088726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users/2f83ea9f068a4401bb6b6007eece3ff1/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.092630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=2f83ea9f068a4401bb6b6007eece3ff1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:56.096409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7d0de-e024-4883-b70a-6ba03bf3bcd2 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:56.134581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2154/4323] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:46:55 2022] GET /identity/v3/users/2f83ea9f068a4401bb6b6007eece3ff1/groups => generated 837 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:56.134581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.135323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.139076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.165917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:46:56.167260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:56.256406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2170/4324] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:46:55 2022] POST /identity/v3/projects => generated 348 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:46:56.258738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:56.320852 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2155/4325] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:46:56.322751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:56.332703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:56.352676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c7c9c-e698-410d-9c64-c4ad1f2650ec None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.427365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e367aea-2a88-47a5-8f68-a2a16e9b99fc tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.440553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.441943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.442616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.442964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.449440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:56.461975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=2af33189d30d4e55adcd8a475972acae)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:56.469458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:56.489407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.490315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.490802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.491225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/89de0377aa69447ba6080647be3ff291` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.492652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=89de0377aa69447ba6080647be3ff291)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:56.495466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:56.559458 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2171/4326] 10.222.0.64 () {60 vars in 1585 bytes} [Wed Nov 2 12:46:56 2022] PUT /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:56.561142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:56.569524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:56.706331 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2156/4327] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:56 2022] DELETE /identity/v3/groups/89de0377aa69447ba6080647be3ff291 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:56.707310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:56.712724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:56.722240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c22c2-3b75-43ce-9582-84eae1a9fd44 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.804726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f3ccedd3204935a0fe16c7c2e28deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b96dfe51bf034e1c86187beade49c456', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.805357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.805641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.805920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.806613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:46:56.806921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:56.813183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:56.825593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ba113-89d3-4f1e-9e35-8703eb47b990 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.839973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.839973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:56.839973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:56.839973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:56.841109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2172/4328] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:56.842714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:56.988191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d01e08-e880-4614-80fa-853b00a51735 tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:56.997409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:56.998155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.002339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.002480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.002598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.002598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.005834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:check_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=2af33189d30d4e55adcd8a475972acae)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.009148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.029668 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2173/4329] 10.222.0.64 () {58 vars in 1567 bytes} [Wed Nov 2 12:46:56 2022] HEAD /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:57.031488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.032361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2157/4330] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:57.033539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.046845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdefdf5b-1630-410e-9c56-826bff5263e8 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.051972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.053725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.054022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.054335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.057212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=2af33189d30d4e55adcd8a475972acae)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.060694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.069672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 2af33189d30d4e55adcd8a475972acae was removed from group 99434654a62b418fa0302c7dd567ac6e on project 77ba0b584b6c47278fe63059d0c5a5cd. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:57.069973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:57.070829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:57.140832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185cd17-676c-4e23-92ba-65845f25d722 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.148297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.149282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.149870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.150104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/groups/a76754d83466451dbdfe82171cfec295` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.152318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a76754d83466451dbdfe82171cfec295)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.156075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.277311 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2158/4331] 10.222.0.64 () {58 vars in 1569 bytes} [Wed Nov 2 12:46:57 2022] DELETE /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/groups/99434654a62b418fa0302c7dd567ac6e/roles/2af33189d30d4e55adcd8a475972acae/inherited_to_projects => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:57.281628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.283947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:57.374571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2174/4332] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:46:57 2022] DELETE /identity/v3/groups/a76754d83466451dbdfe82171cfec295 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:57.386703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.389161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:57.392548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e8568-af79-4603-a568-29d065cc0f19 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.496222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.496222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.496222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.497094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/2af33189d30d4e55adcd8a475972acae` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.499657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2af33189d30d4e55adcd8a475972acae)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.503080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.520292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ef9a5-f694-426b-80b7-ed73a324d0f3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.534013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.535740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.536127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.538321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/users/2f83ea9f068a4401bb6b6007eece3ff1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.540342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2f83ea9f068a4401bb6b6007eece3ff1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.543150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:57.706027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 2af33189d30d4e55adcd8a475972acae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:57.706542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:57.707290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:57.715693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2159/4333] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:57 2022] DELETE /identity/v3/roles/2af33189d30d4e55adcd8a475972acae => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:57.717673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:57.719320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:57.823959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f83ea9f068a4401bb6b6007eece3ff1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:57.829096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57684d83-03ab-4b7b-87d9-da29c3cacaab tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:57.842528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:57.843083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:57.843361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:57.843632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:57.844314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:57.847707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.008282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f83ea9f068a4401bb6b6007eece3ff1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.021440 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2160/4334] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:46:57 2022] POST /identity/v3/roles => generated 240 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:46:58.025821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:58.040189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f83ea9f068a4401bb6b6007eece3ff1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.052263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f83ea9f068a4401bb6b6007eece3ff1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.054084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f83ea9f068a4401bb6b6007eece3ff1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.066774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb1ad8-0eaf-411f-9956-e8450880cdd9 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:58.069759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2175/4335] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:57 2022] DELETE /identity/v3/users/2f83ea9f068a4401bb6b6007eece3ff1 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:58.070660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:58.080329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:58.186916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aec85-f55b-4e82-8b2a-614c9418c1d3 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:58.192014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4f3ccedd3204935a0fe16c7c2e28deb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b96dfe51bf034e1c86187beade49c456', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:58.193459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:58.193980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:58.194436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] PATH_INFO: `/v3/projects/a6339a995e6a4d4c9d15517b5e84d44e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:58.197637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6339a995e6a4d4c9d15517b5e84d44e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:58.200033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.217417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:58.218111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:58.218398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:58.218682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:58.250550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=5956bfde6294425694b9f4b83e38bcc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:58.253728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.399313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2161/4336] 10.222.0.64 () {60 vars in 1582 bytes} [Wed Nov 2 12:46:58 2022] PUT /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:58.400800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:58.403409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:58.416005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6339a995e6a4d4c9d15517b5e84d44e', 'request_id': 'req-36cd7f8d-913e-44f8-a982-ec37d946e5de'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.429682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6339a995e6a4d4c9d15517b5e84d44e', 'request_id': 'req-36cd7f8d-913e-44f8-a982-ec37d946e5de'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.440800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6339a995e6a4d4c9d15517b5e84d44e', 'request_id': 'req-36cd7f8d-913e-44f8-a982-ec37d946e5de'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.534131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd5b2e-a3fd-4a5c-9043-2d948e6bbc2d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:58.567818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] The token cache is being invalidate because project a6339a995e6a4d4c9d15517b5e84d44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:58.568377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.569281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.571195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2176/4337] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:58 2022] DELETE /identity/v3/projects/a6339a995e6a4d4c9d15517b5e84d44e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:58.572088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:58.582935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:58.640327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:58.641102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:58.641888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:58.642693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/domains/20ee44aad99e48dfb4d3d88180e74149` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:58.649232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=20ee44aad99e48dfb4d3d88180e74149)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:58.651083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.667418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7f8d-913e-44f8-a982-ec37d946e5de tempest-RoutersAdminTest-1233005842 tempest-RoutersAdminTest-1233005842-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:58.678903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:58.679863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:58.680146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:58.681647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] PATH_INFO: `/v3/projects/b103bb7c440443ae945c37163c6d3fc2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:58.683115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b103bb7c440443ae945c37163c6d3fc2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:58.685527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.686586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.687199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:58.725979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:58.799002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.801009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.822741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2162/4338] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:46:58 2022] PATCH /identity/v3/domains/20ee44aad99e48dfb4d3d88180e74149 => generated 275 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:46:58.824892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:58.829124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:58.843492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b103bb7c440443ae945c37163c6d3fc2', 'request_id': 'req-688e822b-9ba3-4f70-a091-93dad51b217c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.868441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b103bb7c440443ae945c37163c6d3fc2', 'request_id': 'req-688e822b-9ba3-4f70-a091-93dad51b217c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.877331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b103bb7c440443ae945c37163c6d3fc2', 'request_id': 'req-688e822b-9ba3-4f70-a091-93dad51b217c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:58.972811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859f4d3-c173-41aa-a9ab-1fb9f97779e7 tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:59.004994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] The token cache is being invalidate because project b103bb7c440443ae945c37163c6d3fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:59.005329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.008993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.014249 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2177/4339] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:58 2022] DELETE /identity/v3/projects/b103bb7c440443ae945c37163c6d3fc2 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:59.015316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:59.016782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:59.102298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:59.120981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:59.121679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:59.121969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:59.122246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:59.127665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:check_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=5956bfde6294425694b9f4b83e38bcc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:59.133963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:59.145319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2163/4340] 10.222.0.64 () {58 vars in 1564 bytes} [Wed Nov 2 12:46:58 2022] HEAD /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:59.146409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:59.148694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:59.157705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e822b-9ba3-4f70-a091-93dad51b217c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:59.170442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:59.174959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:59.174959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:59.174959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:59.178983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:59.262585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016789f-9112-4416-a9e1-e1562c24705e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:59.268467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6214be88770440b83020586a2e1ce87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae2358cc8c4f40caab1b4add5256632e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:59.269216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:59.269503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:59.269782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] PATH_INFO: `/v3/domains/20ee44aad99e48dfb4d3d88180e74149` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:59.286286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=20ee44aad99e48dfb4d3d88180e74149)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:59.287982 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:46:59.287982 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:46:59.287982 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:46:59.289003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:59.305442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:59.306956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:59.331397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.340052 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2178/4341] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:46:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:46:59.362018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:59.367164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.370196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:59.484954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ec7db-134b-450a-9dc0-f2cc5bd0a941 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:46:59.493412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:46:59.494267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:46:59.494618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:46:59.495248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] PATH_INFO: `/v3/users/b5654ad957e148168f369e582959273b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:46:59.496793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5654ad957e148168f369e582959273b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:46:59.499888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:46:59.630145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.649573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.822159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.840097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5654ad957e148168f369e582959273b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.860129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] The token cache is being invalidate because project 20ee44aad99e48dfb4d3d88180e74149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:46:59.860526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.861684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.884120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.895635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.896643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '20ee44aad99e48dfb4d3d88180e74149', 'request_id': 'req-328bbb42-e351-4c79-81b1-3030f43031dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.913704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2164/4342] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:46:59 2022] DELETE /identity/v3/domains/20ee44aad99e48dfb4d3d88180e74149 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:46:59.915126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:46:59.916647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:46:59.942168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5654ad957e148168f369e582959273b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:46:59.984274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5654ad957e148168f369e582959273b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.010833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5654ad957e148168f369e582959273b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.013077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5654ad957e148168f369e582959273b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.049489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2179/4343] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:46:59 2022] DELETE /identity/v3/users/b5654ad957e148168f369e582959273b => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:00.050658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:00.054829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:00.074723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bbb42-e351-4c79-81b1-3030f43031dc tempest-GroupsV3TestJSON-1881304800 tempest-GroupsV3TestJSON-1881304800-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:00.123215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:00.246553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:00.247254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.247567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.247848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.250399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=5956bfde6294425694b9f4b83e38bcc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:00.253170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:00.271401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 5956bfde6294425694b9f4b83e38bcc5 was removed from user fd1fcda554cf4965a997db503cb6d0dc on project 77ba0b584b6c47278fe63059d0c5a5cd. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:00.271732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.272737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.294478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d8523-41ba-46dc-9f7d-846356a55f1b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:00.317448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:00.317448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.317448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.319208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] PATH_INFO: `/v3/users/bbe56d3d716d445cb7182ff25e87714f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.324502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe56d3d716d445cb7182ff25e87714f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:00.326919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:00.368157 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2165/4344] 10.222.0.64 () {58 vars in 1566 bytes} [Wed Nov 2 12:46:59 2022] DELETE /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/5956bfde6294425694b9f4b83e38bcc5/inherited_to_projects => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:00.373066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:00.377154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:00.502416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1570b-3b60-4f27-b923-6a0b5836d47a tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:00.533922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:00.534601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:00.534890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:00.535187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/5956bfde6294425694b9f4b83e38bcc5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:00.537179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5956bfde6294425694b9f4b83e38bcc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:00.538583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:00.729221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe56d3d716d445cb7182ff25e87714f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.906450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe56d3d716d445cb7182ff25e87714f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.933697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 5956bfde6294425694b9f4b83e38bcc5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:00.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.940406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:00.954113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2166/4345] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:00 2022] DELETE /identity/v3/roles/5956bfde6294425694b9f4b83e38bcc5 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:00.963260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:00.968992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:00.989007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe56d3d716d445cb7182ff25e87714f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:01.023430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe56d3d716d445cb7182ff25e87714f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:01.026560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c282dc2-1bcd-4caf-98d0-2049e892db90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe56d3d716d445cb7182ff25e87714f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:01.045207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2180/4346] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:00 2022] DELETE /identity/v3/users/bbe56d3d716d445cb7182ff25e87714f => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:01.066997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:01.067458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:01.067912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:01.114865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:01.117580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:01.173277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984784c-b8fc-4d0f-9a47-21ffc7b18415 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:01.330026 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2181/4347] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:01.376371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:01.379264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:01.379967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:01.382719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:01.383322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:01.383864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:01.385578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:01.391436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:01.426776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:01.498385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2167/4348] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:00 2022] POST /identity/v3/roles => generated 240 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:01.505741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:01.508765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:01.536361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac95890-ed5f-4390-8955-5c952d0cce9b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:01.549217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:01.550081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:01.552162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:01.552530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:01.558418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b49733397df44882acc121123dc935ec, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=28f18d369d874e1595f92bd9f85d6c6b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:01.568402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:01.570952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14197f-ab75-4743-9a35-b80d164933c9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:01.576897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:01.577790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:01.578134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:01.578472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:01.593260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:01.595056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:01.612149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2182/4349] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:01.679007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:01.680453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:01.723829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14decd8e-5115-46eb-a989-b77613551889 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:01.736258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:01.738032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:01.738545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:01.739047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] PATH_INFO: `/v3/projects/36afadfa4590450e8ea17f32f258f25d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:01.741238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36afadfa4590450e8ea17f32f258f25d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:01.744749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:01.763784 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2168/4350] 10.222.0.64 () {60 vars in 1582 bytes} [Wed Nov 2 12:47:01 2022] PUT /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:01.763784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:01.892835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e11a6f-16fc-4ba1-a55c-1e6f4218b668 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:01.946355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36afadfa4590450e8ea17f32f258f25d', 'request_id': 'req-0f82265f-f431-4a3d-92da-9859561be918'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:01.995439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36afadfa4590450e8ea17f32f258f25d', 'request_id': 'req-0f82265f-f431-4a3d-92da-9859561be918'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.028593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36afadfa4590450e8ea17f32f258f25d', 'request_id': 'req-0f82265f-f431-4a3d-92da-9859561be918'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.076979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.077723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.078006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.079411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.083020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=b49733397df44882acc121123dc935ec, group_id=99434654a62b418fa0302c7dd567ac6e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.088790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.130174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2169/4351] 10.222.0.64 () {58 vars in 1464 bytes} [Wed Nov 2 12:47:01 2022] GET /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/inherited_to_projects => generated 448 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:02.131445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.175400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fb2d9-be1e-48bd-869f-a839dd56879c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.196820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.200903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.208372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] The token cache is being invalidate because project 36afadfa4590450e8ea17f32f258f25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:02.208372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.208372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f82265f-f431-4a3d-92da-9859561be918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.208372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2183/4352] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:01 2022] DELETE /identity/v3/projects/36afadfa4590450e8ea17f32f258f25d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:02.211387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.211387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.214788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df66e2-c8bd-46d3-bc56-7271bb9641b8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.215068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df66e2-c8bd-46d3-bc56-7271bb9641b8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.215364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df66e2-c8bd-46d3-bc56-7271bb9641b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.216295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=b49733397df44882acc121123dc935ec, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=28f18d369d874e1595f92bd9f85d6c6b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.230111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.239000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:02.245872 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2170/4353] 10.222.0.64 () {58 vars in 1564 bytes} [Wed Nov 2 12:47:02 2022] HEAD /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:02.258775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.276394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.313298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-92df66e2-c8bd-46d3-bc56-7271bb9641b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:02.315177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc66ca-db56-4170-8ca8-6a34ed571c30 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.317909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92df66e2-c8bd-46d3-bc56-7271bb9641b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.321910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.323989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.326557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.334856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.335520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b49733397df44882acc121123dc935ec, group_id=99434654a62b418fa0302c7dd567ac6e, role_id=28f18d369d874e1595f92bd9f85d6c6b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.339968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.347093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 28f18d369d874e1595f92bd9f85d6c6b was removed from group 99434654a62b418fa0302c7dd567ac6e on domain b49733397df44882acc121123dc935ec. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:02.347560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.348700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.463844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2171/4354] 10.222.0.64 () {58 vars in 1566 bytes} [Wed Nov 2 12:47:02 2022] DELETE /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/groups/99434654a62b418fa0302c7dd567ac6e/roles/28f18d369d874e1595f92bd9f85d6c6b/inherited_to_projects => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:02.467885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.470030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.491826 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2184/4355] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:02.495752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.496239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.496798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.567671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:02.570637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.624702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd6b6a-3df7-423c-aae1-05c35d1ebf52 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.640972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.641922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.642783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.642783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/28f18d369d874e1595f92bd9f85d6c6b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.645775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28f18d369d874e1595f92bd9f85d6c6b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.647725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.738086 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2185/4356] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:02.742285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.764169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99865b-df0b-4208-9a56-1feecc9f88f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.776069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.776069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.776630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.776630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.777268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:02.777572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.779212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.816502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 28f18d369d874e1595f92bd9f85d6c6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:02.818752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.819167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:02.823247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2172/4357] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:02 2022] DELETE /identity/v3/roles/28f18d369d874e1595f92bd9f85d6c6b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:02.824432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.829319 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2186/4358] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:02.830656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.833564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:02.841527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:02.889805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a82ad0-5b26-4cf7-90d5-0f2e7c1d64d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.979634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a1968-b0c4-4608-a5e2-05e369c9a672 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:02.981738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.982425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.982715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.983019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.983975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.985685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:02.986844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:02.988075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:02.988617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:02.989113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] PATH_INFO: `/v3/users/dbaf52c5888f42f19575e580751ef726` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:02.990573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbaf52c5888f42f19575e580751ef726)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:02.992704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:03.077911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2187/4359] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:02 2022] POST /identity/v3/roles => generated 240 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:03.079161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:03.081579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:03.119039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf12e09-eba2-44bf-b964-312878117588 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:03.132015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:03.132801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.133138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.133488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.134341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:03.136540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe504f3e-b2b9-48c3-bec8-d80bdadc6161 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:03.230178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbaf52c5888f42f19575e580751ef726'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.300022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2188/4360] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:03 2022] POST /identity/v3/projects => generated 371 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:03.302083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.302377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.302678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.359116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] MFA Rules not processed for user `a891741a9d294fa1b565c18b7c67c887`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:03.360698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:03.472367 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2189/4361] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:03.473870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:03.482805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbaf52c5888f42f19575e580751ef726'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.541098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbaf52c5888f42f19575e580751ef726'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.541098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbaf52c5888f42f19575e580751ef726'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.541098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbaf52c5888f42f19575e580751ef726'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.561582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2173/4362] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:02 2022] DELETE /identity/v3/users/dbaf52c5888f42f19575e580751ef726 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:03.562811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:03.564339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:03.642937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed446ea-da85-4da5-a97d-e11c69577509 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:03.655775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eac9e-2516-40c3-93a7-abe82f5326cc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:03.661916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:03.662483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.662752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.663017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] PATH_INFO: `/v3/projects/dfb573e521b54a43903005fde9cbf83c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.664304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb573e521b54a43903005fde9cbf83c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:03.666268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:03.734432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:03.734432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:03.734760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:03.734942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:03.738399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=28277cf21d4a43759bab4b3800389f1d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:03.743706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:03.861521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2190/4363] 10.222.0.64 () {60 vars in 1579 bytes} [Wed Nov 2 12:47:03 2022] PUT /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:03.862554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:03.866399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:03.880057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb573e521b54a43903005fde9cbf83c', 'request_id': 'req-7be3eab8-736c-43cb-a935-2a2637488fb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:03.905940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb573e521b54a43903005fde9cbf83c', 'request_id': 'req-7be3eab8-736c-43cb-a935-2a2637488fb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.028719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db68b9d-5671-49ed-b708-c3242d368282 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.032385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb573e521b54a43903005fde9cbf83c', 'request_id': 'req-7be3eab8-736c-43cb-a935-2a2637488fb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.057132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] The token cache is being invalidate because project dfb573e521b54a43903005fde9cbf83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:04.057562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.059173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.066679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2174/4364] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:03 2022] DELETE /identity/v3/projects/dfb573e521b54a43903005fde9cbf83c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:04.067696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.070537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.146084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:04.164164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.165041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.165371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.165645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.166528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.172869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79449aa5-4d8e-44d9-ad79-26913b387637 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.222060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eab8-736c-43cb-a935-2a2637488fb3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.237069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.240402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.240938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.241383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.252641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.336233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2191/4365] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:03 2022] POST /identity/v3/users => generated 286 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:04.336233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.336233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.336233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.409850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:04.423713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.424568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.428828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.462945 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2192/4366] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:04.464120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.465563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.470267 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2175/4367] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:04.473610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.478824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.533326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e91c6-5b8f-45dc-9533-6117390e9b8c service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.539390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.540671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.541198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.542300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] PATH_INFO: `/v3/users/a6214be88770440b83020586a2e1ce87` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.544837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6214be88770440b83020586a2e1ce87)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.547386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.582230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:04.652131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62826c-b25b-46b3-b32d-64e745f3ab27 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.663782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.664476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.664802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.667202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.671078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.675983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.719324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2193/4368] 10.222.0.64 () {58 vars in 1461 bytes} [Wed Nov 2 12:47:04 2022] GET /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/inherited_to_projects => generated 447 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:04.722623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.727674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.755938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39955574-6755-4da2-99bf-84c3b508fd77 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.763023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.764037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.764513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.764935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.765729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.767544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.786897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2194/4369] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:04 2022] GET /identity/v3/roles => generated 1651 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:04.788117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.790232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:04.841901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6214be88770440b83020586a2e1ce87'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.890140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03b32-81b1-44e8-86c7-aa7fe53bbe46 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:04.897386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:04.898500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:04.898500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:04.898715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:04.919322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:04.925523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:04.967105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2195/4370] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:04.968174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:04.980067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6214be88770440b83020586a2e1ce87'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:04.996425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0265d-413c-434a-84f5-5b73f44c62ce service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.011759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6214be88770440b83020586a2e1ce87'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:05.012726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.012726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.012726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.013040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.013679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6214be88770440b83020586a2e1ce87'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:05.016883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6214be88770440b83020586a2e1ce87'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:05.018834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=28277cf21d4a43759bab4b3800389f1d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:05.027747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:05.043426 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2196/4371] 10.222.0.64 () {58 vars in 1561 bytes} [Wed Nov 2 12:47:04 2022] HEAD /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:05.050183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:05.058001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:05.077808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2176/4372] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:04 2022] DELETE /identity/v3/users/a6214be88770440b83020586a2e1ce87 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:05.079177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:05.083362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:05.091082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3bb6c-28a2-4851-bed7-f74e1cf287d1 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.220166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.223785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.223785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.223785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.223785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:05.226633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:05.249171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd9a1f-d46d-4a33-b485-86437f6c146c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.257469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2197/4373] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:05 2022] GET /identity/v3/roles => generated 1651 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:05.261990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:05.263190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.263896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.264175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.264454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.266750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=28277cf21d4a43759bab4b3800389f1d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:05.269743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:05.278040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:05.281017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 28277cf21d4a43759bab4b3800389f1d was removed from user fd1fcda554cf4965a997db503cb6d0dc on domain b49733397df44882acc121123dc935ec. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:05.281017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:05.281017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:05.282004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b893-1c91-4396-92e5-fef16b8b067b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.288632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.289832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.290550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.291055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] PATH_INFO: `/v3/projects/0391739b78094b2b9d9f68fbfda9fa77/users/5e0ded6bd89648feba85a1932a5e9575/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.309687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0391739b78094b2b9d9f68fbfda9fa77, user_id=5e0ded6bd89648feba85a1932a5e9575, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:05.312902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6eb43-52cf-40a0-bc33-462beb4a3e56 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:05.437379 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2177/4374] 10.222.0.64 () {58 vars in 1563 bytes} [Wed Nov 2 12:47:05 2022] DELETE /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/28277cf21d4a43759bab4b3800389f1d/inherited_to_projects => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:05.439855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2198/4375] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:05 2022] PUT /identity/v3/projects/0391739b78094b2b9d9f68fbfda9fa77/users/5e0ded6bd89648feba85a1932a5e9575/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:05.450003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:05.450003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:05.453330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.453520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.453799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.526725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] MFA Rules not processed for user `5e0ded6bd89648feba85a1932a5e9575`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:05.530580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:05.595333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c00b6-2639-4ea6-b0d7-ee5aa0217c6b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.719877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2199/4376] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:05.733951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:05.735516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:05.758801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.761264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.761789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.762920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/28277cf21d4a43759bab4b3800389f1d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:05.768780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28277cf21d4a43759bab4b3800389f1d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:05.770522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:05.948178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bdf0f-4734-467f-9cc6-ed8ca44e9c4e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:05.958639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:05.961051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:05.961051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:05.961051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:06.006973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 28277cf21d4a43759bab4b3800389f1d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:06.006973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.006973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.007371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:06.007371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:06.011047 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2178/4377] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:05 2022] DELETE /identity/v3/roles/28277cf21d4a43759bab4b3800389f1d => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:06.028903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:06.030513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:06.042692 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2200/4378] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:06.173709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:06.175159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:06.229623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e5933-e9d0-4472-9dcc-3906f63e67b5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:06.246900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:06.247916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:06.248457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:06.248995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:06.249888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:06.258268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:06.313073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceca4bc-671a-40d2-b893-608844a84c76 service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:06.393478 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2179/4379] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:06 2022] POST /identity/v3/roles => generated 240 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:06.397647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:06.412150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268aac65-af0d-48cd-9985-057d71cd7fc5 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:06.418308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:06.419042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:06.419518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:06.420009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:06.420145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:06.420375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:06.420681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] PATH_INFO: `/v3/users/5e0ded6bd89648feba85a1932a5e9575` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:06.421206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:06.422168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:06.425982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0ded6bd89648feba85a1932a5e9575)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:06.426124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:06.426227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:06.595892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2180/4380] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:06 2022] POST /identity/v3/projects => generated 409 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:06.597187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:06.625948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:06.743016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f2b7c-cd01-435d-b753-cd2536102096 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:06.767132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:06.778152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:06.778442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:06.778725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/ecb871c3e7ba424ba6baf6b3aa8bc296/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:06.784946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0ded6bd89648feba85a1932a5e9575'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.788660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=ecb871c3e7ba424ba6baf6b3aa8bc296)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:06.800660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:06.899939 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2181/4381] 10.222.0.64 () {60 vars in 1579 bytes} [Wed Nov 2 12:47:06 2022] PUT /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/ecb871c3e7ba424ba6baf6b3aa8bc296/inherited_to_projects => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:06.900912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:06.905770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:06.922755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0ded6bd89648feba85a1932a5e9575'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.942292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0ded6bd89648feba85a1932a5e9575'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.968641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0ded6bd89648feba85a1932a5e9575'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.969979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0ded6bd89648feba85a1932a5e9575'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:06.992435 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2201/4382] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:06 2022] DELETE /identity/v3/users/5e0ded6bd89648feba85a1932a5e9575 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:06.994144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:07.001391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:07.114019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88f90e-f353-46cc-ac47-9727a5c59f59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:07.225712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:07.228132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.231774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.233106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5048-a33d-4a76-ab33-01e5659d2151 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:07.233490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] PATH_INFO: `/v3/projects/d143d12bb4b94c3b9da7baa4aaa435a5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.238823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d143d12bb4b94c3b9da7baa4aaa435a5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:07.243550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:07.246690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:07.247406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.251614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.251614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.251614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=77ba0b584b6c47278fe63059d0c5a5cd, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:07.251614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:07.252055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:07.344641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2202/4383] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:06 2022] GET /identity/v3/role_assignments?scope.project.id=77ba0b584b6c47278fe63059d0c5a5cd&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 648 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:07.346003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:07.348061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:07.365279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ded6d-fbaa-4d53-91f5-6fcc4e7f7c8d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:07.374879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:07.376136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.376518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.377409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] PATH_INFO: `/v3/projects/ae2358cc8c4f40caab1b4add5256632e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.378743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2358cc8c4f40caab1b4add5256632e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:07.382231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:07.474509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'request_id': 'req-fd51d702-f446-4142-a33a-9c0ccbcb79b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.483303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'request_id': 'req-fd51d702-f446-4142-a33a-9c0ccbcb79b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.539228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2358cc8c4f40caab1b4add5256632e', 'request_id': 'req-7cb97163-c951-45fb-bd10-a2c3aa356184'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.547144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2358cc8c4f40caab1b4add5256632e', 'request_id': 'req-7cb97163-c951-45fb-bd10-a2c3aa356184'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.556512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2358cc8c4f40caab1b4add5256632e', 'request_id': 'req-7cb97163-c951-45fb-bd10-a2c3aa356184'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.579636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'request_id': 'req-fd51d702-f446-4142-a33a-9c0ccbcb79b3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.591082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:07.595131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] The token cache is being invalidate because project d143d12bb4b94c3b9da7baa4aaa435a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:07.595537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.597091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd51d702-f446-4142-a33a-9c0ccbcb79b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.600688 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2182/4384] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:06 2022] DELETE /identity/v3/projects/d143d12bb4b94c3b9da7baa4aaa435a5 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:07.602751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e448c-cb84-484a-9117-b81326686f94 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.604307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e448c-cb84-484a-9117-b81326686f94 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.605355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e448c-cb84-484a-9117-b81326686f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.653242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-618e448c-cb84-484a-9117-b81326686f94 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:07.654523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-618e448c-cb84-484a-9117-b81326686f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:07.680071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] The token cache is being invalidate because project ae2358cc8c4f40caab1b4add5256632e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:07.680600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.681424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:07.683451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2203/4385] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:07 2022] DELETE /identity/v3/projects/ae2358cc8c4f40caab1b4add5256632e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:07.684393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:07.689904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:07.808672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2183/4386] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:07.812794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e448c-cb84-484a-9117-b81326686f94 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:07.812794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-618e448c-cb84-484a-9117-b81326686f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:07.834476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e448c-cb84-484a-9117-b81326686f94 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:07.839835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:07.840474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.840988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.841110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] PATH_INFO: `/v3/users/f113dfb7876f43c293443ba1bce61302` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.842675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f113dfb7876f43c293443ba1bce61302)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:07.846845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:07.902626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb97163-c951-45fb-bd10-a2c3aa356184 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:07.908765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:07.909492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:07.909776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:07.910052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:07.910877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=9666e0c99c054f60ad0cfeca2a357bbc, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:07.911188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:07.924625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210f5d8-f90f-4f8c-bd18-c893fef0ff2e tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:08.043859 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2204/4387] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:07 2022] GET /identity/v3/role_assignments?scope.project.id=9666e0c99c054f60ad0cfeca2a357bbc&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 648 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:08.045572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4742-7051-43a8-b8d0-f79b5a6108af None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.045855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4742-7051-43a8-b8d0-f79b5a6108af None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.046128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4742-7051-43a8-b8d0-f79b5a6108af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.079067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-276f4742-7051-43a8-b8d0-f79b5a6108af None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:08.081709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-276f4742-7051-43a8-b8d0-f79b5a6108af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.093235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2205/4388] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:08.097322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.097643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.098024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.137356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:08.139293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.153846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2206/4389] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:08.155289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.156906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.217149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f113dfb7876f43c293443ba1bce61302'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.280711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412028a5-7523-4ec1-8b2d-88ba9c9f9a44 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.285035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:08.285669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.285951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.286274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.296856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:08.298678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:08.336019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2207/4390] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:08.337276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.353608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46491bbc-f15e-4b0f-9a25-bdd8922196e3 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.360988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:08.362252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.362612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.362958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/ecb871c3e7ba424ba6baf6b3aa8bc296/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.367546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b49733397df44882acc121123dc935ec, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=ecb871c3e7ba424ba6baf6b3aa8bc296)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:08.372276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:08.381566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role ecb871c3e7ba424ba6baf6b3aa8bc296 was removed from user fd1fcda554cf4965a997db503cb6d0dc on domain b49733397df44882acc121123dc935ec. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:08.381965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.382969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d66bfbe7-488c-47bc-b11f-a229c7bf02ad tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.404937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f113dfb7876f43c293443ba1bce61302'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.429907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f113dfb7876f43c293443ba1bce61302'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.431980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f113dfb7876f43c293443ba1bce61302'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.433569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d3c66c53-3d86-4cf8-895d-6e397658d031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f113dfb7876f43c293443ba1bce61302'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:08.466272 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2184/4391] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:07 2022] DELETE /identity/v3/users/f113dfb7876f43c293443ba1bce61302 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:08.472255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.472255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.472255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.499497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:08.503356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.535901 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2208/4392] 10.222.0.64 () {58 vars in 1563 bytes} [Wed Nov 2 12:47:08 2022] DELETE /identity/v3/OS-INHERIT/domains/b49733397df44882acc121123dc935ec/users/fd1fcda554cf4965a997db503cb6d0dc/roles/ecb871c3e7ba424ba6baf6b3aa8bc296/inherited_to_projects => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:08.536608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.536954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.539234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.578624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:08.579954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.691175 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2185/4393] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:08.691175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.691883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:08.758547 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2209/4394] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:08.760242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.783889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd0f62-f1c2-4afb-b9f6-f84910161748 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.794004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:08.794735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.795085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.795793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.796878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:08.797263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:08.800530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:08.826037 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2210/4395] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:08.828849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.851460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04beb89-6f14-4793-ba7b-7e9793d3908b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.859575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca058f22-31fc-4a85-b700-76a7c9d3afe3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.870812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:08.872969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.873340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.873686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.874484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:08.874863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:08.877767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:08.908179 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2211/4396] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:08.909591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:08.928014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d392f-5dbc-4a10-a9fd-172affa6168b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:08.937981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:08.939952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:08.943088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:08.944141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:08.945284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:08.947823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.011856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.013069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.013534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.013960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.015185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=77ba0b584b6c47278fe63059d0c5a5cd, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:09.015673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.019542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.041526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2212/4397] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:08 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:09.043901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:09.047802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:09.146551 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2186/4398] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:08 2022] GET /identity/v3/role_assignments?scope.project.id=77ba0b584b6c47278fe63059d0c5a5cd&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 228 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:09.151465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:09.175261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6def5f-37de-4cb6-bc6d-67ecc0a9f8d2 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:09.175856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47469d0-57f8-4d5e-9ee3-7dae88d74e7e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:09.183900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.184745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.185211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.185489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.186413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.190623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.199840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.201593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.202869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.203503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.205156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.210685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.364901 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2187/4399] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:09 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:09.364901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:09.373339 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2213/4400] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:09 2022] POST /identity/v3/projects => generated 381 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:09.373339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:09.375097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:09.449827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:09.460436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5643d-3035-401d-9274-332573486b79 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:09.534564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436717a3-4042-481b-b0df-122ef5f1e2ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:09.546731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.547439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.547715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.551467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] PATH_INFO: `/v3/projects/0391739b78094b2b9d9f68fbfda9fa77` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.556152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0391739b78094b2b9d9f68fbfda9fa77)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.562914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.637141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.638168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.638168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.638168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.642334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=9666e0c99c054f60ad0cfeca2a357bbc, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:09.642334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.642334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:09.780275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0391739b78094b2b9d9f68fbfda9fa77', 'request_id': 'req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:09.795787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0391739b78094b2b9d9f68fbfda9fa77', 'request_id': 'req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:09.810358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0391739b78094b2b9d9f68fbfda9fa77', 'request_id': 'req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:09.827457 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2188/4401] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:09 2022] GET /identity/v3/role_assignments?scope.project.id=9666e0c99c054f60ad0cfeca2a357bbc&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 228 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:09.835534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:09.875330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2840e-81db-43db-a456-7bf165f96e31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:09.991285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:09.991905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:09.992180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:09.992445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:09.993121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:09.994732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.007791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2189/4402] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:09 2022] GET /identity/v3/roles => generated 1651 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:10.008727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.019885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28edbd70-2a11-4fcb-b15d-c3087f525b6f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.026609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.027387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.027685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.027954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.028634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.034779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.139350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] The token cache is being invalidate because project 0391739b78094b2b9d9f68fbfda9fa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:10.139597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.140923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.146329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2214/4403] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:09 2022] DELETE /identity/v3/projects/0391739b78094b2b9d9f68fbfda9fa77 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:10.146329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.146329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.163928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049ccb0-adfc-4dfb-a63f-f86bbb7fdcb1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.169458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.170123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.170406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.170682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] PATH_INFO: `/v3/projects/655e1bdbfb0c469daeec1ba8a61057d4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.172013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=655e1bdbfb0c469daeec1ba8a61057d4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.174033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.194528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2190/4404] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:10 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:10.195713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.199202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.398040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655e1bdbfb0c469daeec1ba8a61057d4', 'request_id': 'req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.398525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5aa1d-6de8-4ac3-8a9c-17638181c163 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.409669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655e1bdbfb0c469daeec1ba8a61057d4', 'request_id': 'req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.417847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655e1bdbfb0c469daeec1ba8a61057d4', 'request_id': 'req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.500182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] The token cache is being invalidate because project 655e1bdbfb0c469daeec1ba8a61057d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:10.500502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.501424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.503780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2215/4405] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:10 2022] DELETE /identity/v3/projects/655e1bdbfb0c469daeec1ba8a61057d4 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:10.504967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.509160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.552912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.553593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.553909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.554153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects/9666e0c99c054f60ad0cfeca2a357bbc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.555699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9666e0c99c054f60ad0cfeca2a357bbc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.558752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.663779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d0072-5b70-4a1e-af46-7ed4f76e7e4a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.679690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.682933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.683508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.683898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.686130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.688098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f912-372d-453b-9654-807a7bf86a37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.719536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2216/4406] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:10 2022] GET /identity/v3/roles => generated 1651 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:10.719536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.719536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.719536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.745264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:10.747952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.761126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9666e0c99c054f60ad0cfeca2a357bbc', 'request_id': 'req-d19b4074-8f61-4fb1-888c-207a14f47388'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.782638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9666e0c99c054f60ad0cfeca2a357bbc', 'request_id': 'req-d19b4074-8f61-4fb1-888c-207a14f47388'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.868558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2217/4407] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:10.873975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.873975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.894302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9666e0c99c054f60ad0cfeca2a357bbc', 'request_id': 'req-d19b4074-8f61-4fb1-888c-207a14f47388'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.897216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec018df-c1b2-47dd-8449-ca948d96bfb0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.902640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.904132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.904132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.904132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.905814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.907497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.910611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] The token cache is being invalidate because project 9666e0c99c054f60ad0cfeca2a357bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:10.911153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.912007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:10.914330 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2191/4408] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:10 2022] DELETE /identity/v3/projects/9666e0c99c054f60ad0cfeca2a357bbc => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:10.915386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.918830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.923864 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2218/4409] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:10 2022] GET /identity/v3/roles => generated 1651 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:10.929707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:10.932000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:10.940814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b4074-8f61-4fb1-888c-207a14f47388 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.947133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.947996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06694f8-5312-414b-8abe-0246fe4357fb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:10.948284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.948627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.948896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] PATH_INFO: `/v3/users/3e7652bfbb3b4fcea8d7f6bb127176f1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.950228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7652bfbb3b4fcea8d7f6bb127176f1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.955207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:10.965253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:10.969032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:10.969032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:10.969032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] PATH_INFO: `/v3/projects/724e20d4dc92442793890056ba718eda/users/f6d12ca5aa7b45dd8e7c1469040b3244/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:10.993298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724e20d4dc92442793890056ba718eda, user_id=f6d12ca5aa7b45dd8e7c1469040b3244, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:10.996786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcccca-e20c-4393-a0aa-98ae49436302 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:11.217987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2219/4410] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:10 2022] PUT /identity/v3/projects/724e20d4dc92442793890056ba718eda/users/f6d12ca5aa7b45dd8e7c1469040b3244/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:11.222874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:11.222874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:11.222874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:11.266460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:11.269335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.289033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7652bfbb3b4fcea8d7f6bb127176f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.321581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:11.389157 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2220/4411] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:11.390204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:11.393081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.442620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7652bfbb3b4fcea8d7f6bb127176f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.470439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7652bfbb3b4fcea8d7f6bb127176f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.474331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7652bfbb3b4fcea8d7f6bb127176f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.476954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7652bfbb3b4fcea8d7f6bb127176f1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.536939 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2192/4412] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:10 2022] DELETE /identity/v3/users/3e7652bfbb3b4fcea8d7f6bb127176f1 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:11.541706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:11.546569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.585115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d8f47-6434-4b22-980e-39d03208c6d4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:11.716890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:11.722895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:11.722895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:11.723247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d472857-ba42-4a0c-9c66-8e690e0efac6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:11.723347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/ecb871c3e7ba424ba6baf6b3aa8bc296` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:11.723347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ecb871c3e7ba424ba6baf6b3aa8bc296)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:11.723347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:11.734994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:11.735599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:11.735890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:11.736170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:11.737159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:11.738805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1241743b-d9ae-44f0-abc6-273421290e7b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:11.751513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:11.768418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2193/4413] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:11 2022] GET /identity/v3/roles => generated 1651 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:11.773268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:11.773590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:11.773831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:11.827779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] MFA Rules not processed for user `f6d12ca5aa7b45dd8e7c1469040b3244`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:11.829570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.877342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role ecb871c3e7ba424ba6baf6b3aa8bc296 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:11.877645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.878568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:11.882069 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2221/4414] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:11 2022] DELETE /identity/v3/roles/ecb871c3e7ba424ba6baf6b3aa8bc296 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:11.883170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:11.886859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.940126 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2194/4415] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:11.941121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:11.942522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:11.962259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9879b7-bf98-4a70-85bf-71111b6530bf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.011071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b729b8-ea91-4687-bfc3-5cf15551689b tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.026976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.027613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.029003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.029312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.031160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:12.031473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.034103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c4d02-6dd9-47a5-b16f-d70b46588c69 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.050949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.052627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.053477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.053978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] PATH_INFO: `/v3/projects/4009ddba06bf409ab4e6ba545587359f/users/ee9228d8ab1e4aea9ee4886023603e44/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.066986 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2222/4416] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:12.077970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872621-010c-4ee5-acbe-4384192c9dfb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.077970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872621-010c-4ee5-acbe-4384192c9dfb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.077970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872621-010c-4ee5-acbe-4384192c9dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.079409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4009ddba06bf409ab4e6ba545587359f, user_id=ee9228d8ab1e4aea9ee4886023603e44, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.082617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.129137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-94872621-010c-4ee5-acbe-4384192c9dfb None None] MFA Rules not processed for user `9d131de9b82a4c0692b6e33542361bda`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:12.131964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-94872621-010c-4ee5-acbe-4384192c9dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.245641 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2195/4417] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:11 2022] PUT /identity/v3/projects/4009ddba06bf409ab4e6ba545587359f/users/ee9228d8ab1e4aea9ee4886023603e44/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:12.246916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:12.248856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.282585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2223/4418] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:12.282585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.282585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.282585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.304420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] MFA Rules not processed for user `f6d12ca5aa7b45dd8e7c1469040b3244`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:12.305940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.385189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b1059-26a7-4b32-af26-6ba6bf8b87f9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.393134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.393759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.394038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.394341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.395130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.396851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9c954-5149-4d6a-9b74-398d4be4c9dd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.406424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2224/4419] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:12.406424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:12.489172 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2196/4420] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/roles => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:12.489172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.489172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.489172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.520417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ee5cf-8096-43a9-b644-a256128af138 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.539487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.542649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.542948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.544739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.545808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.549853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.553123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] MFA Rules not processed for user `ee9228d8ab1e4aea9ee4886023603e44`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:12.554648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.648663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2197/4421] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:12.652925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:12.655393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.674000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b172eb-05fc-4de9-adc9-5615d0aec7fe None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.681964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.682589 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2225/4422] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:12.683078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.683078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.683283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] PATH_INFO: `/v3/projects/5db19daadcca4fb7a4b682b68de52c61` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.683550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:12.684752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db19daadcca4fb7a4b682b68de52c61)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.685546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.687162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.806697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8da30a-54ef-47b1-a484-90b8b75819d3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:12.811698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:12.812653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:12.812993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:12.813256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:12.843973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db19daadcca4fb7a4b682b68de52c61', 'request_id': 'req-55a50325-89c2-4ad7-9f87-79a34021e754'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:12.853714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db19daadcca4fb7a4b682b68de52c61', 'request_id': 'req-55a50325-89c2-4ad7-9f87-79a34021e754'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:12.907681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:12.909633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:12.921995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2226/4423] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:12.933807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:12.940066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:12.973695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db19daadcca4fb7a4b682b68de52c61', 'request_id': 'req-55a50325-89c2-4ad7-9f87-79a34021e754'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:12.984866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:12.993080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] The token cache is being invalidate because project 5db19daadcca4fb7a4b682b68de52c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:12.993766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:12.995015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:12.997985 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2198/4424] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:12 2022] DELETE /identity/v3/projects/5db19daadcca4fb7a4b682b68de52c61 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:12.998610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:13.009804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:13.061749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738caec0-9a11-4f3c-a3a3-31ecf9837dee service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:13.120072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a50325-89c2-4ad7-9f87-79a34021e754 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:13.126082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:13.126720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:13.127118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:13.127815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:13.128464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:13.130993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:13.164501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:13.165150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:13.165803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:13.165803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:13.167643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:13.257037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:13.259608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:13.271239 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2227/4425] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:13.272050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:13.273447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:13.329293 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2199/4426] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:12 2022] POST /identity/v3/projects => generated 408 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:13.330467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:13.333233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:13.404890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f0e4-e10a-4db7-878c-abc4807cca6a service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:13.493786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1adb86-e0af-45ac-a8a2-aab188807cac tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:13.509744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:13.510537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:13.511070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:13.511350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:13.511999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:13.514046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129c7d9-d38a-4619-bb2a-753c523bf097 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:13.601402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:13.602096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:13.603142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:13.603418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:13.604145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:13.607287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:13.611868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:13.800520 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2200/4427] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:13 2022] POST /identity/v3/users => generated 293 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:13.802059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:13.802547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:13.806756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:13.850107 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2228/4428] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:13 2022] POST /identity/v3/projects => generated 379 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:13.851068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:13.891314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:13.899909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:14.002420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4dc794-445f-4c8d-ae37-00a72f93dbda admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.026924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.026924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.026924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.027207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/38369f35c9f84adfb4acb4dca997dc04/inherited_to_projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.035126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:create_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=38369f35c9f84adfb4acb4dca997dc04)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.039094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.134803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2201/4429] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:14.134803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.136777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2229/4430] 10.222.0.64 () {60 vars in 1582 bytes} [Wed Nov 2 12:47:13 2022] PUT /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/38369f35c9f84adfb4acb4dca997dc04/inherited_to_projects => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:14.152560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.152929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4516f51-1788-4226-a32f-f833428c2239 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.304081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.304723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.305000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.305267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.305916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.308156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b9e4-e5b9-4bc7-ba15-bfac3aaa76bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.330865 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2202/4431] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:14 2022] GET /identity/v3/roles => generated 1651 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:14.332198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.332475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.332765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.359858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f818214-7b73-447b-9bc5-29c5aa16e0eb tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.374503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.378388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.379277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.380001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.380691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.381826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:14.385773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.388265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:14.404206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2203/4432] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:14.405516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.501956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c7cd-f8cc-46d3-b583-17e1af847b7c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.509467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.518951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.518951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.518951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.518951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=0ef5c2d60b4f490caf2f957ce3a3918d, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:14.519380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.520535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.612121 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2230/4433] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:14 2022] POST /identity/v3/users => generated 290 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:14.613175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.627832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2204/4434] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:14 2022] GET /identity/v3/role_assignments?scope.project.id=0ef5c2d60b4f490caf2f957ce3a3918d&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 649 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:14.628887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.636348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b19c7-455b-48ce-b012-89f4e7ab4488 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.656772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.656772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.656772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.656772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.657113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.657113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.668112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1852f9-e083-433e-88b4-9379bde0b008 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.679675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.685396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.685396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.685396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.685396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:14.685396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.685923 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2231/4435] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:14 2022] GET /identity/v3/roles => generated 1651 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:14.686037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.686137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.719726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2205/4436] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:14.719726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.754320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37079-7714-4ed6-8e20-bd2274fa9eb4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.760138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70dbaf-fd92-4a8f-83f0-3ac436a886bd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.775087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.777471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.778713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.779152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.783408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.783741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.784692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.784692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.790684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.791379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/38369f35c9f84adfb4acb4dca997dc04/inherited_to_projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.801825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=77ba0b584b6c47278fe63059d0c5a5cd, user_id=fd1fcda554cf4965a997db503cb6d0dc, role_id=38369f35c9f84adfb4acb4dca997dc04)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.820356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.841482 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2232/4437] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:14 2022] GET /identity/v3/roles => generated 1651 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:14.843291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.855490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 38369f35c9f84adfb4acb4dca997dc04 was removed from user fd1fcda554cf4965a997db503cb6d0dc on project 77ba0b584b6c47278fe63059d0c5a5cd. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:14.855901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:14.857217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:14.873230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e71844-1ca4-40f2-bed8-a72c296a0103 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:14.890434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:14.891125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:14.891406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:14.892033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] PATH_INFO: `/v3/projects/66ebcccd66e349ba9e23ef9c9f2c81de/users/d9cbdf9211b44da88971e52eac872604/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:14.923686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ebcccd66e349ba9e23ef9c9f2c81de, user_id=d9cbdf9211b44da88971e52eac872604, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:14.926992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:14.989277 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2206/4438] 10.222.0.64 () {58 vars in 1566 bytes} [Wed Nov 2 12:47:14 2022] DELETE /identity/v3/OS-INHERIT/projects/77ba0b584b6c47278fe63059d0c5a5cd/users/fd1fcda554cf4965a997db503cb6d0dc/roles/38369f35c9f84adfb4acb4dca997dc04/inherited_to_projects => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:14.990399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:14.992669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:15.062163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2233/4439] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:14 2022] PUT /identity/v3/projects/66ebcccd66e349ba9e23ef9c9f2c81de/users/d9cbdf9211b44da88971e52eac872604/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:15.063686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.067725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:15.148870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fe76-055e-4405-bfca-3c476379bfb7 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:15.236900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37949315-b072-4823-bc86-7265bbe553a4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:15.244146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:15.245175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.245602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.245938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.246909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:15.249096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:15.267135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:15.267378 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2234/4440] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:15 2022] GET /identity/v3/roles => generated 1651 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:15.268163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.268681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.269153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.269674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.271098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:15.272003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:15.276480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ca4dd-01c7-47e9-b024-539c7ca34a59 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:15.434616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7365d-2650-42af-8d7d-702c5682152e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:15.444891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:15.445481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.445846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.447284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.450062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Adding query filter params (scope.project.id=0ef5c2d60b4f490caf2f957ce3a3918d, user.id=fd1fcda554cf4965a997db503cb6d0dc) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:15.450391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:15.452976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:15.477978 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2207/4441] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:14 2022] POST /identity/v3/projects => generated 377 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:15.478986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.479279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.482401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.564230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] MFA Rules not processed for user `d9cbdf9211b44da88971e52eac872604`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:15.566402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:15.598084 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2235/4442] 10.222.0.64 () {58 vars in 1356 bytes} [Wed Nov 2 12:47:15 2022] GET /identity/v3/role_assignments?scope.project.id=0ef5c2d60b4f490caf2f957ce3a3918d&user.id=fd1fcda554cf4965a997db503cb6d0dc&effective => generated 228 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:15.606289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.651166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72856b44-9e30-4640-a2a5-4e64637ce158 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:15.694011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2208/4443] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:15.695420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.795157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065bb860-0770-40f4-ba8a-539984329da5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:15.801689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:15.802379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.802725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.803537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.804185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:15.806525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:15.809456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:15.810372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:15.812183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:15.812183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] PATH_INFO: `/v3/projects/97a78ec1b89d4fcd8241d5a7c6132405/users/31ed6ef92cb848148d63927d0549591c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:15.841007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a78ec1b89d4fcd8241d5a7c6132405, user_id=31ed6ef92cb848148d63927d0549591c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:15.844851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:15.904189 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2209/4444] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:15 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:15.905527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.969664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2236/4445] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:15 2022] PUT /identity/v3/projects/97a78ec1b89d4fcd8241d5a7c6132405/users/31ed6ef92cb848148d63927d0549591c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:15.981132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:15.987476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:16.045277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e9f4a-b1f8-49c0-8ce9-466493388d39 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:16.153103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:16.154727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.156753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.159389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects/0ef5c2d60b4f490caf2f957ce3a3918d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.161714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ef5c2d60b4f490caf2f957ce3a3918d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:16.167900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:16.183215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd605bfe-b384-44de-bfc7-769c32cf3f80 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:16.199552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:16.200528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.200896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.201174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.201828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:16.204786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:16.405586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2237/4446] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:15 2022] POST /identity/v3/projects => generated 385 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:16.406802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:16.466777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef5c2d60b4f490caf2f957ce3a3918d', 'request_id': 'req-6714d0d2-94f9-445a-bc16-c97689b71286'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:16.478166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef5c2d60b4f490caf2f957ce3a3918d', 'request_id': 'req-6714d0d2-94f9-445a-bc16-c97689b71286'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:16.559332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef5c2d60b4f490caf2f957ce3a3918d', 'request_id': 'req-6714d0d2-94f9-445a-bc16-c97689b71286'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:16.578814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] The token cache is being invalidate because project 0ef5c2d60b4f490caf2f957ce3a3918d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:16.579770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:16.580793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6714d0d2-94f9-445a-bc16-c97689b71286 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:16.583229 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2210/4447] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:15 2022] DELETE /identity/v3/projects/0ef5c2d60b4f490caf2f957ce3a3918d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:16.585779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.586838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.587329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.615852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ce421-8908-4123-b5da-05c2c16286d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:16.635631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:16.650734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:16.653368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.653368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.653368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.653368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:16.663502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] MFA Rules not processed for user `31ed6ef92cb848148d63927d0549591c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:16.669726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:16.672731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:16.721765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2238/4448] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:16 2022] GET /identity/v3/roles => generated 1651 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:16.723564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:16.730887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:16.781936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e4e4b-2973-4fd5-b897-81240dd6ecc6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:16.792043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:16.794233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.794233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.794233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.816678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:16.828525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:16.853492 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2211/4449] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:16.854515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:16.857459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:16.947731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddea35-2fa6-4fed-9017-7de70c985b3a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:16.957547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:16.958218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:16.958505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:16.958782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/roles/38369f35c9f84adfb4acb4dca997dc04` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:16.961967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_role(role_id=38369f35c9f84adfb4acb4dca997dc04)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:16.963328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:17.003048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:17.009218 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2239/4450] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:16 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:17.010427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.014936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:17.040794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f019eb-0dda-41b2-bdac-37564f026672 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.049686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:17.050479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:17.050816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:17.051096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:17.051815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:17.054214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:17.072062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2240/4451] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:17 2022] GET /identity/v3/roles => generated 1651 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:17.072978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.076270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:17.192672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invalidating the token cache because role 38369f35c9f84adfb4acb4dca997dc04 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:17.193845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:17.195581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:17.202969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2212/4452] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:16 2022] DELETE /identity/v3/roles/38369f35c9f84adfb4acb4dca997dc04 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:17.205652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.209432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:17.236630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3118-198d-44a5-b4d9-25e3bc5943c8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.464804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b1d74-c644-48ce-9dd4-5cabf27e6e7d tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.470129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:17.477763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee9228d8ab1e4aea9ee4886023603e44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4009ddba06bf409ab4e6ba545587359f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:17.478444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:17.478742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:17.479011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] PATH_INFO: `/v3/users/ee9228d8ab1e4aea9ee4886023603e44/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:17.479836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:17.480180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:17.480667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:17.481361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:17.482222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] RBAC: Authorizing `identity:list_user_projects(user_id=ee9228d8ab1e4aea9ee4886023603e44)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:17.484102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:17.484877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:17.513088 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2213/4453] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:17.516894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.529221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:17.608128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da38f3-f991-43c8-bd62-6f86716d2633 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.613193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:17.613874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:17.614200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:17.614483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] PATH_INFO: `/v3/projects/6a0d6178bceb4821a849a10833c56365/users/60865b371ff044b79a4db130399b639f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:17.676512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0d6178bceb4821a849a10833c56365, user_id=60865b371ff044b79a4db130399b639f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:17.679345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:17.706556 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2241/4454] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:47:17 2022] GET /identity/v3/users/ee9228d8ab1e4aea9ee4886023603e44/projects => generated 517 bytes in 631 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:17.706556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.719879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:17.804750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2214/4455] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:17 2022] PUT /identity/v3/projects/6a0d6178bceb4821a849a10833c56365/users/60865b371ff044b79a4db130399b639f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:17.809398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:17.867774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbe122-6777-44cb-a89a-76a7feb9f67d tempest-IdentityV3ProjectsTest-1872615402 tempest-IdentityV3ProjectsTest-1872615402-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.982594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ff9e-7245-4124-907e-cc9352488db7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:17.992041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:17.993448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:17.993898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:17.995835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] PATH_INFO: `/v3/projects/e3ea3722f0cb46d489a41786d1e081b4/users/8cf068d1840d48c8b50a9fa1f3575dd5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.017413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea3722f0cb46d489a41786d1e081b4, user_id=8cf068d1840d48c8b50a9fa1f3575dd5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:18.020894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd366-c89f-4a24-b812-e780e5cb5751 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:18.034245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:18.034245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.034923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.034923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/users/fd1fcda554cf4965a997db503cb6d0dc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.050681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_user(user_id=fd1fcda554cf4965a997db503cb6d0dc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:18.053774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:18.141098 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2215/4456] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:17 2022] PUT /identity/v3/projects/e3ea3722f0cb46d489a41786d1e081b4/users/8cf068d1840d48c8b50a9fa1f3575dd5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:18.142486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be89f64-9070-4bdd-8c4f-85c1b49499cc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.144139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be89f64-9070-4bdd-8c4f-85c1b49499cc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.144139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be89f64-9070-4bdd-8c4f-85c1b49499cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.208355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1fcda554cf4965a997db503cb6d0dc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:18.261023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6be89f64-9070-4bdd-8c4f-85c1b49499cc None None] MFA Rules not processed for user `ee9228d8ab1e4aea9ee4886023603e44`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:18.262262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6be89f64-9070-4bdd-8c4f-85c1b49499cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.384088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1fcda554cf4965a997db503cb6d0dc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:18.410699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1fcda554cf4965a997db503cb6d0dc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:18.438966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1fcda554cf4965a997db503cb6d0dc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:18.439849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1fcda554cf4965a997db503cb6d0dc'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:18.453791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2216/4457] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:18.456565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9b7d-2636-4379-a5e8-1afa93934035 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.461918 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2242/4458] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:17 2022] DELETE /identity/v3/users/fd1fcda554cf4965a997db503cb6d0dc => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:18.464932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:18.467403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9b7d-2636-4379-a5e8-1afa93934035 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.468681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9b7d-2636-4379-a5e8-1afa93934035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.469868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.529233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e3d9b7d-2636-4379-a5e8-1afa93934035 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:18.531606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e3d9b7d-2636-4379-a5e8-1afa93934035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.648476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833123a8-9510-4392-989f-eb7aa5636613 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:18.658981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:18.659624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.659903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.660175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.661662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:18.665853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:18.674879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2217/4459] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:18.676208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.676316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.676594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.694347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2243/4460] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:18.694347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:18.702001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.726843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] MFA Rules not processed for user `ee9228d8ab1e4aea9ee4886023603e44`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:18.728128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.905894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.models.token_model [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] User ee9228d8ab1e4aea9ee4886023603e44 has no access to project 97a78ec1b89d4fcd8241d5a7c6132405 {{(pid=82132) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Nov 02 12:47:18.913023 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.application [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:47:18.927969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2218/4461] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:18 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 253 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 02 12:47:18.940793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:18.942139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:18.954573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387b119-7e76-4cb1-ac87-b150aa1e5503 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:18.985518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:18.986274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:18.987397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:18.989301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/groups/99434654a62b418fa0302c7dd567ac6e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:18.997283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_group(group_id=99434654a62b418fa0302c7dd567ac6e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:19.003479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05888e7a-2ba6-4878-aaa6-adb6f6287b59 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:19.067141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:19.160662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639d431-dde5-484c-9eca-9f4cdcacb68d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:19.167491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:19.173068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:19.173068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:19.173068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:19.196030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:19.197548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:19.225810 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2219/4462] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:19.227591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:19.253816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82512b8-2f31-4d5b-988d-89c3fb4b6a14 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:19.270207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2244/4463] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:47:18 2022] DELETE /identity/v3/groups/99434654a62b418fa0302c7dd567ac6e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:19.272520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:19.273221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:19.273504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:19.273778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] PATH_INFO: `/v3/projects/e3ea3722f0cb46d489a41786d1e081b4/users/8cf068d1840d48c8b50a9fa1f3575dd5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:19.274517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:19.274859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:19.275172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:19.284099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea3722f0cb46d489a41786d1e081b4, user_id=8cf068d1840d48c8b50a9fa1f3575dd5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:19.287006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:19.332137 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2220/4464] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:19 2022] PUT /identity/v3/projects/e3ea3722f0cb46d489a41786d1e081b4/users/8cf068d1840d48c8b50a9fa1f3575dd5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:19.342613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:19.344897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:19.362999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] MFA Rules not processed for user `9d131de9b82a4c0692b6e33542361bda`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:19.363923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:19.605849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2245/4465] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:19.605849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:19.641054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577663b-c5a3-49e7-a9c1-66877404a177 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:19.654493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:19.656573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:19.656859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:19.657136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] PATH_INFO: `/v3/users/ee9228d8ab1e4aea9ee4886023603e44` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:19.664649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9228d8ab1e4aea9ee4886023603e44)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:19.670083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:19.671225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:19.889906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590eed-d4b7-4982-a3e0-f2c163aaf5ca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:19.902206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:19.902964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:19.903318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:19.903631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/projects/77ba0b584b6c47278fe63059d0c5a5cd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:19.906215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_project(project_id=77ba0b584b6c47278fe63059d0c5a5cd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:19.908256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:20.045351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9228d8ab1e4aea9ee4886023603e44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.108314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77ba0b584b6c47278fe63059d0c5a5cd', 'request_id': 'req-bfd674e8-9d55-4772-838a-f6b21b2c320c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.133010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77ba0b584b6c47278fe63059d0c5a5cd', 'request_id': 'req-bfd674e8-9d55-4772-838a-f6b21b2c320c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.159077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77ba0b584b6c47278fe63059d0c5a5cd', 'request_id': 'req-bfd674e8-9d55-4772-838a-f6b21b2c320c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.163165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9228d8ab1e4aea9ee4886023603e44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.185831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9228d8ab1e4aea9ee4886023603e44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.188617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9228d8ab1e4aea9ee4886023603e44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.189936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-05b73563-3566-431b-8cc4-b20b6f93be0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9228d8ab1e4aea9ee4886023603e44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.236556 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2221/4466] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:19 2022] DELETE /identity/v3/users/ee9228d8ab1e4aea9ee4886023603e44 => generated 0 bytes in 897 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:20.236556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f534b-df55-4579-b3da-ac99d8639d47 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.237522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f534b-df55-4579-b3da-ac99d8639d47 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.244635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f534b-df55-4579-b3da-ac99d8639d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.297205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fa7f534b-df55-4579-b3da-ac99d8639d47 None None] MFA Rules not processed for user `8cf068d1840d48c8b50a9fa1f3575dd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:20.298047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa7f534b-df55-4579-b3da-ac99d8639d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.302135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] The token cache is being invalidate because project 77ba0b584b6c47278fe63059d0c5a5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:20.302616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.303883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.306551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2246/4467] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:19 2022] DELETE /identity/v3/projects/77ba0b584b6c47278fe63059d0c5a5cd => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:20.308369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:20.310384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.445216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd674e8-9d55-4772-838a-f6b21b2c320c tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:20.500154 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2222/4468] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:20.511026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853a29-78d9-4cbe-8867-4441fb51d53c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.511366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853a29-78d9-4cbe-8867-4441fb51d53c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.511651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af853a29-78d9-4cbe-8867-4441fb51d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.584621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-af853a29-78d9-4cbe-8867-4441fb51d53c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:20.585892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-af853a29-78d9-4cbe-8867-4441fb51d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.669373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:20.674036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.674036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.674036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.674991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.686702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:20.689323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:20.701357 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2247/4469] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:20.708171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:20.708171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.737753 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2223/4470] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:20.739109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.739389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.739661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:20.764008 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:20.765196 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:47:20.766139 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2224/4471] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:47:20 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:47:20.767082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:20.769052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.817212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43fa15-2320-4cc6-822c-7d8534a00469 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:20.817212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:20.817212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.817212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.823032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.826784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dd893-7ca6-4ad6-a237-23ca836dc5cf service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:20.834334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:20.853004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:20.855093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:20.855093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:20.855867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/domains/b49733397df44882acc121123dc935ec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:20.859251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b49733397df44882acc121123dc935ec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:20.861006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:20.917689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.919774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:20.962386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:20.963879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:20.998996 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2225/4472] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:21.000360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:21.020370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ff2-f926-4ee8-9f97-f45dee8b62f2 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:21.094579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.095755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.103898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2248/4473] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:47:20 2022] PATCH /identity/v3/domains/b49733397df44882acc121123dc935ec => generated 277 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:21.107857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:21.110453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:21.114939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:21.127015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:21.127341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:21.127607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:21.143293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:21.362819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ffbed-1ee2-4895-81b2-b7b11efb50bd tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:21.376268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ca7355ecdbc4c2d9ec1c836434f5893', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bbbe08c209948969b6ac2e8e1f0d590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:21.376964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:21.377251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:21.377584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] PATH_INFO: `/v3/domains/b49733397df44882acc121123dc935ec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:21.385272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:21.387402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:21.419091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b49733397df44882acc121123dc935ec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:21.425567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:21.465929 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2226/4474] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:21.536098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.563736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b49733397df44882acc121123dc935ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.603242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:21.825457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.841062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.858409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.960519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] The token cache is being invalidate because project b49733397df44882acc121123dc935ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:21.960519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.960519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.981750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.987226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:21.988125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cc6ea78-d592-4f66-bde9-98720eeb7c31 tempest-InheritsV3TestJSON-1545744686 tempest-InheritsV3TestJSON-1545744686-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b49733397df44882acc121123dc935ec', 'request_id': 'req-2cc6ea78-d592-4f66-bde9-98720eeb7c31'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.001158 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2249/4475] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:47:21 2022] DELETE /identity/v3/domains/b49733397df44882acc121123dc935ec => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:22.006055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:22.007187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:22.032793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c5574-dc0c-4a75-9465-78e646e8f3e7 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:22.117610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:22.148685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:22.149483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:22.149873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:22.150375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] PATH_INFO: `/v3/users/b38eb2c459b147bb93d28abb3d11f5fa` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:22.152914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38eb2c459b147bb93d28abb3d11f5fa)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:22.156171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:22.418607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38eb2c459b147bb93d28abb3d11f5fa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.580330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38eb2c459b147bb93d28abb3d11f5fa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.609123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38eb2c459b147bb93d28abb3d11f5fa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.610824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38eb2c459b147bb93d28abb3d11f5fa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.625124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38eb2c459b147bb93d28abb3d11f5fa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:22.654842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:22.655321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:22.655416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:22.671474 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2227/4476] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:22 2022] DELETE /identity/v3/users/b38eb2c459b147bb93d28abb3d11f5fa => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:22.710457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:22.715919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:22.726800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:22.728572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:22.921894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7b151-d81a-4669-8543-e2a14f087963 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:22.931470 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2250/4477] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:22.939199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:22.939847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:22.940132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:22.940410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:22.946041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:22.946462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:22.972045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fc03c-2cb4-4a06-8b14-57428ddec4a4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:22.985049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:22.985887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:22.986266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:22.986635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:23.000381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:23.003171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:23.020259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2251/4478] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:23.198962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:23.202046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:23.228104 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2228/4479] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:23.500908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:23.500908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:23.539497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e7c33-5a42-4fab-8270-a3a775a0bb44 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:23.545772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:23.546935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:23.547752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:23.548371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] PATH_INFO: `/v3/projects/4009ddba06bf409ab4e6ba545587359f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:23.551000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4009ddba06bf409ab4e6ba545587359f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:23.563753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:23.908981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4009ddba06bf409ab4e6ba545587359f', 'request_id': 'req-e592e85d-b5a3-4820-a0c2-a3cde75592fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:23.937296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4009ddba06bf409ab4e6ba545587359f', 'request_id': 'req-e592e85d-b5a3-4820-a0c2-a3cde75592fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:23.976540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4009ddba06bf409ab4e6ba545587359f', 'request_id': 'req-e592e85d-b5a3-4820-a0c2-a3cde75592fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.176517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] The token cache is being invalidate because project 4009ddba06bf409ab4e6ba545587359f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:24.179033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.180466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.195448 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2252/4480] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:23 2022] DELETE /identity/v3/projects/4009ddba06bf409ab4e6ba545587359f => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:24.199104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:24.235087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ae19-6a3b-4684-b4ae-86d8b4e81c44 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:24.417693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:24.420507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:24.420804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:24.421153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] PATH_INFO: `/v3/users/31ed6ef92cb848148d63927d0549591c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:24.425193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ed6ef92cb848148d63927d0549591c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:24.429836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:24.612195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:24.613685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:24.671594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592e85d-b5a3-4820-a0c2-a3cde75592fb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:24.688005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:24.688693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:24.688970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:24.689249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] PATH_INFO: `/v3/projects/64bc74b60c984c3390bb4f31447da199` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:24.692086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bc74b60c984c3390bb4f31447da199)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:24.695213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:24.770707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ed6ef92cb848148d63927d0549591c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.861567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ed6ef92cb848148d63927d0549591c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.878192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bc74b60c984c3390bb4f31447da199', 'request_id': 'req-161f6913-13fe-4e93-ba19-55a85d8c95ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.901236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ed6ef92cb848148d63927d0549591c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.907782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bc74b60c984c3390bb4f31447da199', 'request_id': 'req-161f6913-13fe-4e93-ba19-55a85d8c95ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.912151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ed6ef92cb848148d63927d0549591c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.915017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ed6ef92cb848148d63927d0549591c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.931143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bc74b60c984c3390bb4f31447da199', 'request_id': 'req-161f6913-13fe-4e93-ba19-55a85d8c95ee'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:24.955597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2229/4481] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:24 2022] DELETE /identity/v3/users/31ed6ef92cb848148d63927d0549591c => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:24.979313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:25.097700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] The token cache is being invalidate because project 64bc74b60c984c3390bb4f31447da199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:25.098633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.101920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.111101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:25.111906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2253/4482] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:24 2022] DELETE /identity/v3/projects/64bc74b60c984c3390bb4f31447da199 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:25.112808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:25.323981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc419ad-05d6-441e-84b8-4642aa0fe093 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:25.346921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:25.348334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:25.348889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:25.351760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] PATH_INFO: `/v3/users/4ca7355ecdbc4c2d9ec1c836434f5893` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:25.354931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca7355ecdbc4c2d9ec1c836434f5893)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:25.360860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:25.585183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:25.735422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca7355ecdbc4c2d9ec1c836434f5893'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.853593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca7355ecdbc4c2d9ec1c836434f5893'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.913074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca7355ecdbc4c2d9ec1c836434f5893'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.916464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca7355ecdbc4c2d9ec1c836434f5893'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.918082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca7355ecdbc4c2d9ec1c836434f5893'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:25.947321 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2230/4483] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:25 2022] DELETE /identity/v3/users/4ca7355ecdbc4c2d9ec1c836434f5893 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:27.011228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:27.014239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:27.015685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:27.185164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f6913-13fe-4e93-ba19-55a85d8c95ee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:27.370343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:27.371309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:27.374302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:27.376304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] PATH_INFO: `/v3/projects/97a78ec1b89d4fcd8241d5a7c6132405` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:27.378557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a78ec1b89d4fcd8241d5a7c6132405)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:27.382868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:27.692560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a78ec1b89d4fcd8241d5a7c6132405', 'request_id': 'req-3370ca8f-2531-494e-bc7e-08638e7a7ad0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:27.711179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a78ec1b89d4fcd8241d5a7c6132405', 'request_id': 'req-3370ca8f-2531-494e-bc7e-08638e7a7ad0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:27.740298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a78ec1b89d4fcd8241d5a7c6132405', 'request_id': 'req-3370ca8f-2531-494e-bc7e-08638e7a7ad0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:27.767541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:27.769780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:27.789093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:27.867210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] The token cache is being invalidate because project 97a78ec1b89d4fcd8241d5a7c6132405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:27.867434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:27.871686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3370ca8f-2531-494e-bc7e-08638e7a7ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:27.873760 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2254/4484] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:27 2022] DELETE /identity/v3/projects/97a78ec1b89d4fcd8241d5a7c6132405 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:27.879689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913a38-47bb-4841-86ad-1f73edbf066e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:27.879961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913a38-47bb-4841-86ad-1f73edbf066e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:27.880235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e913a38-47bb-4841-86ad-1f73edbf066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:27.920434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1e913a38-47bb-4841-86ad-1f73edbf066e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:27.924882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1e913a38-47bb-4841-86ad-1f73edbf066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:27.970971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46751c-0f26-4773-9fe2-b0d754b1bcc0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:28.138053 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2255/4485] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:28.151104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:28.152876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:28.153617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:28.153988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:28.154355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:28.156402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:28.157862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:28.163276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:28.213323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:28.223086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:28.236435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:28.244627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:28.262098 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2231/4486] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:28.288577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2256/4487] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:28.290101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:28.317203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5359c1-b929-47d1-88bf-701ddf41814f service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:28.330309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:28.331443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:28.332038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:28.335062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:28.336416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:28.337322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:28.339593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:28.394962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2232/4488] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:28.400120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:28.426395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71ca35-95c4-4f10-b2a3-1decc09ca094 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:28.445713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:28.446420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:28.446704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:28.446971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:28.447613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:28.449585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:28.809458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:28.811530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:28.835316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5803980-6755-42d5-8ebc-2e0659a079ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:28.840965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:28.841889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:28.842230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:28.842674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] PATH_INFO: `/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:28.843838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbbe08c209948969b6ac2e8e1f0d590)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:28.845801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.298826 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2257/4489] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:28 2022] POST /identity/v3/projects => generated 361 bytes in 899 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:29.302455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.449025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c136f58-9804-4eed-8db4-1ae66fd1a485 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.482271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbbe08c209948969b6ac2e8e1f0d590', 'request_id': 'req-33e0a154-e48f-42c5-8fd5-d5050963d25a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:29.489600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbbe08c209948969b6ac2e8e1f0d590', 'request_id': 'req-33e0a154-e48f-42c5-8fd5-d5050963d25a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:29.612119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.612774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.613054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.613476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.614122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.616627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.619332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbbe08c209948969b6ac2e8e1f0d590', 'request_id': 'req-33e0a154-e48f-42c5-8fd5-d5050963d25a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:29.646146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] The token cache is being invalidate because project 8bbbe08c209948969b6ac2e8e1f0d590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:29.646584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:29.647264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33e0a154-e48f-42c5-8fd5-d5050963d25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:29.651913 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2233/4490] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:28 2022] DELETE /identity/v3/projects/8bbbe08c209948969b6ac2e8e1f0d590 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:29.653988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d8eb-0d54-4672-bf09-54ed6c005e8b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.657060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d8eb-0d54-4672-bf09-54ed6c005e8b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.657060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d8eb-0d54-4672-bf09-54ed6c005e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.682679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0ba1d8eb-0d54-4672-bf09-54ed6c005e8b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:29.683906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ba1d8eb-0d54-4672-bf09-54ed6c005e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:29.695309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2234/4491] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:29.703220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.703540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.703814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.772905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:29.775532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:29.794817 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2235/4492] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:29.803963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.828466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e56ecc-caf3-45f0-b927-f6d5e8c48638 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.830620 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2258/4493] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:29 2022] POST /identity/v3/users => generated 281 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:29.834558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.835454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.836314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.836588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:29.836793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.837134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.837860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:29.838386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.846563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.851866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0521c52-1aba-4b19-a3e2-4710c050e66d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.858469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.859506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.860005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.860619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.862322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.864949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.869182 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2236/4494] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:29.874858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.894667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196adc63-13ba-4948-a187-7ff3a2687bb2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.895258 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2259/4495] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:29.897234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.901630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.902535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.902934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.903672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.904429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.907210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.910703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20f965-0a1f-4e23-9daa-8db4fb97462e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.918153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.919105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.919545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.919983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.920951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.922825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:29.942037 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2260/4496] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:29.954581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:29.955295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e5e15-4348-48b3-9967-d1ebea36ebee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:29.962260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:29.963220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:29.963668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:29.964084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] PATH_INFO: `/v3/projects/7e6102ebf8174903bc1b53bb4e16d2b3/users/890f83cde4f942d3907e865fb1ae7c21/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:29.988184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6102ebf8174903bc1b53bb4e16d2b3, user_id=890f83cde4f942d3907e865fb1ae7c21, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:29.994361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa555a-255a-4d08-9f83-357f003a0be9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.047680 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2237/4497] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:29 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:30.053038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.126430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2261/4498] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:29 2022] PUT /identity/v3/projects/7e6102ebf8174903bc1b53bb4e16d2b3/users/890f83cde4f942d3907e865fb1ae7c21/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:30.139031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b90f-66fe-4866-aa1b-960d6c2ca290 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.139597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b90f-66fe-4866-aa1b-960d6c2ca290 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.142114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830b90f-66fe-4866-aa1b-960d6c2ca290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.179409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c3be6-fa9c-404e-966b-d7e4c3006424 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.222025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d830b90f-66fe-4866-aa1b-960d6c2ca290 None None] MFA Rules not processed for user `890f83cde4f942d3907e865fb1ae7c21`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:30.223410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d830b90f-66fe-4866-aa1b-960d6c2ca290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:30.294511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.295498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.296514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.297363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.298471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.305373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.357871 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2262/4499] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:30.366886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058240a2-c155-4825-a234-2cdf25b5d75f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.366886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058240a2-c155-4825-a234-2cdf25b5d75f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.366886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058240a2-c155-4825-a234-2cdf25b5d75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.386985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-058240a2-c155-4825-a234-2cdf25b5d75f None None] MFA Rules not processed for user `890f83cde4f942d3907e865fb1ae7c21`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:30.388316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-058240a2-c155-4825-a234-2cdf25b5d75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:30.393654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2263/4500] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:47:30.399268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.399646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.400037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.436776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] MFA Rules not processed for user `890f83cde4f942d3907e865fb1ae7c21`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:30.438849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:30.446221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2264/4501] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:30 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:47:30.451183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.453804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:30.461850 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2238/4502] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:30 2022] POST /identity/v3/users => generated 285 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:30.465728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.487601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8213e-e2bc-48db-9a86-024e69830f58 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.488727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77586e5-2bbd-4051-8239-3fa740e6bfcf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.493947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.495117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.495502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.495873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.496768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.496891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.497452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.497729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.498005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.498877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.513258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2239/4503] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:30.518254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorizing `identity:check_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.519921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.523147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.535671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ee181-255e-4231-ab07-c7d6618f40f9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.542717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2265/4504] 10.222.0.64 () {56 vars in 1264 bytes} [Wed Nov 2 12:47:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Nov 02 12:47:30.542911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.542911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.542911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.543246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.544547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.544702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.546153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.560555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df534-0b25-4210-a6eb-97f7091fe06c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.562239 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2240/4505] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:30.567769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.570115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.570752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.571034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.571308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.591635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.595029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.609225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411179-e50b-4ece-bf59-8bdc7d14044f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.634465 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2266/4506] 10.222.0.64 () {56 vars in 1263 bytes} [Wed Nov 2 12:47:30 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Nov 02 12:47:30.635513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.637547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.638230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.638502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.638770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] PATH_INFO: `/v3/projects/5aeacb61670f43b28ff86d95081db6f5/users/87f20d1aad19462683da27f99956d01f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.665492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c30ef-9bbc-4a0a-bac4-571e4b354633 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.677105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:30.678617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.678960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.680467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:30.691532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.693679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.696334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5aeacb61670f43b28ff86d95081db6f5, user_id=87f20d1aad19462683da27f99956d01f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:30.699519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479516-391b-4b80-9983-4fb3186835a4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:30.786534 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2267/4507] 10.222.0.64 () {56 vars in 1266 bytes} [Wed Nov 2 12:47:30 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:30.791288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:30.829749 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2241/4508] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:30 2022] PUT /identity/v3/projects/5aeacb61670f43b28ff86d95081db6f5/users/87f20d1aad19462683da27f99956d01f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:30.834209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f29121-569e-47f5-b899-72b65b9403f4 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:30.944837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:30.945145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:30.945422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.009680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.010062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.010339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.010611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.012648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:31.019890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] MFA Rules not processed for user `87f20d1aad19462683da27f99956d01f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:31.021281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2a5ab486-eaf9-4fb9-b24b-e4e45aa3fcdd tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Nov 02 12:47:31.053915 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.check_revocation(token) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Nov 02 12:47:31.055058 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:47:31.056974 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2268/4509] 10.222.0.64 () {56 vars in 1264 bytes} [Wed Nov 2 12:47:30 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:47:31.060914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.061195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.061471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.093913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] MFA Rules not processed for user `890f83cde4f942d3907e865fb1ae7c21`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:31.095095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:31.111413 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2269/4510] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:31 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:47:31.115666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.135494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcb107-685f-400a-ada7-3e57cd613e1d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.146476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.147008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.147281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.147549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.154380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.156478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.162807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2242/4511] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:31.167808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.180357 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2270/4512] 10.222.0.64 () {56 vars in 1263 bytes} [Wed Nov 2 12:47:31 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:47:31.185676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.197187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a6d0-9f3b-4e0f-b9b0-0c11f72ac30d tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.212706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.213328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.213605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.213874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.229166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.231170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.343023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f779d9-c792-4d35-83e3-19c125aa5b20 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.356660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.359720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.359720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.360533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.363164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.368059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.454004 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2271/4513] 10.222.0.64 () {56 vars in 1266 bytes} [Wed Nov 2 12:47:31 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:31.457975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.471946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145263e8-44bb-46c1-9e80-5e2842ef7b9c tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.487703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '890f83cde4f942d3907e865fb1ae7c21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7e6102ebf8174903bc1b53bb4e16d2b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.488332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.488633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.488900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.498195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Nov 02 12:47:31.516077 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.check_revocation(token) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Nov 02 12:47:31.523434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:47:31.524474 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:47:31.524888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2243/4514] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:31 2022] POST /identity/v3/projects => generated 369 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:31.527520 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2272/4515] 10.222.0.64 () {56 vars in 1263 bytes} [Wed Nov 2 12:47:31 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:47:31.529305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.529775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.558294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee67811-b9e3-4288-a28b-eb4229807740 tempest-TokensV3Test-2074244498 tempest-TokensV3Test-2074244498-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.681134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55a057-3189-4ea7-8ff1-61dcbc053d38 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.682575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.685454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.685739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.686018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] PATH_INFO: `/v3/users/890f83cde4f942d3907e865fb1ae7c21` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.688205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=890f83cde4f942d3907e865fb1ae7c21)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.689210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.690062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.690756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.691134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.691692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.694399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.696823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.833806 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2244/4516] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:31 2022] POST /identity/v3/users => generated 291 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:31.837905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.858934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465de71a-d027-4ef2-b87b-51fdffff2dc4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.876836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.878389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.878934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.879744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.881366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.895141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:31.929976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:31.934539 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2245/4517] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:31.935559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:31.949382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79b85a-cf46-47d0-8c20-016c99ee05d9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:31.961140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:31.963438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890f83cde4f942d3907e865fb1ae7c21'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:31.966697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:31.966842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:31.968834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] PATH_INFO: `/v3/projects/168d1221f6234f8e9b11eb3a21d64634/users/244306f238bb4008a49943d79c231e8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:31.980368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:31.992644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168d1221f6234f8e9b11eb3a21d64634, user_id=244306f238bb4008a49943d79c231e8d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:31.995594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:32.087831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890f83cde4f942d3907e865fb1ae7c21'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:32.107199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890f83cde4f942d3907e865fb1ae7c21'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:32.119606 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2246/4518] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:31 2022] PUT /identity/v3/projects/168d1221f6234f8e9b11eb3a21d64634/users/244306f238bb4008a49943d79c231e8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:32.123165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:32.139320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890f83cde4f942d3907e865fb1ae7c21'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:32.141176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c951e54-0dd9-41bc-b3e2-1dd0c07ca30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890f83cde4f942d3907e865fb1ae7c21'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:32.155382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2273/4519] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:31 2022] DELETE /identity/v3/users/890f83cde4f942d3907e865fb1ae7c21 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:32.163726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.164150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.164584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.191445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:32.193853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:32.229333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3371b-b384-4d33-893d-fa9987d45f19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:32.279838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2274/4520] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:32.342605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:32.345712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:32.349193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:32.360282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.361178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.361471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.367497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:32.372766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:32.410751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2247/4521] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:47:32.412975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:32.418215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:32.452205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f676a4-0469-4218-b98e-c81033de350d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:32.471480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:32.472173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.472453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.474700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] PATH_INFO: `/v3/projects/168d1221f6234f8e9b11eb3a21d64634/users/244306f238bb4008a49943d79c231e8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.489342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168d1221f6234f8e9b11eb3a21d64634, user_id=244306f238bb4008a49943d79c231e8d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:32.491949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882f12-f852-4929-9036-ea56c2ae70d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:32.504797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da203b-d22a-4fae-a39c-dc12feb388f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:32.515858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:32.516588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.520903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.522840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.524958 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2248/4522] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:32 2022] PUT /identity/v3/projects/168d1221f6234f8e9b11eb3a21d64634/users/244306f238bb4008a49943d79c231e8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:32.535546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.535977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.537101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.547821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:32.549580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:32.572954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2275/4523] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:32.599998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] MFA Rules not processed for user `244306f238bb4008a49943d79c231e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:32.612550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:32.772713 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2249/4524] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:32.777395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:32.868461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35549194-50f2-42b7-9681-0de90ec852bf service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:32.874987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:32.875914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:32.876289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:32.876794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:32.877963 n-d-857339-6 devstack@keystone.service[82131]: WARNING oslo_log.versionutils [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:32.878559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:32.880860 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:32.880860 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:47:32.880860 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:47:32.884370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.010048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2276/4525] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:32 2022] POST /identity/v3/policies => generated 229 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:33.014466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.028117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0083-6bd8-466c-9f90-bdd7f0b1ca87 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.034500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.045595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.045595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.045595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/266becd510564ada98cbf80866b41780` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.045595 n-d-857339-6 devstack@keystone.service[82132]: WARNING oslo_log.versionutils [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:33.045595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=266becd510564ada98cbf80866b41780)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.046577 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:33.046577 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:47:33.046577 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:47:33.046577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.251412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.252066 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2250/4526] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:47:33 2022] PATCH /identity/v3/policies/266becd510564ada98cbf80866b41780 => generated 236 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:33.266826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5dbfe-446c-41a7-9eb3-243537e26a8d tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.284930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.285754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.286021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.286403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/266becd510564ada98cbf80866b41780` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.287318 n-d-857339-6 devstack@keystone.service[82131]: WARNING oslo_log.versionutils [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:33.288803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=266becd510564ada98cbf80866b41780)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.290123 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:33.290123 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:47:33.290123 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:47:33.292063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.317750 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2277/4527] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:47:33 2022] GET /identity/v3/policies/266becd510564ada98cbf80866b41780 => generated 236 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:33.320252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.335440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f96cc3-c0f4-4139-80e2-b6285bbf30f8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.349017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.349933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.350443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.350881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/266becd510564ada98cbf80866b41780` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.351862 n-d-857339-6 devstack@keystone.service[82132]: WARNING oslo_log.versionutils [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:33.352560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=266becd510564ada98cbf80866b41780)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.356002 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:33.356002 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:47:33.356002 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:47:33.357286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.520394 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2251/4528] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:33 2022] DELETE /identity/v3/policies/266becd510564ada98cbf80866b41780 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:33.526973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.544441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78607aa5-4bbe-4aff-a8f5-311c745398a8 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.558748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.559772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.560258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.560683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.563575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.565571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.697942 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2278/4529] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:33 2022] POST /identity/v3/policies => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:33.702637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.724544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924af62-3a64-4349-9112-ff4850a1b0aa tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.734202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.734993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.735375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.735845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.738317 n-d-857339-6 devstack@keystone.service[82132]: WARNING oslo_log.versionutils [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:33.739262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.741328 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:33.741328 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:47:33.741328 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:47:33.760239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.898270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2252/4530] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:33 2022] POST /identity/v3/policies => generated 228 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:33.901670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:33.925252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16b1a7-c59b-4de3-bcd1-c109f8ad5c35 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:33.940093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:33.952883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:33.953650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:33.954060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:33.954443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:33.956208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:33.960751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:33.974078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:34.135702 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2279/4531] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:33 2022] POST /identity/v3/policies => generated 230 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:34.140305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.156976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fbf9a-0e3a-48b6-a19a-57b58f49c15c tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:34.168279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:34.169450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:34.171333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:34.171725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:34.172910 n-d-857339-6 devstack@keystone.service[82132]: WARNING oslo_log.versionutils [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:34.175248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:34.180604 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:34.180604 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:47:34.180604 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:47:34.182446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:34.201437 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2253/4532] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:47:34 2022] GET /identity/v3/policies => generated 763 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:47:34.205515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.221151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5682cc-4ac1-40d1-9258-5158aaf8772b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:34.235672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:34.236817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:34.237485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:34.238013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/fab648a93a314e6a8ee96cca510b2bc2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:34.239157 n-d-857339-6 devstack@keystone.service[82131]: WARNING oslo_log.versionutils [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Nov 02 12:47:34.240789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=fab648a93a314e6a8ee96cca510b2bc2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:34.242569 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:34.242569 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:47:34.242569 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:47:34.258439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:34.429405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2280/4533] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:34 2022] DELETE /identity/v3/policies/fab648a93a314e6a8ee96cca510b2bc2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:34.434204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.445112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312ca1-d39f-4e26-9dc3-3547652c7894 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:34.472002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:34.473267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:34.473873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:34.475211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/624b8b0733e64f28bc2729de63f6cb9a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:34.476938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=624b8b0733e64f28bc2729de63f6cb9a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:34.481973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:34.619260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2254/4534] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:34 2022] DELETE /identity/v3/policies/624b8b0733e64f28bc2729de63f6cb9a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:34.623388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.648327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cff3e-b269-4ab4-9a56-6f1b220efc2b tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:34.663915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '244306f238bb4008a49943d79c231e8d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '168d1221f6234f8e9b11eb3a21d64634', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:34.663915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:34.663915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:34.664245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] PATH_INFO: `/v3/policies/3f3fb4ff96144529b56db98fca67b124` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:34.665128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=3f3fb4ff96144529b56db98fca67b124)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:34.676522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:34.776709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.781687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:34.786339 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2281/4535] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:34 2022] DELETE /identity/v3/policies/3f3fb4ff96144529b56db98fca67b124 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:34.797829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:34.932444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8c328-8b49-44c2-b632-f7d52ab86d52 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:34.941588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:34.944060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:34.948026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:34.964168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] PATH_INFO: `/v3/users/87f20d1aad19462683da27f99956d01f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:34.966944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f20d1aad19462683da27f99956d01f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:34.971480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:35.035817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:35.056645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201a065-ec4b-4d1b-bcf2-3c55d2ec7b10 tempest-PoliciesTestJSON-1857643801 tempest-PoliciesTestJSON-1857643801-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:35.070158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:35.073466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:35.073466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:35.073466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] PATH_INFO: `/v3/projects/7e6102ebf8174903bc1b53bb4e16d2b3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:35.074300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6102ebf8174903bc1b53bb4e16d2b3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:35.076861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:35.294827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f20d1aad19462683da27f99956d01f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.307773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6102ebf8174903bc1b53bb4e16d2b3', 'request_id': 'req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.319802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6102ebf8174903bc1b53bb4e16d2b3', 'request_id': 'req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.450090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f20d1aad19462683da27f99956d01f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.530418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6102ebf8174903bc1b53bb4e16d2b3', 'request_id': 'req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.549975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f20d1aad19462683da27f99956d01f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.564553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] The token cache is being invalidate because project 7e6102ebf8174903bc1b53bb4e16d2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:35.569133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.571495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26bfe6dd-a7cf-49f6-8c8e-561c8843b415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.584765 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2255/4536] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:34 2022] DELETE /identity/v3/projects/7e6102ebf8174903bc1b53bb4e16d2b3 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:35.598834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62855e-d96b-42f8-a130-174722ac101b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:35.599180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62855e-d96b-42f8-a130-174722ac101b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:35.602204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62855e-d96b-42f8-a130-174722ac101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:35.603480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f20d1aad19462683da27f99956d01f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.606125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2cabf8d5-9f18-47dc-b382-aab793529d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f20d1aad19462683da27f99956d01f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:35.651652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2282/4537] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:34 2022] DELETE /identity/v3/users/87f20d1aad19462683da27f99956d01f => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:35.659205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47e54-d74c-46f0-8ec9-81a0be01506e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:35.661000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47e54-d74c-46f0-8ec9-81a0be01506e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:35.661297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d47e54-d74c-46f0-8ec9-81a0be01506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:35.725234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bf62855e-d96b-42f8-a130-174722ac101b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:35.734623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf62855e-d96b-42f8-a130-174722ac101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:35.783562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f8d47e54-d74c-46f0-8ec9-81a0be01506e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:35.807553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f8d47e54-d74c-46f0-8ec9-81a0be01506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:35.981138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:36.038450 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2256/4538] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:36.040914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.041324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.041441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.069994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2283/4539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:36.074058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.074283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.074612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.097574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] MFA Rules not processed for user `9d131de9b82a4c0692b6e33542361bda`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:36.105929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:36.113726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:36.115386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:36.153376 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2284/4540] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:36.153376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:36.156149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:36.257648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2257/4541] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:36.258765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:36.278750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9908d4-7e77-413a-a268-e7360bc2bf48 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:36.284672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:36.285561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.285994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.286423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.300999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:36.302852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:36.317501 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2285/4542] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:36.327672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f759283-44b1-414a-a939-a8ec84dfb0fa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:36.335944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:36.336717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.340359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.340765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.342562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:36.342562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:36.344017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:36.369230 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2258/4543] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:36.370433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:36.389452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eedf0-8d27-4db9-93df-268802af4902 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:36.407306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:36.408338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.409731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.410409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.411359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:36.414003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:36.663530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2286/4544] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:36 2022] POST /identity/v3/projects => generated 377 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:36.664270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:36.679394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17b5ac-714c-43c4-a56c-abd00a3faa7c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:36.828735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:36.829720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:36.830228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:36.831371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:36.832308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:36.834743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:37.024210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:37.031535 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2259/4545] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:36 2022] POST /identity/v3/users => generated 289 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:37.046523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a31992-5a66-4ff5-a06c-ad298c285095 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:37.076733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:37.077302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:37.077578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:37.077903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:37.078610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:37.080502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:37.110319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:37.120306 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2287/4546] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:37.124887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:37.144919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd382a-0f7c-4de7-81e0-a814bf917513 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:37.160078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:37.160733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:37.161008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:37.161275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:37.166142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:37.170402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21f881-4a92-4be0-82a6-e1e880d8519a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:37.214442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2260/4547] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:37.215680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:37.242520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e101849-c190-4724-90c9-a1045ac00dc9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:37.261075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:37.261075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:37.261075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:37.261075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] PATH_INFO: `/v3/projects/0457c093df8b4ab9a39aaa6c7ca84c2a/users/364b15525f65455abc55762bf588f567/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:37.313047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0457c093df8b4ab9a39aaa6c7ca84c2a, user_id=364b15525f65455abc55762bf588f567, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:37.325706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1a657-539b-47ef-9022-f99c9013ad04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:37.561792 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2288/4548] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:37 2022] PUT /identity/v3/projects/0457c093df8b4ab9a39aaa6c7ca84c2a/users/364b15525f65455abc55762bf588f567/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:37.574416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:37.575363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:37.575836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:37.596068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:37.596340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:37.596644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:37.611656 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:37.612553 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:47:37.624875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2289/4549] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:47:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:47:37.650254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] MFA Rules not processed for user `364b15525f65455abc55762bf588f567`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:37.651640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:37.870488 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2261/4550] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:37.875721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.147996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:38.147996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b57338-3b13-4c85-b5b4-d78da5b00beb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.166305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.167067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.167474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.167946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:38.174163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:38.186286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:38.452671 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2290/4551] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:37 2022] POST /identity/v3/projects => generated 377 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:38.456889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.479745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3420bdf-8c21-4216-ab2a-42b6d79dff33 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.628031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.628967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.629640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.630034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:38.631475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:38.634729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:38.828087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2262/4552] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:38 2022] POST /identity/v3/users => generated 289 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:38.840293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.855400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f393-bec7-4b02-b56b-c5da0e9f9eca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.868381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.869158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.869448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.869816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:38.870492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:38.872141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:38.886583 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2291/4553] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:47:38.890953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.901958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.904210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:38.906069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76313a3-236e-47d8-b5c4-bd729aac8039 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.914395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.915584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.915867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.916482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:38.918119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:38.919930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:38.924933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b90e81-d7ee-425f-932d-659bb4ef05e1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.931665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.932438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.932699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.933054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] PATH_INFO: `/v3/projects/5aeacb61670f43b28ff86d95081db6f5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:38.934479 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2263/4554] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:38.934822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5aeacb61670f43b28ff86d95081db6f5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:38.936936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:38.939166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:38.973235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d9e8-6c40-496e-b188-4f62c795550d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:38.994807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:38.996594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:38.996594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:38.996594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] PATH_INFO: `/v3/projects/64acbf6b65c04b7d9ef50ad3b9f05217/users/455f40ae97d44675a9fbda09f8abde9d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:39.008084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:39.087104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64acbf6b65c04b7d9ef50ad3b9f05217, user_id=455f40ae97d44675a9fbda09f8abde9d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:39.091783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0c110-bdf7-4016-8205-edb35a6f6f3f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:39.275774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2264/4555] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:38 2022] PUT /identity/v3/projects/64acbf6b65c04b7d9ef50ad3b9f05217/users/455f40ae97d44675a9fbda09f8abde9d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:39.279203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7af2-1057-4ada-a188-5d95b3de09a4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:39.279489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7af2-1057-4ada-a188-5d95b3de09a4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:39.279768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d7af2-1057-4ada-a188-5d95b3de09a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:39.292135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5aeacb61670f43b28ff86d95081db6f5', 'request_id': 'req-4042dad0-d3b3-4590-86f6-80d909bb2a66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:39.301473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5aeacb61670f43b28ff86d95081db6f5', 'request_id': 'req-4042dad0-d3b3-4590-86f6-80d909bb2a66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:39.312005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5aeacb61670f43b28ff86d95081db6f5', 'request_id': 'req-4042dad0-d3b3-4590-86f6-80d909bb2a66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:39.341360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-686d7af2-1057-4ada-a188-5d95b3de09a4 None None] MFA Rules not processed for user `60865b371ff044b79a4db130399b639f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:39.354268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-686d7af2-1057-4ada-a188-5d95b3de09a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:39.425160 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2265/4556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:39.426326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:39.426605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:39.426925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:39.454109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] The token cache is being invalidate because project 5aeacb61670f43b28ff86d95081db6f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:39.455242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:39.456927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:39.460623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2292/4557] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:38 2022] DELETE /identity/v3/projects/5aeacb61670f43b28ff86d95081db6f5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:39.461841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:39.465558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:39.494533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] MFA Rules not processed for user `455f40ae97d44675a9fbda09f8abde9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:39.495745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:39.676782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2266/4558] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:39.678977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:39.683588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:39.788420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042dad0-d3b3-4590-86f6-80d909bb2a66 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:39.818414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:39.819181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:39.819569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:39.820029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:39.820430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:39.826653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:39.863101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f1efb-1eeb-430f-a052-891b7cd2cff3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:39.871103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:39.874886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:39.875785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:39.876218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:39.876697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] PATH_INFO: `/v3/users/244306f238bb4008a49943d79c231e8d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:39.878419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244306f238bb4008a49943d79c231e8d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:39.880989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:39.893479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:39.937976 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2293/4559] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:39.946457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:39.949748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:40.167658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8bd24-9ed2-4351-8877-4eec1d9a3bce service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:40.176829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:40.178276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:40.181382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:40.181785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:40.184051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:40.239289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244306f238bb4008a49943d79c231e8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:40.346409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:40.353860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a815ab6-8b38-4e7e-b050-7421ac2f79dc service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:40.385794 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2294/4560] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:40.465601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244306f238bb4008a49943d79c231e8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:40.487732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244306f238bb4008a49943d79c231e8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:40.489115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244306f238bb4008a49943d79c231e8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:40.490160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244306f238bb4008a49943d79c231e8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:40.514887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2267/4561] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:39 2022] DELETE /identity/v3/users/244306f238bb4008a49943d79c231e8d => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:41.016097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:41.016609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:41.016714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:41.079497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:41.081168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:41.174136 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2295/4562] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:41.340303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:41.454568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:41.456166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:41.627915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b18a0-a44e-4a09-be79-b2b8ce7cefa3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:41.647886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:41.648950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:41.649667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:41.650157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:41.662960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:41.666109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e83293-1069-4f80-a79f-21b0c9dd5903 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:41.718997 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2268/4563] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:47:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:47:41.849978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:41.851492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:41.978243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa72c374-4ef4-4dc7-a947-2acab7984605 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:41.985191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:41.986204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:41.986641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:41.987217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] PATH_INFO: `/v3/projects/168d1221f6234f8e9b11eb3a21d64634` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:41.988785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168d1221f6234f8e9b11eb3a21d64634)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:41.992418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:42.183594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168d1221f6234f8e9b11eb3a21d64634', 'request_id': 'req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:42.193570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168d1221f6234f8e9b11eb3a21d64634', 'request_id': 'req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:42.200769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168d1221f6234f8e9b11eb3a21d64634', 'request_id': 'req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:42.340241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] The token cache is being invalidate because project 168d1221f6234f8e9b11eb3a21d64634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:42.340688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:42.341681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3bcf071b-9d7e-47d7-b662-cb7cf17081e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:42.343944 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2296/4564] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:41 2022] DELETE /identity/v3/projects/168d1221f6234f8e9b11eb3a21d64634 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:42.351188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:42.351785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:42.352393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:42.391297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:42.397204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:42.501461 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2269/4565] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:42.512982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:42.513476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:42.513894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:42.541241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:42.542848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:42.556321 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2297/4566] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:42.560988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:42.581612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1682-c4b0-4ba9-8381-c0ba5117989a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:42.587645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:42.589484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:42.589992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:42.590443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:42.591279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:42.593817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:42.599636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:42.630458 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2270/4567] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:47:42.631390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:42.643335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c5c7c-5316-4ff5-9018-7e8262a83829 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:42.653040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:42.653880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:42.654400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:42.666123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:42.666123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:42.666123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:42.777938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:42.784126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:42.898388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a868d-bcd6-4912-90e7-d0480b83917a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:42.904538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:42.905629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:42.906328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:42.906996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:42.909583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:42.920699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2298/4568] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:42 2022] POST /identity/v3/projects => generated 369 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:42.921977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:43.021728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68eac-97f3-40ac-bdda-3eeee481c930 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:43.027161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.027481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:43.028182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.028500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.028789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.029429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.030437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a4109-e020-4d8c-b73a-768ef7d4580d service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.031820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.042230 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2271/4569] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:47:43.111564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:43.161680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.162423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.162720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.202572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:43.204139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:43.250419 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2299/4570] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:42 2022] POST /identity/v3/users => generated 285 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:43.252215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:43.294814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96376bff-7ad3-48e1-8c09-9925fa2c7015 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:43.308607 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2272/4571] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:43.308828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:43.308828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.308828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.308828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.309226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.309226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.309393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:43.311056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:43.324205 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2300/4572] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:43.325154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:43.340572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25dd01-b1ec-4efb-bdbd-fa4156b6c150 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:43.348648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:43.349865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.350145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.350418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.351124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.354055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.374281 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2301/4573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:43.379621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:43.393805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e2ab-0634-43a4-9a57-19e885206dbf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:43.402082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:43.402997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.403520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.404755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] PATH_INFO: `/v3/projects/368d3b397ab64d12901bea2008cda339/users/5a5776cec80c42249b9dc7dd8ac18f33/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.421552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541c5b6-9b14-4a23-aab3-2e143171e14e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:43.430504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368d3b397ab64d12901bea2008cda339, user_id=5a5776cec80c42249b9dc7dd8ac18f33, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.433636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.434619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:43.435305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.435985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.435985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.449862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:43.451998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5228-a5de-4819-baaf-06e2e68438e5 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:43.467478 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2273/4574] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:47:43.794173 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2302/4575] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:43 2022] PUT /identity/v3/projects/368d3b397ab64d12901bea2008cda339/users/5a5776cec80c42249b9dc7dd8ac18f33/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:43.796035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:43.796999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:43.798683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:43.855494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] MFA Rules not processed for user `5a5776cec80c42249b9dc7dd8ac18f33`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:43.857489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:43.961597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2274/4576] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:43.966192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.048935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17daa4-ccbf-4edf-aca6-55809f977e10 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.054726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:44.055718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:44.056909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:44.057401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:44.058330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:44.060353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:44.269903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.271562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2303/4577] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:43 2022] POST /identity/v3/projects => generated 367 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:44.303829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70024-3d9d-467b-8bef-abb684f1fac5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.443865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:44.444636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:44.445904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:44.446683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:44.457761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:44.459838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:44.470662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.474051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:44.492925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc923a5e-4153-4ff4-a73b-5e687d8bffb9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.499240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:44.502684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:44.502684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:44.502684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] PATH_INFO: `/v3/users/364b15525f65455abc55762bf588f567` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:44.502684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=364b15525f65455abc55762bf588f567)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:44.506687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:44.611327 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2275/4578] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:44 2022] POST /identity/v3/users => generated 290 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:44.612804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.628298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378811db-64c8-4ff0-a1b3-4e8f53c7d162 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.636357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:44.637687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:44.637983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:44.638314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:44.639414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:44.642738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:44.662763 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2276/4579] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:44.663852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.680532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c31c06-f3f3-494b-a909-7de72acab2f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.688053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:44.689056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:44.690057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:44.690415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] PATH_INFO: `/v3/projects/06be197c461a4cfdac0f0d93b148a313/users/ab136ae93d774fc18a7fd8aa92671bab/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:44.713325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06be197c461a4cfdac0f0d93b148a313, user_id=ab136ae93d774fc18a7fd8aa92671bab, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:44.716880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:44.866902 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2277/4580] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:44 2022] PUT /identity/v3/projects/06be197c461a4cfdac0f0d93b148a313/users/ab136ae93d774fc18a7fd8aa92671bab/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:44.871665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:44.975016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364b15525f65455abc55762bf588f567'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:44.991002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f069d-3494-4bb2-b372-5c4b0be04ce1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:44.998965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.000309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.000840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.001278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.002184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.006036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:45.034878 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2278/4581] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:45.040403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:45.062656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ad0b-cce4-4cfb-953c-427063d5fbdb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:45.077285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.077437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364b15525f65455abc55762bf588f567'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:45.078033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.078319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.078756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] PATH_INFO: `/v3/projects/06be197c461a4cfdac0f0d93b148a313/users/ab136ae93d774fc18a7fd8aa92671bab/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.089679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06be197c461a4cfdac0f0d93b148a313, user_id=ab136ae93d774fc18a7fd8aa92671bab, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.095230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364b15525f65455abc55762bf588f567'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:45.097796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50b024-ea66-4e14-bade-100db1ff6a40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:45.105627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364b15525f65455abc55762bf588f567'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:45.106796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66aebf54-61be-474b-b9f6-830f12c0b8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364b15525f65455abc55762bf588f567'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:45.115975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2304/4582] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:44 2022] DELETE /identity/v3/users/364b15525f65455abc55762bf588f567 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:45.121106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.121747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.122600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.145670 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2279/4583] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:45 2022] PUT /identity/v3/projects/06be197c461a4cfdac0f0d93b148a313/users/ab136ae93d774fc18a7fd8aa92671bab/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:45.147881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.160921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.161380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.164671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:45.165937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:45.198968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] MFA Rules not processed for user `ab136ae93d774fc18a7fd8aa92671bab`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:45.200755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:45.295699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2305/4584] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:47:45.341199 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2280/4585] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:45.342296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:45.354235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a061d0d-79b0-43c8-87a6-22cb249c0e39 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:45.362283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:45.365039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:45.368681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.369428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.370366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.370646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.376844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.382996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:45.467259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a023a46-199b-4eba-bdfe-94105beb161a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:45.472435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.473283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.473568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.473840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.485732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.487465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:45.527122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2281/4586] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:45.591176 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2306/4587] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:45 2022] POST /identity/v3/projects => generated 329 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:45.598898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:45.639631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b078c0-8eed-46f8-b4f7-929e5e3e65ba service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:45.778229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.779139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.779591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.780714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.780916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.783246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:45.929517 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2282/4588] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:45 2022] POST /identity/v3/users => generated 416 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:45.933564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:45.945751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1422-a25e-4f97-be8f-1fb9e5850699 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:45.951594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:45.952341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:45.952657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:45.952941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:45.953636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:45.955249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.072320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2307/4589] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:45 2022] POST /identity/v3/roles => generated 244 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:46.076982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.087709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22bb61-3b99-4304-96c8-29e2803b96a9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:46.099446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:46.099446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:46.099446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:46.099929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:46.099929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:46.099929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.229871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:46.275163 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2283/4590] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:46 2022] POST /identity/v3/roles => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:46.281052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.297683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6549d3-91a1-41d6-a74d-692aa59fe58b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:46.313091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:46.314013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:46.314759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:46.315307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35/users/f77fa936dd7a4232b322a6c1f00ef634/roles/9474ab14a75142fcbbe053cd232a9c4b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:46.354658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5e31bc1ee8ff4f6d992a74149662bf35, user_id=f77fa936dd7a4232b322a6c1f00ef634, role_id=9474ab14a75142fcbbe053cd232a9c4b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:46.359754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.502017 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2308/4591] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:46 2022] PUT /identity/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35/users/f77fa936dd7a4232b322a6c1f00ef634/roles/9474ab14a75142fcbbe053cd232a9c4b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:46.507396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.520663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c803ac-d6f5-422f-b0df-9479ebf2baf3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:46.586210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:46.589827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:46.595288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:46.595288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:46.595288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35/users/f77fa936dd7a4232b322a6c1f00ef634/roles/034212adda104ca596f792d225c58132` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:46.595288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5e31bc1ee8ff4f6d992a74149662bf35, user_id=f77fa936dd7a4232b322a6c1f00ef634, role_id=034212adda104ca596f792d225c58132)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:46.597180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.662467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.666000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:46.732358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2284/4592] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:46 2022] PUT /identity/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35/users/f77fa936dd7a4232b322a6c1f00ef634/roles/034212adda104ca596f792d225c58132 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:46.734980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.823468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e139-8940-4b5b-a61f-4f20e710d7a2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:46.843850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba2c5-bbba-489c-b11a-86f142b52e25 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:46.848339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:46.850995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:46.852405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:46.852570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:46.854194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:46.858940 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:46.858940 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:47:46.858940 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:47:46.860450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.944682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2285/4593] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:46 2022] GET /identity/v3/users => generated 8905 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:46.950452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:46.954417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:46.961196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:46.962183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:46.962647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:46.963107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] PATH_INFO: `/v3/users/d9cbdf9211b44da88971e52eac872604` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:46.967070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9cbdf9211b44da88971e52eac872604)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:46.968311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:46.983975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180d385-7730-4961-809a-a1b940cbe5c8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:47.002870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:47.003593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.003996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.004672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] PATH_INFO: `/v3/projects/0457c093df8b4ab9a39aaa6c7ca84c2a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.009126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0457c093df8b4ab9a39aaa6c7ca84c2a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:47.011285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:47.258442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0457c093df8b4ab9a39aaa6c7ca84c2a', 'request_id': 'req-ae3837c1-7bb7-412f-b0aa-6b868967cc05'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.260033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9cbdf9211b44da88971e52eac872604'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.272863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0457c093df8b4ab9a39aaa6c7ca84c2a', 'request_id': 'req-ae3837c1-7bb7-412f-b0aa-6b868967cc05'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.407131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9cbdf9211b44da88971e52eac872604'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.427562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9cbdf9211b44da88971e52eac872604'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.454196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9cbdf9211b44da88971e52eac872604'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.456445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6439d071-3d22-45f5-b411-0116be722222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9cbdf9211b44da88971e52eac872604'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.465948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2309/4594] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:46 2022] DELETE /identity/v3/users/d9cbdf9211b44da88971e52eac872604 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:47.467608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.468061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.468513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.524950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] MFA Rules not processed for user `f77fa936dd7a4232b322a6c1f00ef634`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:47.527082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:47.533992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0457c093df8b4ab9a39aaa6c7ca84c2a', 'request_id': 'req-ae3837c1-7bb7-412f-b0aa-6b868967cc05'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.550385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] The token cache is being invalidate because project 0457c093df8b4ab9a39aaa6c7ca84c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:47.550683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.554114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae3837c1-7bb7-412f-b0aa-6b868967cc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:47.558348 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2286/4595] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:46 2022] DELETE /identity/v3/projects/0457c093df8b4ab9a39aaa6c7ca84c2a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:47.559694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501237-c233-4d03-86e7-4c4ede084fe6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.559998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501237-c233-4d03-86e7-4c4ede084fe6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.560267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74501237-c233-4d03-86e7-4c4ede084fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.616693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-74501237-c233-4d03-86e7-4c4ede084fe6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:47.617947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74501237-c233-4d03-86e7-4c4ede084fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:47.661905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2310/4596] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:47.663207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:47.664812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:47.766982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48378a-b8bb-41fd-bb18-4cde153abc30 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:47.773548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2287/4597] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:47.774990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.775275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.775555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.778944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:47.779706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.780128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.780522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] PATH_INFO: `/v3/users/455f40ae97d44675a9fbda09f8abde9d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.782782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=455f40ae97d44675a9fbda09f8abde9d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:47.785663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:47.814806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] MFA Rules not processed for user `f77fa936dd7a4232b322a6c1f00ef634`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:47.816041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:47.824424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2288/4598] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:47.826676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:47.838667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:47.956735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d1ad8-b759-4686-bdac-ad9ee47605be None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:47.969098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:47.970050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:47.970494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:47.970933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:47.990791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:47.992740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:48.017008 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2289/4599] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:48.019927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:48.050263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3358a6e-c208-44ac-bf0a-28a1fe3d6307 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:48.056927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77fa936dd7a4232b322a6c1f00ef634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e31bc1ee8ff4f6d992a74149662bf35', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1205357649', 'tempest-DelegatedRole-1770971565'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:48.057846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:48.058412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:48.058842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:48.059766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: Authorizing `identity:create_trust()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:48.061373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:48.092344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455f40ae97d44675a9fbda09f8abde9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:48.206727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455f40ae97d44675a9fbda09f8abde9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:48.253586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455f40ae97d44675a9fbda09f8abde9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:48.262187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455f40ae97d44675a9fbda09f8abde9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:48.263421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455f40ae97d44675a9fbda09f8abde9d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:48.274407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2311/4600] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:47 2022] DELETE /identity/v3/users/455f40ae97d44675a9fbda09f8abde9d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:48.309051 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2290/4601] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:47:48 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:48.314611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:48.316156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:48.534067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f646-5dc3-499f-8307-f4e5900c3c8f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:48.557003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:48.557741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:48.558081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:48.558364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:48.559752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:48.561143 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:48.561143 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:47:48.561143 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:47:48.562059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23842960-703b-431d-a2c4-e7b29c474047 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:48.571759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2312/4602] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:47:48 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:48.577834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:48.579832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:48.603182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a876f-4965-4316-a589-c9fa76c40a77 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:48.665770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:48.719791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77fa936dd7a4232b322a6c1f00ef634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e31bc1ee8ff4f6d992a74149662bf35', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1205357649', 'tempest-DelegatedRole-1770971565'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:48.720804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:48.721087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:48.721408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] PATH_INFO: `/v3/OS-TRUST/trusts/cef242a1cc344f949e5c9c9087d78ab4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:48.734667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: Authorizing `identity:delete_trust(trust_id=cef242a1cc344f949e5c9c9087d78ab4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:48.736669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:48.765826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:48.766195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:48.766672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:48.797512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] MFA Rules not processed for user `60865b371ff044b79a4db130399b639f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:48.798809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:48.926643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2313/4603] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:48.929197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:48.933100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:48.944670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'cef242a1cc344f949e5c9c9087d78ab4', 'request_id': 'req-bdeba30d-29de-45de-a430-394f80a16cc8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.060449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cef242a1cc344f949e5c9c9087d78ab4', 'request_id': 'req-bdeba30d-29de-45de-a430-394f80a16cc8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.064268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'cef242a1cc344f949e5c9c9087d78ab4', 'request_id': 'req-bdeba30d-29de-45de-a430-394f80a16cc8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.071201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2291/4604] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:47:48 2022] DELETE /identity/v3/OS-TRUST/trusts/cef242a1cc344f949e5c9c9087d78ab4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:49.075798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:49.079766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:49.120625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba30d-29de-45de-a430-394f80a16cc8 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:49.128755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad825ba-07d3-4efe-a694-68e52eca3a82 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:49.133812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f77fa936dd7a4232b322a6c1f00ef634', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e31bc1ee8ff4f6d992a74149662bf35', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1205357649', 'tempest-DelegatedRole-1770971565'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:49.137185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:49.138069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:49.140124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] PATH_INFO: `/v3/OS-TRUST/trusts/cef242a1cc344f949e5c9c9087d78ab4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:49.157361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:49.158759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:49.158759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:49.158759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] PATH_INFO: `/v3/projects/66ebcccd66e349ba9e23ef9c9f2c81de` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:49.159805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ebcccd66e349ba9e23ef9c9f2c81de)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:49.162340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Could not find trust: cef242a1cc344f949e5c9c9087d78ab4.: keystone.exception.TrustNotFound: Could not find trust: cef242a1cc344f949e5c9c9087d78ab4. Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Nov 02 12:47:49.189367 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: cef242a1cc344f949e5c9c9087d78ab4. Nov 02 12:47:49.190497 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:47:49.191309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2292/4605] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:47:49 2022] GET /identity/v3/OS-TRUST/trusts/cef242a1cc344f949e5c9c9087d78ab4 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:47:49.195662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:49.197598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:49.230224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4cd94-2cd2-4b43-9235-ea62b73a82e5 tempest-TrustsV3TestJSON-1174773117 tempest-user-1176063076] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:49.238984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:49.241264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:49.241771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:49.242257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/034212adda104ca596f792d225c58132` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:49.245038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=034212adda104ca596f792d225c58132)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:49.247213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:49.407531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ebcccd66e349ba9e23ef9c9f2c81de', 'request_id': 'req-6a84270f-034f-45a1-88ad-a5fc4ba461f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.416149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ebcccd66e349ba9e23ef9c9f2c81de', 'request_id': 'req-6a84270f-034f-45a1-88ad-a5fc4ba461f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.422955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ebcccd66e349ba9e23ef9c9f2c81de', 'request_id': 'req-6a84270f-034f-45a1-88ad-a5fc4ba461f5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.531205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 034212adda104ca596f792d225c58132 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:49.532029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.532179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.538304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2293/4606] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:49 2022] DELETE /identity/v3/roles/034212adda104ca596f792d225c58132 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:49.539303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:49.542152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:49.604128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] The token cache is being invalidate because project 66ebcccd66e349ba9e23ef9c9f2c81de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:49.606142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.606142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.608389 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2314/4607] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:48 2022] DELETE /identity/v3/projects/66ebcccd66e349ba9e23ef9c9f2c81de => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:49.612870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:49.614625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:49.677983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627a24c-9e85-4346-9498-07cecc6a7d09 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:49.691042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:49.691886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:49.692140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:49.692243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/9474ab14a75142fcbbe053cd232a9c4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:49.703511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9474ab14a75142fcbbe053cd232a9c4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:49.706150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:49.762471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84270f-034f-45a1-88ad-a5fc4ba461f5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:49.840832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:49.842011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:49.842358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:49.843096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] PATH_INFO: `/v3/users/8cf068d1840d48c8b50a9fa1f3575dd5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:49.844276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf068d1840d48c8b50a9fa1f3575dd5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:49.846575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:49.968061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 9474ab14a75142fcbbe053cd232a9c4b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:49.968411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.969116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:49.970963 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2294/4608] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:49 2022] DELETE /identity/v3/roles/9474ab14a75142fcbbe053cd232a9c4b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:49.974117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:49.974117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:50.044619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02649b-fe01-4795-bd31-a557a763d00e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:50.049285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:50.049918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.050194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.050681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] PATH_INFO: `/v3/projects/64acbf6b65c04b7d9ef50ad3b9f05217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.051874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64acbf6b65c04b7d9ef50ad3b9f05217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:50.054576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:50.119019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf068d1840d48c8b50a9fa1f3575dd5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.208908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:50.224586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf068d1840d48c8b50a9fa1f3575dd5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.238134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64acbf6b65c04b7d9ef50ad3b9f05217', 'request_id': 'req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.248139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64acbf6b65c04b7d9ef50ad3b9f05217', 'request_id': 'req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.248754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf068d1840d48c8b50a9fa1f3575dd5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.258146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf068d1840d48c8b50a9fa1f3575dd5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.258703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-621a40b1-5850-485b-a9c5-76992abdea6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf068d1840d48c8b50a9fa1f3575dd5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.265252 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2315/4609] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:49 2022] DELETE /identity/v3/users/8cf068d1840d48c8b50a9fa1f3575dd5 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:50.266593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.266889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.267167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:50.274235 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:47:50.275296 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:47:50.276409 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2316/4610] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:47:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:47:50.276409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:50.277994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:50.372451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548f4c6-2262-4605-9ce1-46a869525036 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:50.378315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:50.378902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.380614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.380847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/f77fa936dd7a4232b322a6c1f00ef634` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.382322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f77fa936dd7a4232b322a6c1f00ef634)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:50.385389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:50.386148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64acbf6b65c04b7d9ef50ad3b9f05217', 'request_id': 'req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.402290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] The token cache is being invalidate because project 64acbf6b65c04b7d9ef50ad3b9f05217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:50.402874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.403763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-84f62c6f-ce7f-4eba-9915-f8f5ce6f426b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.406089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2295/4611] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:49 2022] DELETE /identity/v3/projects/64acbf6b65c04b7d9ef50ad3b9f05217 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:50.414919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46cee-eafe-426b-80e7-082427a7d91c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.415542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46cee-eafe-426b-80e7-082427a7d91c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.416768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb46cee-eafe-426b-80e7-082427a7d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.447363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cdb46cee-eafe-426b-80e7-082427a7d91c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:50.449550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdb46cee-eafe-426b-80e7-082427a7d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:50.621124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77fa936dd7a4232b322a6c1f00ef634'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.641751 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2296/4612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:50.643260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.643542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.643807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.680000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:50.681433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:50.696111 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2297/4613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:50.697283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:50.708478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053744ab-fddf-491f-b0e8-30f6f52d0451 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:50.716086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:50.717033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.717380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.717722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.718699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:50.719070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:50.721083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:50.737373 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2298/4614] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:50.744622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:50.768583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77fa936dd7a4232b322a6c1f00ef634'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.786811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577a62e-02ca-4808-ae57-6dd22cd29bff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:50.798466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77fa936dd7a4232b322a6c1f00ef634'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.810054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:50.810607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:50.817404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:50.817404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:50.818348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77fa936dd7a4232b322a6c1f00ef634'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.819175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77fa936dd7a4232b322a6c1f00ef634'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:50.820955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:50.827513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:50.829657 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2317/4615] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:50 2022] DELETE /identity/v3/users/f77fa936dd7a4232b322a6c1f00ef634 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:50.834032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:50.835772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:50.995993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c3fab7-9a49-424d-b7f8-3c7356665112 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:50.996281 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2299/4616] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:50 2022] POST /identity/v3/projects => generated 399 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:51.000397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.005637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.105296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.109965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.109965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.109965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.110812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5e31bc1ee8ff4f6d992a74149662bf35)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.115673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.158440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1ebca-7974-4b69-afbc-0f12954f97fa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.165978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.167003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.167470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.167948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.168984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.171221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.339148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2300/4617] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:50 2022] POST /identity/v3/users => generated 300 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:47:51.339148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.350184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.373435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2af735-eefb-49c8-93a0-50bf747ef329 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.380743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:51.455462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.456114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.456392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.456728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] PATH_INFO: `/v3/projects/e3ea3722f0cb46d489a41786d1e081b4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.457871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea3722f0cb46d489a41786d1e081b4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.460724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.498776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e31bc1ee8ff4f6d992a74149662bf35', 'request_id': 'req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.506831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e31bc1ee8ff4f6d992a74149662bf35', 'request_id': 'req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.513219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e31bc1ee8ff4f6d992a74149662bf35', 'request_id': 'req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.632105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project 5e31bc1ee8ff4f6d992a74149662bf35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:51.633404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.634482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.638488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2318/4618] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:50 2022] DELETE /identity/v3/projects/5e31bc1ee8ff4f6d992a74149662bf35 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:47:51.639886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.645202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.656289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea3722f0cb46d489a41786d1e081b4', 'request_id': 'req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.667550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea3722f0cb46d489a41786d1e081b4', 'request_id': 'req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.668802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e540371-fed4-4a4b-9e0c-6b8371cbdec3 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.753555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.754630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.754911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.755716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.756689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.758138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.775850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2319/4619] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:51.777011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea3722f0cb46d489a41786d1e081b4', 'request_id': 'req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.777618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.780082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.809033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] The token cache is being invalidate because project e3ea3722f0cb46d489a41786d1e081b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:51.809525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.811557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:51.820584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2301/4620] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:51 2022] DELETE /identity/v3/projects/e3ea3722f0cb46d489a41786d1e081b4 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:51.823849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.826418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.841907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e67fea-9c15-4dc3-b11c-3e5341dfcc7a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.847775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.848330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.848703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.849638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.850333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.852110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a44b92-fb60-47aa-a401-e7902ae3e673 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.870994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2302/4621] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:51.870994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.870994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.870994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.896352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:51.898214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:51.899291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f697e-ace5-4262-a70a-b1c002fd054e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.908223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.908895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.909184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.909856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.910074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.912807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e742da-818b-4bc0-b391-cb1c28badfd7 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:51.921683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2303/4622] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:51.921683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:51.929101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f13b-90f3-4821-a993-fec3365832fd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:51.935196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:51.935884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:51.936168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:51.936447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] PATH_INFO: `/v3/projects/c1ea0e13261a4a6790ff89a1b9302938/users/f9d1f6e602604fb0bc748ba05f99d502/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:51.955224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ea0e13261a4a6790ff89a1b9302938, user_id=f9d1f6e602604fb0bc748ba05f99d502, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:51.958883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.038884 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2320/4623] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:47:51 2022] POST /identity/v3/projects => generated 329 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.045739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ad2a-d6cd-482c-9d48-8970b3995909 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.050192 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2304/4624] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:51 2022] PUT /identity/v3/projects/c1ea0e13261a4a6790ff89a1b9302938/users/f9d1f6e602604fb0bc748ba05f99d502/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:52.050192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.051486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ad2a-d6cd-482c-9d48-8970b3995909 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.052180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ad2a-d6cd-482c-9d48-8970b3995909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.055039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.088185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ff93ad2a-d6cd-482c-9d48-8970b3995909 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:52.090206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ff93ad2a-d6cd-482c-9d48-8970b3995909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.161143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937ebd-b0f5-4568-abd6-f5f6b2b3169f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.169477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.171044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.171581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.172388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.173340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.180185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.192022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2321/4625] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:52.197589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.198171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.198457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.231740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] MFA Rules not processed for user `f9d1f6e602604fb0bc748ba05f99d502`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:52.232987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.283818 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2305/4626] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/users => generated 416 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.283818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.302647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bfbb4-7dcb-4d10-bd50-02c475a282ee tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.320887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2322/4627] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:52.321887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.342394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.343130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.343542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.344089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.344786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:52.351506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b69ddd-62ea-4c94-a77a-513240afd952 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.358344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.358344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.358619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.359058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.359185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.360159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.361973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.362170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.391074 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2306/4628] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:52.393410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.409237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ec6d2-4328-4c82-99dc-312289e9d1b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.417102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.417716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.417995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.418266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.418902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.420851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.488380 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2323/4629] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/roles => generated 244 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.490354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.502786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fd567-ebc6-44be-a384-82841b0ac637 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.508767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.509358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.509631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.509900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.511061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.513093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.658414 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2307/4630] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/projects => generated 399 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.658414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.658414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.735437 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2324/4631] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.735437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.751230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae93b5-0806-4b98-a0bf-0205e122ca60 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.828920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f849b14-ba5e-46e9-80e8-276d7efdd943 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.834326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.834967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.835241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.835514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.836181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.838355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.845286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.846016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.846302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.846577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.848434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.864279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.865968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.877699 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2308/4632] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:52.878517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.880324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:52.949731 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2325/4633] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/roles => generated 245 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:52.949731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:52.957353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88065fe8-e1e6-474f-b6c2-f3ffafe41d91 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.962743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40176a-38ba-4760-8e23-710b8635227d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:52.971380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.972981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.975391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.975391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] PATH_INFO: `/v3/users/9d131de9b82a4c0692b6e33542361bda` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.975784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d131de9b82a4c0692b6e33542361bda)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:52.978307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:52.984804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:52.985446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:52.987104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:52.987276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:52.987912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.016462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.162117 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2326/4634] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:52 2022] POST /identity/v3/users => generated 306 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:53.162117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.175175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52dfc3-707c-4d3b-8615-8ca49bbfb37f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.189607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.190848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.190848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.191043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.191643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.194573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.369623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:53.378673 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2327/4635] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:53 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:53.383601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.419132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d131de9b82a4c0692b6e33542361bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:53.419500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a789f-2ec4-4f65-83eb-b483f538f803 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.430348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.432541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.432855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.433135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/b4700d728f874e36b0c6a0903ccc806d/users/cfff0b1ccd324fd5bfabb8c8353c83b6/roles/45fe63f4001c4ebeb9b5e057d251c0cd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.468584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b4700d728f874e36b0c6a0903ccc806d, user_id=cfff0b1ccd324fd5bfabb8c8353c83b6, role_id=45fe63f4001c4ebeb9b5e057d251c0cd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.471963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.617971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d131de9b82a4c0692b6e33542361bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:53.633697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d131de9b82a4c0692b6e33542361bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:53.634517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d131de9b82a4c0692b6e33542361bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:53.635227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d131de9b82a4c0692b6e33542361bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:53.655472 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2309/4636] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:52 2022] DELETE /identity/v3/users/9d131de9b82a4c0692b6e33542361bda => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:53.659704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.672013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2328/4637] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:53 2022] PUT /identity/v3/projects/b4700d728f874e36b0c6a0903ccc806d/users/cfff0b1ccd324fd5bfabb8c8353c83b6/roles/45fe63f4001c4ebeb9b5e057d251c0cd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:53.672013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.672661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:53.675032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:53.782287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a2c62-9c3e-412c-a6d9-e09b78a26e19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.812057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831216-6675-4f33-a111-ca14e4f2c4f6 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.834830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.835746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.836060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.836335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.841879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.846281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.860578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2329/4638] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:53 2022] GET /identity/v3/roles => generated 1891 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:53.861816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.866039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:53.886753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.895884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.895884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.895884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.895884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.895884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.912201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2310/4639] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:53 2022] GET /identity/v3/roles => generated 1891 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:53.913564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.931360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4b6e2-fbc7-4795-a759-5d4a2f24ca66 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.944149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.945488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.945917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.946353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.947178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.949046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:53.961870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87072d-10a2-4050-a170-1e717bd18247 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.970419 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2311/4640] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:53 2022] GET /identity/v3/roles => generated 1891 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:53.970419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:53.979679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.980367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.980747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.980952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/b4700d728f874e36b0c6a0903ccc806d/users/cfff0b1ccd324fd5bfabb8c8353c83b6/roles/5a72566533154885bb04256612ea5e7b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.983598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a295fdf-a144-4f25-aa31-5aed7eda7976 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:53.988815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:53.989756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:53.990033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:53.990304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] PATH_INFO: `/v3/projects/a732ba5fdce345fd87c7b6482100033e/users/2c1418d4ea624d4d828f50be874d0b39/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:53.991323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b4700d728f874e36b0c6a0903ccc806d, user_id=cfff0b1ccd324fd5bfabb8c8353c83b6, role_id=5a72566533154885bb04256612ea5e7b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:53.993891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:54.014383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a732ba5fdce345fd87c7b6482100033e, user_id=2c1418d4ea624d4d828f50be874d0b39, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:54.017136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:54.071269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:54.124925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2330/4641] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:53 2022] PUT /identity/v3/projects/b4700d728f874e36b0c6a0903ccc806d/users/cfff0b1ccd324fd5bfabb8c8353c83b6/roles/5a72566533154885bb04256612ea5e7b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:54.128354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2312/4642] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:53 2022] PUT /identity/v3/projects/a732ba5fdce345fd87c7b6482100033e/users/2c1418d4ea624d4d828f50be874d0b39/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:54.128963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:54.129380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:54.130975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:54.253088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa7b97-35e4-4f70-9797-c81e228ad6cf tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:54.277776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44f62a-dfff-4f85-9d9a-962943848eef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:54.284678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:54.289829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:54.289829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:54.289829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] PATH_INFO: `/v3/projects/762ab703cd6b4d41ac9eddd7baa56c69` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:54.289829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762ab703cd6b4d41ac9eddd7baa56c69)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:54.291975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:54.406368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:54.408683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:54.409015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:54.409285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] PATH_INFO: `/v3/projects/8fabc60192d84a4dad9f31f9c5ff93b5/users/1f968a2793944b0f81a479863dbc76f7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:54.459270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fabc60192d84a4dad9f31f9c5ff93b5, user_id=1f968a2793944b0f81a479863dbc76f7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:54.469359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:54.691672 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2331/4643] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:54 2022] PUT /identity/v3/projects/8fabc60192d84a4dad9f31f9c5ff93b5/users/1f968a2793944b0f81a479863dbc76f7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:54.691672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:54.724684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762ab703cd6b4d41ac9eddd7baa56c69', 'request_id': 'req-5f048e05-59ca-435c-a6cb-beaaa241f502'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:54.734858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762ab703cd6b4d41ac9eddd7baa56c69', 'request_id': 'req-5f048e05-59ca-435c-a6cb-beaaa241f502'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:54.809058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838be73-9f85-4e6b-9cdb-e416be2c1ffb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:54.865278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762ab703cd6b4d41ac9eddd7baa56c69', 'request_id': 'req-5f048e05-59ca-435c-a6cb-beaaa241f502'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:54.882136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] The token cache is being invalidate because project 762ab703cd6b4d41ac9eddd7baa56c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:54.882448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:54.889547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:54.896453 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2313/4644] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:54 2022] DELETE /identity/v3/projects/762ab703cd6b4d41ac9eddd7baa56c69 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:54.899400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:54.910371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:54.935935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:54.936718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:54.938002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:54.938286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:54.938969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:54.940448 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:47:54.940448 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:47:54.940448 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:47:54.941823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b08d6-1bd5-43ad-ab6f-6c01361e5992 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:55.009231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2332/4645] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:54 2022] GET /identity/v3/users => generated 8643 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:55.009231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a23d-9efb-42fd-ac41-99a7a79b0986 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.009231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a23d-9efb-42fd-ac41-99a7a79b0986 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.009231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a23d-9efb-42fd-ac41-99a7a79b0986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.047878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2097a23d-9efb-42fd-ac41-99a7a79b0986 None None] MFA Rules not processed for user `1f968a2793944b0f81a479863dbc76f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.059992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2097a23d-9efb-42fd-ac41-99a7a79b0986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.146782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f048e05-59ca-435c-a6cb-beaaa241f502 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:55.153586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:55.154212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.155687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.155687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.156090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:55.164461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa0edf4-a04b-481b-b35a-9d13b1f5bc0f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:55.197243 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2333/4646] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:55.199388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.199388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.200024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.210782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2314/4647] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:54 2022] GET /identity/v3/roles => generated 1891 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:55.210782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.210782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.210782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.296728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.314473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.333688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2334/4648] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:55.336636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:55.344447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.346878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] MFA Rules not processed for user `cfff0b1ccd324fd5bfabb8c8353c83b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.348418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.368371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115b8ba-43db-4ecb-ae8c-5ab950628f75 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:55.397359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:55.398032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.398389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.401422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.402949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:55.406407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d7c0a-e4af-4f62-b562-d11d35bf3714 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:55.638470 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2315/4649] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:55.651837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:55.671905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e65256d-b799-4ef8-abaf-8263603905f2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:55.678822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:55.679777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.680149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.680556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] PATH_INFO: `/v3/projects/a732ba5fdce345fd87c7b6482100033e/users/2c1418d4ea624d4d828f50be874d0b39/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.683282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a732ba5fdce345fd87c7b6482100033e, user_id=2c1418d4ea624d4d828f50be874d0b39, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:55.685489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2335/4650] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/projects => generated 381 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:55.687415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.687703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.687982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.689856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324413ae-eb46-463c-a21e-942b25ea8c2a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:55.702911 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2316/4651] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:55 2022] PUT /identity/v3/projects/a732ba5fdce345fd87c7b6482100033e/users/2c1418d4ea624d4d828f50be874d0b39/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:55.709106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42287-ec38-47b7-b36c-b1190163c8ad None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.709106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42287-ec38-47b7-b36c-b1190163c8ad None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.709106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42287-ec38-47b7-b36c-b1190163c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.729147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-84b42287-ec38-47b7-b36c-b1190163c8ad None None] MFA Rules not processed for user `cfff0b1ccd324fd5bfabb8c8353c83b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.729743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.730444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84b42287-ec38-47b7-b36c-b1190163c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.730882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.832819 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2336/4652] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:55.833872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:55.837796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2317/4653] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:55.841493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.841493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.841493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.848964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061d97b-81a9-457f-ac42-d203be6e7918 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:55.854727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:55.864177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:55.870895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:55.875072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:55.875072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:55.879880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:55.913523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] MFA Rules not processed for user `2c1418d4ea624d4d828f50be874d0b39`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:55.914840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:55.996184 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2337/4654] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:55.996184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.016543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:56.022192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baba8f0-d0e8-4587-97aa-47940db4993c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.035540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.037417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.037825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.038733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.040805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:47:56.042373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.047273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.070799 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2318/4655] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:56.075261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.080806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2338/4656] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:56.081515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.089006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737ad2f-5fad-4406-8ca8-2de88de9dbc0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.094516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfff0b1ccd324fd5bfabb8c8353c83b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4700d728f874e36b0c6a0903ccc806d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1472089582', 'tempest-NotDelegatedRole-94727378'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.099317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.099317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.099317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.099317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorizing `identity:create_trust()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.099317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.111102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1557ec-e047-4659-9071-333a5b26283f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.128568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.129468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.130359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.130654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.131430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.133100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.167634 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2339/4657] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:56 2022] GET /identity/v3/roles => generated 1891 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:56.173814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.188107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753b523-740f-4e27-807e-1ea61682ebe9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.195856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.196466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.196773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.197046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.197680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.199585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.295651 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2319/4658] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:47:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:56.296975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.298830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:56.339268 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2340/4659] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:56 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:56.340119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.391270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3368f-ae10-4ce5-b859-6cff54cd3998 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.441131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3293364f-9ac4-439c-94e6-861a3ccfe3bf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.452933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.453987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.453987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.454343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.454747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.456632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.470655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2341/4660] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:56 2022] GET /identity/v3/roles => generated 1891 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:56.477042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.483200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.483833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.484118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.484393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.501120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:56.577502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fda457-5930-4d33-9956-75029b3cc553 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.582739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfff0b1ccd324fd5bfabb8c8353c83b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4700d728f874e36b0c6a0903ccc806d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1472089582', 'tempest-NotDelegatedRole-94727378'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.583946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.584226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.584519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.585184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.586609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.594186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2342/4661] 10.222.0.64 () {58 vars in 1252 bytes} [Wed Nov 2 12:47:56 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=cfff0b1ccd324fd5bfabb8c8353c83b6 => generated 611 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:47:56.595054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.598340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.601167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.611780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4ba93-37c7-4019-ac72-37b9ad611710 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.615185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2320/4662] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:56.616316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.617635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.618273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.618789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.619069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.619830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.622263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e4fc9-6fe5-419c-b148-793062c17d9e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.633487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9eecda-baba-475b-820d-c6c80871b1ee service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.640464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.641600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.642101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.642621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] PATH_INFO: `/v3/projects/e6c0e848b2364e6d93f4e8d9c0e97fe5/users/d37043f6d0d94db5a54ccf16d79933d3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.664025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c0e848b2364e6d93f4e8d9c0e97fe5, user_id=d37043f6d0d94db5a54ccf16d79933d3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.667446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.779832 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2321/4663] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:56 2022] PUT /identity/v3/projects/e6c0e848b2364e6d93f4e8d9c0e97fe5/users/d37043f6d0d94db5a54ccf16d79933d3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:56.779832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.781029 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2343/4664] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:56 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:56.783893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.784581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.785111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.841531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] MFA Rules not processed for user `d37043f6d0d94db5a54ccf16d79933d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:56.844569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:56.905609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df563737-c1df-49d1-84a5-58bd9c0eecfd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:56.912343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfff0b1ccd324fd5bfabb8c8353c83b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4700d728f874e36b0c6a0903ccc806d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1472089582', 'tempest-NotDelegatedRole-94727378'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:56.912343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:56.912343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:56.912700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] PATH_INFO: `/v3/OS-TRUST/trusts/e25e7a13fca2437c9c0aab57ef254c89` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:56.919411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorizing `identity:delete_trust(trust_id=e25e7a13fca2437c9c0aab57ef254c89)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:56.920933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:56.956806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2344/4665] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:56.957765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:56.990449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e25e7a13fca2437c9c0aab57ef254c89', 'request_id': 'req-0a71f055-081b-4346-a5de-e5b796718327'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:57.039677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c286c78-92cc-4cbb-8bb2-db3b6935b5fd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.047071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.048333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.048733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.048949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.049583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.051392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.063193 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2345/4666] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:56 2022] GET /identity/v3/roles => generated 1891 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:57.064075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.077245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd0ea-bb8f-47cc-b35f-7d8083b98000 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.085312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.086942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.088125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e25e7a13fca2437c9c0aab57ef254c89', 'request_id': 'req-0a71f055-081b-4346-a5de-e5b796718327'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:57.088459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.088819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.088946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e25e7a13fca2437c9c0aab57ef254c89', 'request_id': 'req-0a71f055-081b-4346-a5de-e5b796718327'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:57.089603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.092248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.100047 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2322/4667] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:47:56 2022] DELETE /identity/v3/OS-TRUST/trusts/e25e7a13fca2437c9c0aab57ef254c89 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:57.100047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.101573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:57.119642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f055-081b-4346-a5de-e5b796718327 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.129300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.129300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.129300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.129300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.129687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.130786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.151710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2323/4668] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:57 2022] GET /identity/v3/roles => generated 1891 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:57.152446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.155208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:57.174384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc568bf-9da7-4934-85b2-3f2741109b0d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.180435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfff0b1ccd324fd5bfabb8c8353c83b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4700d728f874e36b0c6a0903ccc806d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1472089582', 'tempest-NotDelegatedRole-94727378'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.181209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.181588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.182139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] PATH_INFO: `/v3/OS-TRUST/trusts/e25e7a13fca2437c9c0aab57ef254c89` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.185805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Could not find trust: e25e7a13fca2437c9c0aab57ef254c89.: keystone.exception.TrustNotFound: Could not find trust: e25e7a13fca2437c9c0aab57ef254c89. Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Nov 02 12:47:57.199346 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e25e7a13fca2437c9c0aab57ef254c89. Nov 02 12:47:57.200749 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:47:57.202732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2324/4669] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:47:57 2022] GET /identity/v3/OS-TRUST/trusts/e25e7a13fca2437c9c0aab57ef254c89 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:47:57.203959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.221079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e00b6-76d9-4890-93b0-4d7fdeb7e3f4 tempest-TrustsV3TestJSON-1546903419 tempest-user-1243854113] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.235815 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2346/4670] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:47:57 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:57.237672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.243255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:57.245099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.246973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.248256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.249381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] PATH_INFO: `/v3/projects/a720f4a1648e4aa1b4efaf39bb904f11/users/3ccf6b6cde274e6fbbda8f3c92808415/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.292892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a720f4a1648e4aa1b4efaf39bb904f11, user_id=3ccf6b6cde274e6fbbda8f3c92808415, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.298203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.364442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167a86f-9602-42cc-acdd-84e9ae554dca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.375580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.375580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.375580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.375991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/5a72566533154885bb04256612ea5e7b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.375991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a72566533154885bb04256612ea5e7b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.376569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.543706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2325/4671] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:57 2022] PUT /identity/v3/projects/a720f4a1648e4aa1b4efaf39bb904f11/users/3ccf6b6cde274e6fbbda8f3c92808415/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:57.544380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.547484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:57.654745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc75d-17f4-451f-8d1d-8bc71df7a60a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:57.655286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:57.656095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.656470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.656904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.657853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:57.660371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26300782-b51c-4d5f-91b4-99ba3275fbf8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:57.815781 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2326/4672] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:47:57 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:47:57.819698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:57.820130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:57.820419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:57.834694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 5a72566533154885bb04256612ea5e7b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:57.834996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:57.840213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:57.844148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2347/4673] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:57 2022] DELETE /identity/v3/roles/5a72566533154885bb04256612ea5e7b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:57.845107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:57.851071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:57.874751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:57.878505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.030144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d117a9c-635a-4f80-9aaa-7403a2c71d79 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.037041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.038016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.038476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.038763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.039441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.046094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.064387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2348/4674] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:57 2022] GET /identity/v3/roles => generated 1655 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:58.065569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.067318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.088271 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2327/4675] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:58.089574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.123269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdc2e7-091f-4ece-945b-d86a9d089293 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.138279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.147354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.150851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.154317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] PATH_INFO: `/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e/users/1768ad5292ca4498bcbcb49f1293f6da/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.181375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98c00104ba44fa19d18d03bc5b2ac8e, user_id=1768ad5292ca4498bcbcb49f1293f6da, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.186407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.231275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302524b-6abc-4f7d-a4f5-c52fb5a62da4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.261818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.262721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.263068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.263357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/45fe63f4001c4ebeb9b5e057d251c0cd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.265368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=45fe63f4001c4ebeb9b5e057d251c0cd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.267747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.338545 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2328/4676] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:58 2022] PUT /identity/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e/users/1768ad5292ca4498bcbcb49f1293f6da/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:58.338545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.338545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.438628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42858d1f-e5cb-4cd9-aba9-53d5445d9aa3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.442366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.443012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.443287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.443558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.519375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.522192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.531895 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2329/4677] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:58.538886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.541492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:58.556912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c7d1-c1c5-48d5-b533-2db4f0410e81 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.565949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.567540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.574031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.574031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.574031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.574031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.599938 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2330/4678] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:47:58 2022] GET /identity/v3/roles => generated 1655 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:47:58.601463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.608982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.714152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed5f20-c14b-4ed6-b3dc-a8e03e47150b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:58.727649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:58.732392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:58.732392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:58.732392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:58.732392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.766699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 45fe63f4001c4ebeb9b5e057d251c0cd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:47:58.772445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:58.772445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:58.780172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2349/4679] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:58 2022] DELETE /identity/v3/roles/45fe63f4001c4ebeb9b5e057d251c0cd => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:58.781365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:58.783359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:58.832650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:58.836028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:58.866426 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2331/4680] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:58.872014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:59.007728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395b7cc-3b4b-45b4-b957-99f73ab7ccad service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:59.034728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd77f95-3071-4416-abfb-c80b80387dcc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:59.043924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:59.045338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:59.054822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:59.054822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] PATH_INFO: `/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e/users/1768ad5292ca4498bcbcb49f1293f6da/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:59.054822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98c00104ba44fa19d18d03bc5b2ac8e, user_id=1768ad5292ca4498bcbcb49f1293f6da, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:59.054822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345021bf-5f26-4b43-abb9-42a37151a0fe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:59.075101 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2350/4681] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:47:58 2022] PUT /identity/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e/users/1768ad5292ca4498bcbcb49f1293f6da/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:59.083106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:59.087432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:59.087958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:59.088476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:59.143632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] MFA Rules not processed for user `1768ad5292ca4498bcbcb49f1293f6da`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:47:59.145428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:59.160905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:59.162168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:59.162479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:59.162756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/cfff0b1ccd324fd5bfabb8c8353c83b6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:59.165155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cfff0b1ccd324fd5bfabb8c8353c83b6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:59.175168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:59.306772 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2351/4682] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:47:59.385245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:59.386539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:59.452927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfff0b1ccd324fd5bfabb8c8353c83b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:59.545692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9dd2a-f335-46fc-9dc5-d48d65f02c36 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:59.557809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:59.558644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:59.559747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:59.560544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:59.564026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfff0b1ccd324fd5bfabb8c8353c83b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:59.576753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:59.595395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfff0b1ccd324fd5bfabb8c8353c83b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:59.596578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfff0b1ccd324fd5bfabb8c8353c83b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:59.606138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfff0b1ccd324fd5bfabb8c8353c83b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:47:59.667243 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2332/4683] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:47:58 2022] DELETE /identity/v3/users/cfff0b1ccd324fd5bfabb8c8353c83b6 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:47:59.672817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:47:59.674954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:47:59.823358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:59.827325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:47:59.853182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2352/4684] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:47:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:47:59.890442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e0246-5225-4f80-81c4-9df7342378dd tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:47:59.899057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:47:59.899415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:47:59.899707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:47:59.900115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/b4700d728f874e36b0c6a0903ccc806d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:47:59.901505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4700d728f874e36b0c6a0903ccc806d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:47:59.904603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:00.194881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:00.196901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:00.221967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4700d728f874e36b0c6a0903ccc806d', 'request_id': 'req-31367563-fcab-4c2c-a17a-1bbc78fd9228'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.233446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4700d728f874e36b0c6a0903ccc806d', 'request_id': 'req-31367563-fcab-4c2c-a17a-1bbc78fd9228'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.360175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca54bb-413d-426f-901c-d742d5853a5f service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:00.413878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4700d728f874e36b0c6a0903ccc806d', 'request_id': 'req-31367563-fcab-4c2c-a17a-1bbc78fd9228'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.438034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project b4700d728f874e36b0c6a0903ccc806d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:00.438658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.440900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.442957 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2333/4685] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:47:59 2022] DELETE /identity/v3/projects/b4700d728f874e36b0c6a0903ccc806d => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:00.449232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:00.453572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:00.475686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:00.476986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:00.477604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:00.478417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] PATH_INFO: `/v3/users/60865b371ff044b79a4db130399b639f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:00.480480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60865b371ff044b79a4db130399b639f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:00.483901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:00.580860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:00.623054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31367563-fcab-4c2c-a17a-1bbc78fd9228 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:00.635120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:00.636260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:00.636783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:00.637210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:00.638019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:00.641112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:00.837419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60865b371ff044b79a4db130399b639f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.846037 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2334/4686] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:48:00 2022] POST /identity/v3/projects => generated 329 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:00.850934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:00.934270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60865b371ff044b79a4db130399b639f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:00.992080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60865b371ff044b79a4db130399b639f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.011579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60865b371ff044b79a4db130399b639f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.014723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60865b371ff044b79a4db130399b639f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.023693 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2353/4687] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:00 2022] DELETE /identity/v3/users/60865b371ff044b79a4db130399b639f => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:01.025930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:01.027598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:01.045691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf651c-e015-4e59-8c00-723228156004 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:01.118812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caedf3a-1655-4e36-8b2a-73919645e9b2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:01.124888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:01.126270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:01.127525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:01.128000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] PATH_INFO: `/v3/users/f6d12ca5aa7b45dd8e7c1469040b3244` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:01.130750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d12ca5aa7b45dd8e7c1469040b3244)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:01.134574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:01.158521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:01.159285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:01.159804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:01.160159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:01.160877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:01.162956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:01.355844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2335/4688] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:00 2022] POST /identity/v3/users => generated 416 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:01.357612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:01.358954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:01.393768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9c80c-6970-48db-a0d3-1345c3339fce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:01.404751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:01.405392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:01.405719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:01.406055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:01.406750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:01.408380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:01.604518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d12ca5aa7b45dd8e7c1469040b3244'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.607072 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2336/4689] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:01 2022] POST /identity/v3/roles => generated 243 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:01.615348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:01.618579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:01.660941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac294eb3-a1a0-410e-af2c-7103cd59547d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:01.675149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:01.675149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:01.675149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:01.675149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] PATH_INFO: `/v3/projects/6a0d6178bceb4821a849a10833c56365` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:01.691549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0d6178bceb4821a849a10833c56365)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:01.694154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:01.825439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d12ca5aa7b45dd8e7c1469040b3244'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.859433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d12ca5aa7b45dd8e7c1469040b3244'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.864627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d12ca5aa7b45dd8e7c1469040b3244'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.866450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d12ca5aa7b45dd8e7c1469040b3244'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.884767 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2354/4690] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:01 2022] DELETE /identity/v3/users/f6d12ca5aa7b45dd8e7c1469040b3244 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:01.886749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:01.895345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:01.935426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0d6178bceb4821a849a10833c56365', 'request_id': 'req-592b5ef6-0e91-4502-b4a8-b863c9a23f95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:01.953571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0d6178bceb4821a849a10833c56365', 'request_id': 'req-592b5ef6-0e91-4502-b4a8-b863c9a23f95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:02.016301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07b924-ad64-4b77-8271-48fbc7151b75 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.088026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0d6178bceb4821a849a10833c56365', 'request_id': 'req-592b5ef6-0e91-4502-b4a8-b863c9a23f95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:02.109177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] The token cache is being invalidate because project 6a0d6178bceb4821a849a10833c56365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:02.109570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:02.110363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-592b5ef6-0e91-4502-b4a8-b863c9a23f95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:02.115126 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2337/4691] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:01 2022] DELETE /identity/v3/projects/6a0d6178bceb4821a849a10833c56365 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:02.122352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2842c1-29e5-4cfb-a2e1-c2eb66ebdf29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.122734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2842c1-29e5-4cfb-a2e1-c2eb66ebdf29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.123088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2842c1-29e5-4cfb-a2e1-c2eb66ebdf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.171731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dd2842c1-29e5-4cfb-a2e1-c2eb66ebdf29 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:02.173126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dd2842c1-29e5-4cfb-a2e1-c2eb66ebdf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:02.173953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.174919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.175199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.175473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.176154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.178409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:02.305625 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2338/4692] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:02.328702 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2355/4693] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:01 2022] POST /identity/v3/roles => generated 246 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:02.330082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:02.335469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.338039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.338039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.341348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:02.395135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:02.398447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:02.410113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2339/4694] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:02.412125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:02.427738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:02.445075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccaa60-66ec-4381-837d-d698e9913363 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.459633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.460239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.460842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.461125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/ab6f3a2da297430f8877b2820d4922c2/users/faec033965cd426aba200d8c50e6f27d/roles/241b55251f514abdb82ca3256c97ffa7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.489673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24bd4f-afda-4a6f-b4e7-6373dc02fc4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.500387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.501048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.501326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.501597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.505460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab6f3a2da297430f8877b2820d4922c2, user_id=faec033965cd426aba200d8c50e6f27d, role_id=241b55251f514abdb82ca3256c97ffa7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.508987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:02.540477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.541829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff95ac-d28c-4747-92f0-653169a209c6 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:02.584649 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2356/4695] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:02.590064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.590434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.590723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.632172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:02.633730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:02.648220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2357/4696] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:02.648686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:02.662364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e9d438-453c-4862-86c5-5f4251c4fb61 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.667661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.668273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.668611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.668885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.669707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:02.670019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.672231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:02.686679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2340/4697] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:02 2022] PUT /identity/v3/projects/ab6f3a2da297430f8877b2820d4922c2/users/faec033965cd426aba200d8c50e6f27d/roles/241b55251f514abdb82ca3256c97ffa7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:02.687624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:02.692599 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2358/4698] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:48:02.695294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:02.702832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:02.712835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1b603-f9c1-4f93-806f-7a7f147f81c8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.854904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.854904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.854904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.854904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.855517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.857672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:02.886379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2650-c742-4328-80bd-57e0ca541032 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:02.922375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:02.922375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:02.922375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:02.922777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/ab6f3a2da297430f8877b2820d4922c2/users/faec033965cd426aba200d8c50e6f27d/roles/a422a9e1c7a84c76b55e5101aff3896e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:02.922777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab6f3a2da297430f8877b2820d4922c2, user_id=faec033965cd426aba200d8c50e6f27d, role_id=a422a9e1c7a84c76b55e5101aff3896e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:02.931352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.003454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2359/4699] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:02 2022] POST /identity/v3/projects => generated 379 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:03.011480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.012837 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2341/4700] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:02 2022] PUT /identity/v3/projects/ab6f3a2da297430f8877b2820d4922c2/users/faec033965cd426aba200d8c50e6f27d/roles/a422a9e1c7a84c76b55e5101aff3896e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:03.024565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.186665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee5264-d687-41bd-843c-026890d85d85 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.196418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669394c2-85ad-49af-bf1d-826992f8c5ae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.211198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.212328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.213911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.216009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.216961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.221351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.287410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.289504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.289814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.290626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.291928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.296269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29e576-c6eb-4db0-808f-f1ac0d521cef tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.358847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2342/4701] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:03 2022] GET /identity/v3/users => generated 8940 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:03.360694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1512cd-419f-402d-b4eb-4fb9130ae483 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.361183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1512cd-419f-402d-b4eb-4fb9130ae483 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.361683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1512cd-419f-402d-b4eb-4fb9130ae483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.372424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2360/4702] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:03 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:03.378042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.403916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e7b3e-2ffb-43f8-afa1-88cae4458abc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.409720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6f1512cd-419f-402d-b4eb-4fb9130ae483 None None] MFA Rules not processed for user `faec033965cd426aba200d8c50e6f27d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:03.414235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f1512cd-419f-402d-b4eb-4fb9130ae483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:03.416613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.418116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.419611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.419611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.419611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.426144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.454376 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2361/4703] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:03 2022] GET /identity/v3/roles => generated 1891 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:03.457874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.484291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5098b-174e-4afb-a9d8-5e624bdf60a4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.497099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.502594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.502594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.502594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.502594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.502594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.518728 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2362/4704] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:03 2022] GET /identity/v3/roles => generated 1891 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:48:03.520044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.539929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9782e-bd8c-428e-b07a-d4e46b89f41d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.547010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.548114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.548403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.549071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] PATH_INFO: `/v3/projects/fc93689736c14e8dbfd8d32885abdbb8/users/da7f3b0109eb45148e88b3e7d5c2a833/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.577382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2343/4705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:03.580894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.582282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.582570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.595001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc93689736c14e8dbfd8d32885abdbb8, user_id=da7f3b0109eb45148e88b3e7d5c2a833, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.600158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff2ba6-ac7c-4801-abd4-43fa52a8a534 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.631090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] MFA Rules not processed for user `faec033965cd426aba200d8c50e6f27d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:03.632357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:03.641492 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2344/4706] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:03.646759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:03.660889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3825d3-5b39-4618-a9bd-d05c8bb0f482 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:03.672785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:03.673538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.673823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.675193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.676572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:create_trust()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:03.678667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:03.818481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2363/4707] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:03 2022] PUT /identity/v3/projects/fc93689736c14e8dbfd8d32885abdbb8/users/da7f3b0109eb45148e88b3e7d5c2a833/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:03.818481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:03.818481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:03.818481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:03.863892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] MFA Rules not processed for user `da7f3b0109eb45148e88b3e7d5c2a833`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:03.866102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:03.993510 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2345/4708] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:48:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:03.995756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.001061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.026347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2364/4709] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:04.027969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.033258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed59a4d-785c-48a2-a83c-8c86f05f2a83 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.106812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6d5c-b89a-41da-8725-25f8926194c0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.112545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.113545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.114739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.115247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.133583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.133583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.133583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.133583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] PATH_INFO: `/v3/projects/724e20d4dc92442793890056ba718eda` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.133934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724e20d4dc92442793890056ba718eda)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.134014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:get_trust(trust_id=bf13170b9c7b416dac75e0a584d21219)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.134097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.134173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b1945-ad98-4081-bcf9-082426675cd0 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.142054 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2365/4710] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219 => generated 858 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:04.143850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.144350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.145103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.170194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] MFA Rules not processed for user `da7f3b0109eb45148e88b3e7d5c2a833`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:04.172022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.185259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2366/4711] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:04.186316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.198260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a185-8dbe-4ae5-b4ff-c3859280aff6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.205042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.206157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.227616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.227616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.227616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=bf13170b9c7b416dac75e0a584d21219)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.227616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.227616 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2367/4712] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:04.228277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.235316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.325608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d755c3e-8640-48a4-87ea-92129fe982e3 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.331652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.331911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.332192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.332465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.342120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.343738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.355877 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2368/4713] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:04.356611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.369332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a947550-2c32-49a0-9ac3-cbe48d0a3ce7 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.390094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.390772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.391055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.391343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/241b55251f514abdb82ca3256c97ffa7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.394284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:04.413379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bf13170b9c7b416dac75e0a584d21219, role_id=241b55251f514abdb82ca3256c97ffa7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.414864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.415761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724e20d4dc92442793890056ba718eda', 'request_id': 'req-2fd72ba4-b08f-4897-9d5c-e99affa13729'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:04.426443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724e20d4dc92442793890056ba718eda', 'request_id': 'req-2fd72ba4-b08f-4897-9d5c-e99affa13729'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:04.448467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2369/4714] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/241b55251f514abdb82ca3256c97ffa7 => generated 243 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:04.449449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.465354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02294e4e-26e7-4a7f-9a66-9be07a5b20da tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.567522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.568199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.568474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.568772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/241b55251f514abdb82ca3256c97ffa7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.581270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bf13170b9c7b416dac75e0a584d21219, role_id=241b55251f514abdb82ca3256c97ffa7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.583660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724e20d4dc92442793890056ba718eda', 'request_id': 'req-2fd72ba4-b08f-4897-9d5c-e99affa13729'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:04.596222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.604785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] The token cache is being invalidate because project 724e20d4dc92442793890056ba718eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:04.605087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:04.606714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2fd72ba4-b08f-4897-9d5c-e99affa13729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:04.616345 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2346/4715] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:03 2022] DELETE /identity/v3/projects/724e20d4dc92442793890056ba718eda => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:04.619965 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2370/4716] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:04 2022] HEAD /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/241b55251f514abdb82ca3256c97ffa7 => generated 0 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 02 12:48:04.620288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61062d9-43c6-4b51-bdac-d44dee4450c2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.620288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61062d9-43c6-4b51-bdac-d44dee4450c2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.620288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61062d9-43c6-4b51-bdac-d44dee4450c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.622918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.625875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.658722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdbe0-83d7-4780-b38e-a4522b352d79 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.671991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.672696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.672974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.673244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/a422a9e1c7a84c76b55e5101aff3896e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.676054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d61062d9-43c6-4b51-bdac-d44dee4450c2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:04.677581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d61062d9-43c6-4b51-bdac-d44dee4450c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.693814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bf13170b9c7b416dac75e0a584d21219, role_id=a422a9e1c7a84c76b55e5101aff3896e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.704715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Could not find role: a422a9e1c7a84c76b55e5101aff3896e.: keystone.exception.RoleNotFound: Could not find role: a422a9e1c7a84c76b55e5101aff3896e. Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:04.724178 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a422a9e1c7a84c76b55e5101aff3896e. Nov 02 12:48:04.725312 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:04.725865 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2371/4717] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/a422a9e1c7a84c76b55e5101aff3896e => generated 110 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:04.733582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.758986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e904f40-24d2-48d5-b179-fc5c6f5c3838 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.768468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.769543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.769543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.769779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/a422a9e1c7a84c76b55e5101aff3896e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.784279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:get_role_for_trust(trust_id=bf13170b9c7b416dac75e0a584d21219, role_id=a422a9e1c7a84c76b55e5101aff3896e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.786792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Could not find role: a422a9e1c7a84c76b55e5101aff3896e.: keystone.exception.RoleNotFound: Could not find role: a422a9e1c7a84c76b55e5101aff3896e. Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:04.811893 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a422a9e1c7a84c76b55e5101aff3896e. Nov 02 12:48:04.821137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:04.821137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2372/4718] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:04 2022] HEAD /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219/roles/a422a9e1c7a84c76b55e5101aff3896e => generated 0 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 02 12:48:04.822490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.843909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09013060-fccd-4cf8-acb4-348bbbfa121a tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.851340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2347/4719] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:04.861618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.862063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.862494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.869399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.869857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.870011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.870176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.882063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorizing `identity:delete_trust(trust_id=bf13170b9c7b416dac75e0a584d21219)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.883671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:04.931203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:04.934527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:04.952951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2348/4720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:04.955341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:04.970415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cda717-41ac-485d-a91d-8a1be6f1c56a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:04.981715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:04.982476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:04.982824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:04.983395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:04.985982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:04.986348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:04.988062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.022122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2349/4721] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:05.043386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'bf13170b9c7b416dac75e0a584d21219', 'request_id': 'req-2efbd9a4-9f53-4f59-8119-a142fa449569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:05.050824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.073981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3734467-2116-4538-ae93-e1c718f34814 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.079690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.080439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.080849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.081201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.082356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.084734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.163878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bf13170b9c7b416dac75e0a584d21219', 'request_id': 'req-2efbd9a4-9f53-4f59-8119-a142fa449569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:05.164796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'bf13170b9c7b416dac75e0a584d21219', 'request_id': 'req-2efbd9a4-9f53-4f59-8119-a142fa449569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:05.173166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2373/4722] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:48:04 2022] DELETE /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:05.177071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.181912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:05.208037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbd9a4-9f53-4f59-8119-a142fa449569 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.226821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faec033965cd426aba200d8c50e6f27d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab6f3a2da297430f8877b2820d4922c2', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-553166840', 'tempest-DelegatedRole-131128356'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.232377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.232377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.232377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] PATH_INFO: `/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Could not find trust: bf13170b9c7b416dac75e0a584d21219.: keystone.exception.TrustNotFound: Could not find trust: bf13170b9c7b416dac75e0a584d21219. Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Nov 02 12:48:05.243670 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: bf13170b9c7b416dac75e0a584d21219. Nov 02 12:48:05.244781 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:05.245606 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2374/4723] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:05 2022] GET /identity/v3/OS-TRUST/trusts/bf13170b9c7b416dac75e0a584d21219 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:48:05.250014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.283370 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2350/4724] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:05 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:05.284502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.286822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:05.290018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:05.398485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c8f3ac-c7aa-43cf-8d00-61a99a714e50 tempest-TrustsV3TestJSON-1790777864 tempest-user-1456486739] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.425263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e7b1-faba-45e1-8a11-c2d07d7120eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.431411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.432455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.432769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.433075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.433778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.436004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.479524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.479524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.479524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.479946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/a422a9e1c7a84c76b55e5101aff3896e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.482007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a422a9e1c7a84c76b55e5101aff3896e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.483646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.597239 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2351/4725] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:05 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:05.602049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.612392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94761a91-8cd9-4967-81b7-a6882899e664 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.619399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.619632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.619737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.620110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.620673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.622286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.644750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2352/4726] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:05 2022] GET /identity/v3/roles => generated 1891 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:05.646357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.657601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a23d9-2041-45eb-bb9b-56839276cc2c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.663616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.664232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.664527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.664803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.665445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.667045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.696369 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2353/4727] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:05 2022] GET /identity/v3/roles => generated 1891 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:48:05.697853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.710083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a156cad-1ee4-4ab9-9fb0-f6ce611233ca admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:05.715597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:05.717381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.717725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.718254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] PATH_INFO: `/v3/projects/50dbedb7dffd4f67adfc30507afc0b98/users/c97d1f9cf2384ad7baf02cfd017430d2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.738875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50dbedb7dffd4f67adfc30507afc0b98, user_id=c97d1f9cf2384ad7baf02cfd017430d2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:05.742533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b024a3c-16de-41e6-b4ed-f9edb6f69654 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:05.845317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role a422a9e1c7a84c76b55e5101aff3896e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:05.845317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:05.845317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:05.846134 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2375/4728] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:05 2022] DELETE /identity/v3/roles/a422a9e1c7a84c76b55e5101aff3896e => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:05.850260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:05.851869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:05.904012 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2354/4729] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:05 2022] PUT /identity/v3/projects/50dbedb7dffd4f67adfc30507afc0b98/users/c97d1f9cf2384ad7baf02cfd017430d2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:05.905966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:05.906352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:05.906637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:05.931590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:05.933133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:05.987151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dc47c-52e9-4545-bdc6-805594522d3b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:06.099862 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2355/4730] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:06.103098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:06.104124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:06.104806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:06.105302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/241b55251f514abdb82ca3256c97ffa7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:06.107183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=241b55251f514abdb82ca3256c97ffa7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:06.109360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:06.166710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:06.169258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:06.299030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9660121-d05f-4e81-bdb5-fe3e1ab596ee None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:06.303861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:06.304498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:06.304803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:06.305086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:06.320841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:06.322381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:06.339081 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2356/4731] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:06.353556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 241b55251f514abdb82ca3256c97ffa7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:06.353556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.353556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.354992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2376/4732] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:05 2022] DELETE /identity/v3/roles/241b55251f514abdb82ca3256c97ffa7 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:06.359115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:06.373308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac9cba-a9c2-46b2-a8f5-92ad99cea108 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:06.470384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:06.471366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:06.471723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:06.472147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/faec033965cd426aba200d8c50e6f27d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:06.474337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=faec033965cd426aba200d8c50e6f27d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:06.476588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:06.539985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:06.652628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faec033965cd426aba200d8c50e6f27d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.757133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faec033965cd426aba200d8c50e6f27d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.778438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faec033965cd426aba200d8c50e6f27d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.779266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faec033965cd426aba200d8c50e6f27d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.780847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faec033965cd426aba200d8c50e6f27d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:06.803371 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2357/4733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:06 2022] DELETE /identity/v3/users/faec033965cd426aba200d8c50e6f27d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:06.805482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:06.810699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:06.827089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867d82e-df8e-490f-ba24-3df16c44337f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:06.913336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:06.914529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:06.915052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:06.915577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/ab6f3a2da297430f8877b2820d4922c2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:06.918292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab6f3a2da297430f8877b2820d4922c2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:06.920883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:07.378869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:07.459015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6f3a2da297430f8877b2820d4922c2', 'request_id': 'req-af6d54ee-0043-46a6-93b6-dc639ed462ce'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:07.468015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6f3a2da297430f8877b2820d4922c2', 'request_id': 'req-af6d54ee-0043-46a6-93b6-dc639ed462ce'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:07.479459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6f3a2da297430f8877b2820d4922c2', 'request_id': 'req-af6d54ee-0043-46a6-93b6-dc639ed462ce'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:07.666790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project ab6f3a2da297430f8877b2820d4922c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:07.667982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:07.669224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:07.677813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:07.679890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:07.682081 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2377/4734] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:06 2022] DELETE /identity/v3/projects/ab6f3a2da297430f8877b2820d4922c2 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:07.683870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:07.697519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:07.705667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c4bb-36d4-4099-a171-a7e7ded6918e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:07.885405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d54ee-0043-46a6-93b6-dc639ed462ce tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:07.894648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:07.896152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:07.896976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:07.897439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:07.898632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:07.899462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:07.899841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:07.900218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:07.900341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:07.901137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:07.903317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:07.920014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:07.922655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:07.961653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2378/4735] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:08.058319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2358/4736] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:48:07 2022] POST /identity/v3/projects => generated 327 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:08.062890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:08.065923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:08.100343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b04a4-6a41-4aeb-994e-e34fb181da04 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:08.244974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:08.246535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:08.250882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:08.250882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:08.250882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:08.252027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:08.375901 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2379/4737] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:08 2022] POST /identity/v3/users => generated 416 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:08.381093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:08.399464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7d7e3-95e6-4b1e-8064-4b1592ed7508 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:08.410413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:08.411339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:08.411831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:08.412314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:08.413247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:08.418162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:08.557797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2359/4738] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:08 2022] POST /identity/v3/roles => generated 244 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:08.562241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:08.580765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b11fb-47fe-4257-9ab9-44cb6c2b7056 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:08.591241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:08.592069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:08.592472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:08.592870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:08.593662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:08.597069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:08.706077 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2380/4739] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:08 2022] POST /identity/v3/roles => generated 245 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:08.710289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:08.727300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9945e13-973e-4ac9-9360-cc9544a66262 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:08.740584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:08.742575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:08.742575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:08.742979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/14b6ee9e88344367997a434b725d075d/users/79695fcc49df48a8acfc7e2a03486be7/roles/b3ae0f240ad047ed84abc531b63af0d6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:08.782809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14b6ee9e88344367997a434b725d075d, user_id=79695fcc49df48a8acfc7e2a03486be7, role_id=b3ae0f240ad047ed84abc531b63af0d6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:08.787516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:08.871585 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2360/4740] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:08 2022] PUT /identity/v3/projects/14b6ee9e88344367997a434b725d075d/users/79695fcc49df48a8acfc7e2a03486be7/roles/b3ae0f240ad047ed84abc531b63af0d6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:08.877173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:08.892375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf03d2-78f6-4bca-b1e0-49dea70333d1 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:09.023820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:09.025486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.025990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.026669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/14b6ee9e88344367997a434b725d075d/users/79695fcc49df48a8acfc7e2a03486be7/roles/ea841b2d0f77416f9b286269ee4f2a99` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.029800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=14b6ee9e88344367997a434b725d075d, user_id=79695fcc49df48a8acfc7e2a03486be7, role_id=ea841b2d0f77416f9b286269ee4f2a99)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:09.033156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5a22a-cd9c-452b-8c1c-c215343f85ea tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:09.153992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:09.161609 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2381/4741] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:08 2022] PUT /identity/v3/projects/14b6ee9e88344367997a434b725d075d/users/79695fcc49df48a8acfc7e2a03486be7/roles/ea841b2d0f77416f9b286269ee4f2a99 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:09.175116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688cb7f-eec1-4fab-b183-c8331bd6c295 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:09.330217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:09.334077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.334510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.336729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.342015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:09.344925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b01d0-f290-4019-b36c-8286bbdb6a93 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:09.403134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2361/4742] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:09 2022] GET /identity/v3/users => generated 9505 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:09.406508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.408725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.409268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.482533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] MFA Rules not processed for user `79695fcc49df48a8acfc7e2a03486be7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:09.491656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:09.629537 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2382/4743] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:09.633146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.633433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.633708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.667535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] MFA Rules not processed for user `79695fcc49df48a8acfc7e2a03486be7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:09.669183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:09.690902 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2362/4744] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:09.700669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:09.707411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5646d-f9a1-4d4a-b876-9322314171cd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:09.725895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79695fcc49df48a8acfc7e2a03486be7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '14b6ee9e88344367997a434b725d075d', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-15330346', 'tempest-DelegatedRole-1910530126'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:09.726542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.726972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.727253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.731473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] RBAC: Authorizing `identity:create_trust()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:09.734062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:09.753428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Nov 02 12:48:09.912922 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise ValueError(str(e)) Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Nov 02 12:48:09.914288 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:09.915807 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:09.920558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2383/4745] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:48:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 223 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:09.922362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:09.954380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d612f-01a7-47f8-b4da-b1cffb51705c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:09.961211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:09.964989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:09.964989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:09.964989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/ea841b2d0f77416f9b286269ee4f2a99` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:09.968768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ea841b2d0f77416f9b286269ee4f2a99)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:09.986736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:10.228186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:10.305861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role ea841b2d0f77416f9b286269ee4f2a99 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:10.308256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:10.309204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:10.313426 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2363/4746] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:09 2022] DELETE /identity/v3/roles/ea841b2d0f77416f9b286269ee4f2a99 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:10.318189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:10.321047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:10.363086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915c313-0e53-467d-8f4f-6c874b79343e tempest-TrustsV3TestJSON-43856510 tempest-user-1806394294] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:10.467208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:10.467890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:10.468174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:10.468451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/b3ae0f240ad047ed84abc531b63af0d6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:10.473916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b3ae0f240ad047ed84abc531b63af0d6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:10.476926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:10.748859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role b3ae0f240ad047ed84abc531b63af0d6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:10.749664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:10.750614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:10.755319 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2384/4747] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:10 2022] DELETE /identity/v3/roles/b3ae0f240ad047ed84abc531b63af0d6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:10.764614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:10.784313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611dd9-cccf-44c5-a2cf-a3b4619ff989 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:10.886879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:10.888693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:10.889962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:10.890482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/79695fcc49df48a8acfc7e2a03486be7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:10.892892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=79695fcc49df48a8acfc7e2a03486be7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:10.896364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:11.047525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79695fcc49df48a8acfc7e2a03486be7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.191381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79695fcc49df48a8acfc7e2a03486be7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.222656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79695fcc49df48a8acfc7e2a03486be7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.224071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79695fcc49df48a8acfc7e2a03486be7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.225869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79695fcc49df48a8acfc7e2a03486be7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.250405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2364/4748] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:10 2022] DELETE /identity/v3/users/79695fcc49df48a8acfc7e2a03486be7 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:11.255285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:11.258069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:11.282345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60056e-e172-40a2-a274-3c53c55c410d tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:11.393852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:11.395516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:11.396066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:11.397647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/14b6ee9e88344367997a434b725d075d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:11.399267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=14b6ee9e88344367997a434b725d075d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:11.407097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:11.604598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b6ee9e88344367997a434b725d075d', 'request_id': 'req-47e136c3-e1fc-42c8-a365-b5c3b882a91e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.620150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b6ee9e88344367997a434b725d075d', 'request_id': 'req-47e136c3-e1fc-42c8-a365-b5c3b882a91e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.650484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b6ee9e88344367997a434b725d075d', 'request_id': 'req-47e136c3-e1fc-42c8-a365-b5c3b882a91e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.655404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:11.788942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project 14b6ee9e88344367997a434b725d075d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:11.789280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.790004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:11.792391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2385/4749] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:11 2022] DELETE /identity/v3/projects/14b6ee9e88344367997a434b725d075d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:11.798170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:11.800452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:11.864894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f393015-a99e-4f33-9387-87173caca8a8 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:12.011852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:12.013461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.013925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.014361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.015485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:12.017669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee227d-7c4e-4784-a16e-a0738950cb5b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:12.210193 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2365/4750] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:48:11 2022] POST /identity/v3/projects => generated 328 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:12.211007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:12.213006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:12.225350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8e34b-1809-47ae-8d9d-ee8b754fae5b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.225906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8e34b-1809-47ae-8d9d-ee8b754fae5b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.226339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8e34b-1809-47ae-8d9d-ee8b754fae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.234927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e136c3-e1fc-42c8-a365-b5c3b882a91e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:12.271510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-45f8e34b-1809-47ae-8d9d-ee8b754fae5b None None] MFA Rules not processed for user `e2be048b612348bc8645e2ff12890db6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:12.274083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-45f8e34b-1809-47ae-8d9d-ee8b754fae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:12.360676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:12.361703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.362236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.362902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.363718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:12.365899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:12.383745 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2366/4751] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:12.393851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.394497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.395115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.437534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] MFA Rules not processed for user `e2be048b612348bc8645e2ff12890db6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:12.439138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:12.456671 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2367/4752] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:12.556347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2386/4753] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:12 2022] POST /identity/v3/users => generated 416 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:12.558284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:12.578351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fa2d2-7c73-42b5-af9a-ce9800ade86e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:12.585098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:12.585973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.586420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.587072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.589703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:12.591559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:12.713569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2368/4754] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:12 2022] POST /identity/v3/roles => generated 244 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:12.717762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:12.737709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd40b-9ec6-48ab-ac0c-7400f9d0182c tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:12.747027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:12.747675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.748005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.748335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.749553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:12.751432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:12.826394 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2387/4755] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:12 2022] POST /identity/v3/roles => generated 245 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:12.827627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:12.848389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1db94-a803-412b-a613-c2eba4334288 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:12.861231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:12.861231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:12.861231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:12.861599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a/roles/acbe12c94efa4fe1bea16ce666e8c014` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:12.890466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=441fc7d650f4412f9bcb8ddc1f1b0a71, user_id=b5ba4a54a3da4f8d8c4636fa5bec2c7a, role_id=acbe12c94efa4fe1bea16ce666e8c014)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:12.893147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:12.975181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:12.999816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:13.007418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2369/4756] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:12 2022] PUT /identity/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a/roles/acbe12c94efa4fe1bea16ce666e8c014 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:13.026891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba25b9-7509-4693-8584-3e1df36fb58e tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:13.289061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:13.293000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:13.296769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:13.297749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a/roles/343117587dc042b8b4ae4be9e210365a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:13.317048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=441fc7d650f4412f9bcb8ddc1f1b0a71, user_id=b5ba4a54a3da4f8d8c4636fa5bec2c7a, role_id=343117587dc042b8b4ae4be9e210365a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:13.322175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713efd57-29fb-4736-a6eb-923c304309cc tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:13.432949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:13.468377 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2388/4757] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:12 2022] PUT /identity/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a/roles/343117587dc042b8b4ae4be9e210365a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:13.473224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:13.490360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe6500-5571-4d7a-bc21-95284dd070ad tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:13.630851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:13.633380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:13.634411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:13.634805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:13.635178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:13.635983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:13.638246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c317f05-20f1-4878-b09b-2a3e155c6c0f tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:13.700981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2370/4758] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:13 2022] GET /identity/v3/users => generated 9505 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:13.701201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f03ab-2519-40a2-ab80-7369267ecb42 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:13.701647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f03ab-2519-40a2-ab80-7369267ecb42 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:13.701647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f03ab-2519-40a2-ab80-7369267ecb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:13.707990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:13.708803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:13.710003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:13.735801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c12f03ab-2519-40a2-ab80-7369267ecb42 None None] MFA Rules not processed for user `3ccf6b6cde274e6fbbda8f3c92808415`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:13.737081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c12f03ab-2519-40a2-ab80-7369267ecb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:13.820055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] MFA Rules not processed for user `b5ba4a54a3da4f8d8c4636fa5bec2c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:13.824549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:13.886483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2389/4759] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:13.898484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45a29-f58b-4b1c-b712-6da0c10c3289 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:13.898842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45a29-f58b-4b1c-b712-6da0c10c3289 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:13.899034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f45a29-f58b-4b1c-b712-6da0c10c3289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:13.970245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-25f45a29-f58b-4b1c-b712-6da0c10c3289 None None] MFA Rules not processed for user `3ccf6b6cde274e6fbbda8f3c92808415`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:13.971646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-25f45a29-f58b-4b1c-b712-6da0c10c3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:13.988528 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2390/4760] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:14.013496 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2371/4761] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:14.029805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.030112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.030510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.062825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] MFA Rules not processed for user `b5ba4a54a3da4f8d8c4636fa5bec2c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:14.064550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:14.079909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.092390 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2391/4762] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:14.097164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef94ce-795f-4c3b-b26e-b3991e4c5dd8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.104214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.105524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.105908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.106329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.107120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:create_trust()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.108528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.273153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.275333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:14.412005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2372/4763] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:48:14 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:14.415552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.458629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03293f5e-e1d5-4742-a73e-3a59d82e2e0f tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.470645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.471363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.471644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.473572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.490085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:get_trust(trust_id=c174932a81ca4a1993752d444797f944)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.491973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.508899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2373/4764] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:14 2022] GET /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944 => generated 834 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:14.510682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.534615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714a59-d101-48b4-a42c-68aedbceeaf1 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.539875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.540770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.541197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.542351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.550954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=c174932a81ca4a1993752d444797f944)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.553382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.569523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2374/4765] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:48:14 2022] GET /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles => generated 371 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:14.574030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.585774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d64a4e-3391-486c-81a3-205c6eeebe2a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.587754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1888c-3a04-4324-a474-0ce48df5f9fe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.595118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.596035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.596421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.596880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/acbe12c94efa4fe1bea16ce666e8c014` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.606553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c174932a81ca4a1993752d444797f944, role_id=acbe12c94efa4fe1bea16ce666e8c014)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.608450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.609292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.610546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.610888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.611173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.625083 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2375/4766] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:14 2022] GET /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/acbe12c94efa4fe1bea16ce666e8c014 => generated 244 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:14.626337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.628289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.633332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.639490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b06385-3b09-4956-8c63-fe9add751684 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.646888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.647902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.647902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.648302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/acbe12c94efa4fe1bea16ce666e8c014` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.659186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c174932a81ca4a1993752d444797f944, role_id=acbe12c94efa4fe1bea16ce666e8c014)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.659514 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2392/4767] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:14.661050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.675165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2376/4768] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:14 2022] HEAD /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/acbe12c94efa4fe1bea16ce666e8c014 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 02 12:48:14.679631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.696053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6e37d-99a1-435c-ae65-875ccbb61f76 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.714531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.717475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.720137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.720137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/343117587dc042b8b4ae4be9e210365a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.761828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c174932a81ca4a1993752d444797f944, role_id=343117587dc042b8b4ae4be9e210365a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.764221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Could not find role: 343117587dc042b8b4ae4be9e210365a.: keystone.exception.RoleNotFound: Could not find role: 343117587dc042b8b4ae4be9e210365a. Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:14.782899 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 343117587dc042b8b4ae4be9e210365a. Nov 02 12:48:14.784238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:14.787864 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2393/4769] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:14 2022] GET /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/343117587dc042b8b4ae4be9e210365a => generated 110 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:14.788791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.810562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a97e2-a37d-42c5-bdc4-f5d4e97c805a tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.825546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.826228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `HEAD` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.826506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.826778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/343117587dc042b8b4ae4be9e210365a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.836051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:get_role_for_trust(trust_id=c174932a81ca4a1993752d444797f944, role_id=343117587dc042b8b4ae4be9e210365a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.837391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Could not find role: 343117587dc042b8b4ae4be9e210365a.: keystone.exception.RoleNotFound: Could not find role: 343117587dc042b8b4ae4be9e210365a. Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:14.855285 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 343117587dc042b8b4ae4be9e210365a. Nov 02 12:48:14.859277 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:14.859277 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2377/4770] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:14 2022] HEAD /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944/roles/343117587dc042b8b4ae4be9e210365a => generated 0 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:14.864095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:14.876964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f213e-6853-493f-abdb-965570dd087c tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:14.884037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:14.885201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:14.885800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:14.886289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:14.897602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorizing `identity:delete_trust(trust_id=c174932a81ca4a1993752d444797f944)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:14.899484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:15.001834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c174932a81ca4a1993752d444797f944', 'request_id': 'req-1dfb52d1-1706-4fa9-be06-30f590adcd59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.083337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c174932a81ca4a1993752d444797f944', 'request_id': 'req-1dfb52d1-1706-4fa9-be06-30f590adcd59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.084035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c174932a81ca4a1993752d444797f944', 'request_id': 'req-1dfb52d1-1706-4fa9-be06-30f590adcd59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.092788 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2394/4771] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:48:14 2022] DELETE /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:15.096759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:15.099713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:15.130899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d4a75-945d-4cb6-8544-274db1bc93a6 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:15.143266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211a709-ef02-4c19-ae4b-b7d5e73cabba tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1679480231', 'tempest-NotDelegatedRole-91231543'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:15.143967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a709-ef02-4c19-ae4b-b7d5e73cabba tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.144242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a709-ef02-4c19-ae4b-b7d5e73cabba tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.144545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a709-ef02-4c19-ae4b-b7d5e73cabba tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] PATH_INFO: `/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-4211a709-ef02-4c19-ae4b-b7d5e73cabba tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Could not find trust: c174932a81ca4a1993752d444797f944.: keystone.exception.TrustNotFound: Could not find trust: c174932a81ca4a1993752d444797f944. Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Nov 02 12:48:15.167413 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c174932a81ca4a1993752d444797f944. Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:15.170543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2378/4772] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:15 2022] GET /identity/v3/OS-TRUST/trusts/c174932a81ca4a1993752d444797f944 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:15.174172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:15.175617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:15.196107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb52d1-1706-4fa9-be06-30f590adcd59 tempest-TrustsV3TestJSON-776915630 tempest-user-1485645831] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:15.201697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:15.202592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.202945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.203284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/343117587dc042b8b4ae4be9e210365a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.205753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=343117587dc042b8b4ae4be9e210365a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:15.207431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:15.293562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.293915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.294110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:15.303485 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:15.304547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:15.306243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:15.314806 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2379/4773] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:15.531931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 343117587dc042b8b4ae4be9e210365a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:15.532228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.535542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74223cce-1d3c-4a64-ad27-43610c9e57c9 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.542455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:15.543352 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2395/4774] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:15 2022] DELETE /identity/v3/roles/343117587dc042b8b4ae4be9e210365a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:15.544285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:15.644451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:15.651445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:15.652595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.652861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.653143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/acbe12c94efa4fe1bea16ce666e8c014` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.654654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=acbe12c94efa4fe1bea16ce666e8c014)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:15.657061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:15.712816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:15.807671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093be2-f5a0-41ac-97c3-8d302a794135 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.808148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093be2-f5a0-41ac-97c3-8d302a794135 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.808272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02093be2-f5a0-41ac-97c3-8d302a794135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-02093be2-f5a0-41ac-97c3-8d302a794135 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:15.816301 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:15.817462 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:15.831990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2396/4775] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:15.870850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:15.870850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:15.870850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:15.910241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] MFA Rules not processed for user `3ccf6b6cde274e6fbbda8f3c92808415`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:15.910241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:15.917600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role acbe12c94efa4fe1bea16ce666e8c014 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:15.917901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.918920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:15.921079 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2380/4776] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:15 2022] DELETE /identity/v3/roles/acbe12c94efa4fe1bea16ce666e8c014 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:15.926582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:15.930367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:16.122645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2397/4777] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:16.136329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558134dd-3ea4-47d5-81e6-5db0bdbec6c0 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:16.145283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:16.146312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:16.146822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:16.147260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:16.150558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b5ba4a54a3da4f8d8c4636fa5bec2c7a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:16.154945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:16.371539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.465760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.492408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.493585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.494569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ba4a54a3da4f8d8c4636fa5bec2c7a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.511303 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2381/4778] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:15 2022] DELETE /identity/v3/users/b5ba4a54a3da4f8d8c4636fa5bec2c7a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:16.525450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:16.547150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26efe9-cacc-4cfd-b461-1d9d75ee5fa4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:16.616112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:16.616689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:16.616969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:16.617258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:16.618604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=441fc7d650f4412f9bcb8ddc1f1b0a71)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:16.620809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:16.884844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'request_id': 'req-1374f414-adb5-49f8-a4a3-50786ff41d84'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.903600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'request_id': 'req-1374f414-adb5-49f8-a4a3-50786ff41d84'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:16.928132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441fc7d650f4412f9bcb8ddc1f1b0a71', 'request_id': 'req-1374f414-adb5-49f8-a4a3-50786ff41d84'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:17.036570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project 441fc7d650f4412f9bcb8ddc1f1b0a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:17.036896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:17.037944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:17.040510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2398/4779] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:16 2022] DELETE /identity/v3/projects/441fc7d650f4412f9bcb8ddc1f1b0a71 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:17.047366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:17.050085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:17.089448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab9a91-81f7-408f-b44a-d3fa036a4c80 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:17.167394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:17.168403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.171875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.171875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.171875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:17.172723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007007c1-56d8-4058-bb8f-fd938746a911 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:17.293264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2382/4780] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/projects => generated 329 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:17.297519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:17.299404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:17.322025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374f414-adb5-49f8-a4a3-50786ff41d84 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:17.342178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:17.367438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36293-59e7-4272-9499-45082de632f5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.367857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36293-59e7-4272-9499-45082de632f5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.368739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d36293-59e7-4272-9499-45082de632f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e2d36293-59e7-4272-9499-45082de632f5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:17.378012 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:17.379474 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:17.398219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2383/4781] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:48:17.445516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.446146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.446668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.482442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] MFA Rules not processed for user `3ccf6b6cde274e6fbbda8f3c92808415`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:17.486666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:17.533188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:17.534156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.534663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.535359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.536305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:17.544383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:17.599475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2384/4782] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:17.688755 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2399/4783] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/users => generated 416 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:17.697776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:17.711785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc215c7-ad45-41c2-918c-24da7dc14ea6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:17.717851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:17.718585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.719116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.719240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.719933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:17.740369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:17.767821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:17.768990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:17.869401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2385/4784] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/roles => generated 244 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:17.874800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:17.896381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912c729-b87c-4e4c-818e-f4b9fc43f886 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:17.908804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:17.909492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.909851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.910036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.910726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:17.913690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:17.921733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0315792-e00b-42f9-aedb-80c803d46216 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:17.934992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:17.937611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:17.938240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:17.938824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] PATH_INFO: `/v3/users/f9d1f6e602604fb0bc748ba05f99d502` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:17.940507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d1f6e602604fb0bc748ba05f99d502)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:17.943836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:17.989401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2386/4785] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:17 2022] POST /identity/v3/roles => generated 247 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:17.995585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:18.014898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef65c5b-194e-4999-97c2-28cafa95a1de tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:18.021641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:18.022331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.022616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.022893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3/users/6371b500aa8c46be8486c05dc27468ef/roles/9888c7cd577f4bb2ac944c408ffc0e11` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.046944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a4bc9ec094a4b468ba565fea2242bc3, user_id=6371b500aa8c46be8486c05dc27468ef, role_id=9888c7cd577f4bb2ac944c408ffc0e11)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:18.051029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:18.142166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2387/4786] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:17 2022] PUT /identity/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3/users/6371b500aa8c46be8486c05dc27468ef/roles/9888c7cd577f4bb2ac944c408ffc0e11 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:18.147111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:18.232013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d1f6e602604fb0bc748ba05f99d502'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:18.291593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fe9fa-bad9-4810-a744-cf842da87c4b tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:18.298165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:18.298992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.299363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.299702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3/users/6371b500aa8c46be8486c05dc27468ef/roles/1079efbf3d164145967862cbc3f51543` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.303714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9a4bc9ec094a4b468ba565fea2242bc3, user_id=6371b500aa8c46be8486c05dc27468ef, role_id=1079efbf3d164145967862cbc3f51543)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:18.306716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:18.362921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d1f6e602604fb0bc748ba05f99d502'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:18.385908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d1f6e602604fb0bc748ba05f99d502'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:18.401059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d1f6e602604fb0bc748ba05f99d502'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:18.402724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c38f6b17-f282-41fc-8e16-e787710a8a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d1f6e602604fb0bc748ba05f99d502'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:18.415951 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2400/4787] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:17 2022] DELETE /identity/v3/users/f9d1f6e602604fb0bc748ba05f99d502 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:18.420515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.420898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.421244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.449923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2388/4788] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:18 2022] PUT /identity/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3/users/6371b500aa8c46be8486c05dc27468ef/roles/1079efbf3d164145967862cbc3f51543 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:18.453813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:18.459572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:18.460596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:18.461140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:18.611571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2401/4789] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:18.617991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4cf3e-910d-4917-a1a4-4d99edafea47 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:18.626403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:18.628222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.628222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.629602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.633519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:18.633519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4187d-b062-4125-b444-cb467684b174 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:18.640892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:18.642706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:18.680342 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2389/4790] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:18 2022] GET /identity/v3/users => generated 9214 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:18.686604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6094-0128-43dd-96cb-2cc8d8d1cee1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.687039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6094-0128-43dd-96cb-2cc8d8d1cee1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.687436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e6094-0128-43dd-96cb-2cc8d8d1cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.739827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b1174-5c82-4806-978c-23bea08c7619 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:18.753108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:18.756592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.756986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.758142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.776803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0a3e6094-0128-43dd-96cb-2cc8d8d1cee1 None None] MFA Rules not processed for user `6371b500aa8c46be8486c05dc27468ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:18.778192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a3e6094-0128-43dd-96cb-2cc8d8d1cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:18.778953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:18.781149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ad3e6-742e-46d2-91ad-4560050389fe service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:18.794186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2402/4791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:18.874435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2390/4792] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:18.881765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.882657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.883047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.920211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] MFA Rules not processed for user `6371b500aa8c46be8486c05dc27468ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:18.924047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:18.925159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:18.938125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2403/4793] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:18 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:18.941438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.941929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.942703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:18.943302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.952699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67258c-0070-45bf-8eff-433ae7934b7f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:18.953949 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:18.956028 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:18.958547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:18.959187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:18.959462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:18.960538 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2391/4794] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:18 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:18.972632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:18.972632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:create_trust()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:18.972632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.214881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.226839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2404/4795] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:48:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:19.231229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.236189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.237080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.237521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.237954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.243074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:19.248288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:get_trust(trust_id=baca6fa323e64d67baa3773cecace6d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.250071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.269641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.292708 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2392/4796] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:19 2022] GET /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0 => generated 835 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:19.294594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d839f-3939-449b-9f45-ce56c0d552ab tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.304930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.305604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.306889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.307145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.316402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=baca6fa323e64d67baa3773cecace6d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.319163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.337906 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2405/4797] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:48:19 2022] GET /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles => generated 371 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:19.339036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.350103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4cb92-0512-49f1-8487-563e3fe99f01 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.355621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.356394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.356917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.357260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/9888c7cd577f4bb2ac944c408ffc0e11` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.366484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:get_role_for_trust(trust_id=baca6fa323e64d67baa3773cecace6d0, role_id=9888c7cd577f4bb2ac944c408ffc0e11)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.368938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.386036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.396416 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2393/4798] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:19 2022] GET /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/9888c7cd577f4bb2ac944c408ffc0e11 => generated 244 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:48:19.399045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83ac3-0f2f-4f6d-b96a-e3bed90dbf48 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.403578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.404281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.404766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.405622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/9888c7cd577f4bb2ac944c408ffc0e11` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.413466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:get_role_for_trust(trust_id=baca6fa323e64d67baa3773cecace6d0, role_id=9888c7cd577f4bb2ac944c408ffc0e11)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.416127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.430447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.434277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2406/4799] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:19 2022] HEAD /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/9888c7cd577f4bb2ac944c408ffc0e11 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Nov 02 12:48:19.446344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd65dc-6368-40f2-8f8f-7ecb73115c6f tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.452685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.453353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.453629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.454142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/1079efbf3d164145967862cbc3f51543` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.466084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:get_role_for_trust(trust_id=baca6fa323e64d67baa3773cecace6d0, role_id=1079efbf3d164145967862cbc3f51543)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.468477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Could not find role: 1079efbf3d164145967862cbc3f51543.: keystone.exception.RoleNotFound: Could not find role: 1079efbf3d164145967862cbc3f51543. Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:19.481468 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1079efbf3d164145967862cbc3f51543. Nov 02 12:48:19.482927 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:48:19.487431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.495623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2394/4800] 10.222.0.64 () {58 vars in 1368 bytes} [Wed Nov 2 12:48:19 2022] GET /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/1079efbf3d164145967862cbc3f51543 => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:19.499273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b3d89-1e8c-463d-b777-9da55b70340d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.504203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.505423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `HEAD` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.505704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.512515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/1079efbf3d164145967862cbc3f51543` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.519041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:get_role_for_trust(trust_id=baca6fa323e64d67baa3773cecace6d0, role_id=1079efbf3d164145967862cbc3f51543)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.521602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Could not find role: 1079efbf3d164145967862cbc3f51543.: keystone.exception.RoleNotFound: Could not find role: 1079efbf3d164145967862cbc3f51543. Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Nov 02 12:48:19.536112 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1079efbf3d164145967862cbc3f51543. Nov 02 12:48:19.537516 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:19.539731 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2407/4801] 10.222.0.64 () {58 vars in 1369 bytes} [Wed Nov 2 12:48:19 2022] HEAD /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0/roles/1079efbf3d164145967862cbc3f51543 => generated 0 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Nov 02 12:48:19.543879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.554909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd588d3e-b688-4240-8996-175b12ca088d tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.559958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.561819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.561819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.561819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.570312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorizing `identity:delete_trust(trust_id=baca6fa323e64d67baa3773cecace6d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.571842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:19.710627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'baca6fa323e64d67baa3773cecace6d0', 'request_id': 'req-42d4ad65-f15a-4765-8d4b-2e224153dbe8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:19.836526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'baca6fa323e64d67baa3773cecace6d0', 'request_id': 'req-42d4ad65-f15a-4765-8d4b-2e224153dbe8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:19.837260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'baca6fa323e64d67baa3773cecace6d0', 'request_id': 'req-42d4ad65-f15a-4765-8d4b-2e224153dbe8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:19.848723 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2395/4802] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:48:19 2022] DELETE /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:19.853309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.856376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:19.880696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb9fb1-8960-46bb-9209-cc1174b7394b tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.884596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6371b500aa8c46be8486c05dc27468ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a4bc9ec094a4b468ba565fea2242bc3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1121260578', 'tempest-DelegatedRole-1838778500'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.885371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.888509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.889003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] PATH_INFO: `/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Could not find trust: baca6fa323e64d67baa3773cecace6d0.: keystone.exception.TrustNotFound: Could not find trust: baca6fa323e64d67baa3773cecace6d0. Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Nov 02 12:48:19.904620 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: baca6fa323e64d67baa3773cecace6d0. Nov 02 12:48:19.905958 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:19.913707 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2408/4803] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:48:19 2022] GET /identity/v3/OS-TRUST/trusts/baca6fa323e64d67baa3773cecace6d0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:48:19.920821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:19.920821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:19.944522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ad65-f15a-4765-8d4b-2e224153dbe8 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:19.957984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:19.958951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:19.959388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:19.959827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/1079efbf3d164145967862cbc3f51543` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:19.968686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1079efbf3d164145967862cbc3f51543)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:19.970711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:20.064698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:20.069015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:20.201322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c56c66-5fbf-4de4-b023-71aa64ccf1b4 tempest-TrustsV3TestJSON-1165137970 tempest-user-1067485307] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:20.215981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:20.217114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:20.218168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:20.218895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] PATH_INFO: `/v3/projects/c1ea0e13261a4a6790ff89a1b9302938` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:20.221529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ea0e13261a4a6790ff89a1b9302938)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:20.227756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:20.357237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 1079efbf3d164145967862cbc3f51543 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:20.358718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.386010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.389101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2396/4804] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:19 2022] DELETE /identity/v3/roles/1079efbf3d164145967862cbc3f51543 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:20.395034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:20.401542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:20.409246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ea0e13261a4a6790ff89a1b9302938', 'request_id': 'req-4de63628-6afa-4ed5-9772-3683b9b0f188'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.429395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ea0e13261a4a6790ff89a1b9302938', 'request_id': 'req-4de63628-6afa-4ed5-9772-3683b9b0f188'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.448728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ea0e13261a4a6790ff89a1b9302938', 'request_id': 'req-4de63628-6afa-4ed5-9772-3683b9b0f188'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.537281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0a636-6cc2-4ad9-b4ec-4ad679af8432 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:20.543647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:20.544306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:20.544683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:20.545011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/roles/9888c7cd577f4bb2ac944c408ffc0e11` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:20.546482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9888c7cd577f4bb2ac944c408ffc0e11)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:20.548356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:20.569271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] The token cache is being invalidate because project c1ea0e13261a4a6790ff89a1b9302938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:20.569271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.569271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.579453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2409/4805] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:20 2022] DELETE /identity/v3/projects/c1ea0e13261a4a6790ff89a1b9302938 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:20.583739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:20.586069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:20.752935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63628-6afa-4ed5-9772-3683b9b0f188 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:20.843157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invalidating the token cache because role 9888c7cd577f4bb2ac944c408ffc0e11 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:20.843566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.844412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:20.851111 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2397/4806] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:20 2022] DELETE /identity/v3/roles/9888c7cd577f4bb2ac944c408ffc0e11 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:20.852702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:20.855747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:20.889982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:20.890803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:20.892163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:20.892865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] PATH_INFO: `/v3/users/2c1418d4ea624d4d828f50be874d0b39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:20.894544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1418d4ea624d4d828f50be874d0b39)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:20.898127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:20.984999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aadf2-d043-47d5-b0c3-7a47cf0eb727 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:20.997625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:20.998812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:20.999782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:21.000268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/users/6371b500aa8c46be8486c05dc27468ef` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:21.001982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6371b500aa8c46be8486c05dc27468ef)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:21.005585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:21.193441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6371b500aa8c46be8486c05dc27468ef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.232015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1418d4ea624d4d828f50be874d0b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.291424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6371b500aa8c46be8486c05dc27468ef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.318610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6371b500aa8c46be8486c05dc27468ef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.321653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6371b500aa8c46be8486c05dc27468ef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.323554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6371b500aa8c46be8486c05dc27468ef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.342543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2398/4807] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:20 2022] DELETE /identity/v3/users/6371b500aa8c46be8486c05dc27468ef => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:21.343941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:21.350542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:21.396874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1418d4ea624d4d828f50be874d0b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.416380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1418d4ea624d4d828f50be874d0b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.425053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1418d4ea624d4d828f50be874d0b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.426077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1418d4ea624d4d828f50be874d0b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.450312 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2410/4808] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:20 2022] DELETE /identity/v3/users/2c1418d4ea624d4d828f50be874d0b39 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:21.451422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:21.459106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:21.462869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90b94-48ea-43d9-bc85-a1629043c1b2 tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:21.587405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:21.588276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:21.588943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:21.589682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] PATH_INFO: `/v3/users/df8f2e2918d74ad0b181080e10a45cbc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:21.591482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8f2e2918d74ad0b181080e10a45cbc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:21.594473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:21.609421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a3f7d-39d2-47d1-8e0c-4f7cf60bed4c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:21.621796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:21.623374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:21.623973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:21.624255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:21.624564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] PATH_INFO: `/v3/users/da7f3b0109eb45148e88b3e7d5c2a833` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:21.629259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da7f3b0109eb45148e88b3e7d5c2a833)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:21.635842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:21.842066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8f2e2918d74ad0b181080e10a45cbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.938266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8f2e2918d74ad0b181080e10a45cbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.971453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da7f3b0109eb45148e88b3e7d5c2a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.982841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8f2e2918d74ad0b181080e10a45cbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.983498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8f2e2918d74ad0b181080e10a45cbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:21.985515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8f2e2918d74ad0b181080e10a45cbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.016218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2399/4809] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:21 2022] DELETE /identity/v3/users/df8f2e2918d74ad0b181080e10a45cbc => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:22.017599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:22.019642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.074516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da7f3b0109eb45148e88b3e7d5c2a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.100328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da7f3b0109eb45148e88b3e7d5c2a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.116057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da7f3b0109eb45148e88b3e7d5c2a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.117658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f8ae148-99a3-4211-8c7e-8d7b37e4d459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da7f3b0109eb45148e88b3e7d5c2a833'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.134765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2411/4810] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:21 2022] DELETE /identity/v3/users/da7f3b0109eb45148e88b3e7d5c2a833 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:22.147892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1dd-06d1-4b11-830a-5c3c6613f29f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.147892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1dd-06d1-4b11-830a-5c3c6613f29f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.147892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b1dd-06d1-4b11-830a-5c3c6613f29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.170950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9b65fe-bac8-4803-b0f4-137a5ddaa0ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:22.173446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:22.182728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3fc4b1dd-06d1-4b11-830a-5c3c6613f29f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:22.186991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3fc4b1dd-06d1-4b11-830a-5c3c6613f29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.292767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab136ae93d774fc18a7fd8aa92671bab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06be197c461a4cfdac0f0d93b148a313', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:22.293629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.294020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.294401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] PATH_INFO: `/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.297240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9a4bc9ec094a4b468ba565fea2242bc3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:22.299829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:22.351962 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2412/4811] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:22.354206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.354497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.354928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.401410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:22.405424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.424710 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2413/4812] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:22.425740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:22.431257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.543675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dac409-0ef4-4f14-8544-1a3db045eea6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:22.631210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:22.631855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.632165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.632416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.665273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4bc9ec094a4b468ba565fea2242bc3', 'request_id': 'req-2aab04d3-bc84-42ae-8fe0-be257f5cceba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.693323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4bc9ec094a4b468ba565fea2242bc3', 'request_id': 'req-2aab04d3-bc84-42ae-8fe0-be257f5cceba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.807959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4bc9ec094a4b468ba565fea2242bc3', 'request_id': 'req-2aab04d3-bc84-42ae-8fe0-be257f5cceba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.820852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:22.823772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:22.833612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] The token cache is being invalidate because project 9a4bc9ec094a4b468ba565fea2242bc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:22.835634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.837571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:22.841822 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2400/4813] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:22 2022] DELETE /identity/v3/projects/9a4bc9ec094a4b468ba565fea2242bc3 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:22.848213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:22.852804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.861824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2414/4814] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:22.862898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:22.865205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.893467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab04d3-bc84-42ae-8fe0-be257f5cceba tempest-TrustsV3TestJSON-632848107 tempest-TrustsV3TestJSON-632848107-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:22.896779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebd0d9-1f9c-41e9-adf1-b536e98eaad0 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:22.909875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:22.909875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.909875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.909875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.911715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:22.912426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:22.912736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:22.913016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] PATH_INFO: `/v3/projects/a732ba5fdce345fd87c7b6482100033e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:22.917726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:22.923806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a732ba5fdce345fd87c7b6482100033e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:22.927780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:22.951009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:22.953848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:22.983568 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2401/4815] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:22.985826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:22.990781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:23.021034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:23.022394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4050c-2db2-4171-b010-4da0fb2aaa9d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:23.034998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:23.036931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.037222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.037501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] PATH_INFO: `/v3/users/5a5776cec80c42249b9dc7dd8ac18f33` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.041867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5776cec80c42249b9dc7dd8ac18f33)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:23.043881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:23.139002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a732ba5fdce345fd87c7b6482100033e', 'request_id': 'req-f030a58a-827d-4931-b30f-81c4908595d4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.181491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a732ba5fdce345fd87c7b6482100033e', 'request_id': 'req-f030a58a-827d-4931-b30f-81c4908595d4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.199396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a732ba5fdce345fd87c7b6482100033e', 'request_id': 'req-f030a58a-827d-4931-b30f-81c4908595d4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.345663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5776cec80c42249b9dc7dd8ac18f33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.360717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] The token cache is being invalidate because project a732ba5fdce345fd87c7b6482100033e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:23.361285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.361676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f030a58a-827d-4931-b30f-81c4908595d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.363494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2415/4816] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:22 2022] DELETE /identity/v3/projects/a732ba5fdce345fd87c7b6482100033e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:23.373727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8caf3d-cacb-4d32-a48d-533477c317b1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.374015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8caf3d-cacb-4d32-a48d-533477c317b1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.374505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8caf3d-cacb-4d32-a48d-533477c317b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.417636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9c8caf3d-cacb-4d32-a48d-533477c317b1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:23.417636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c8caf3d-cacb-4d32-a48d-533477c317b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:23.505029 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2416/4817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:23.506551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.506837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.507116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.515085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5776cec80c42249b9dc7dd8ac18f33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.544611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5776cec80c42249b9dc7dd8ac18f33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.545765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5776cec80c42249b9dc7dd8ac18f33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.546194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:23.547549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d18aba35-1f2a-455e-8b6b-ab69513ad410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5776cec80c42249b9dc7dd8ac18f33'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:23.550703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:23.561029 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2417/4818] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:23.565638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:23.581526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2402/4819] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:22 2022] DELETE /identity/v3/users/5a5776cec80c42249b9dc7dd8ac18f33 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:23.586992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.587451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.587824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.596316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3315007-6420-416c-8b5a-b2536d38b96f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:23.612803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:23.614214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:23.680414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:23.681140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.681425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.681697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.682567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:23.682869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:23.685761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:23.712984 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2418/4820] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:23.714351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:23.729785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34c9dd-1c81-4796-98c2-e0b01a37febc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:23.737960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:23.738896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:23.740231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:23.740536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:23.741298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:23.743630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:23.767299 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2403/4821] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:23.791914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:23.794992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:23.883754 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2419/4822] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:23 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:23.887894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:23.963977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aff6a0-9796-4e68-9eb6-6e16524e6d47 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.050452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd030b-ac10-410e-9338-dedf24df4e97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.063168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.063782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.064098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.064371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.065060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.067628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.145385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.146168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.146296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.146572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.178085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.178569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.198747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2404/4823] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:24.230079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2420/4824] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:23 2022] POST /identity/v3/users => generated 278 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:24.234315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:24.248706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154877f-aa08-46d0-a66a-cdd604069de9 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.263218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.263857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.264133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.264401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.265078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.266741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.292586 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2405/4825] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:24.293630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:24.310990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168dcda-12e9-49cd-abfc-016788767588 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.326003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.326328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.326616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.326887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.327535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.331240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.359806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2421/4826] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:24.364706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:24.378210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39097b01-d761-44cd-b536-ed14cc0089da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.398449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.399303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.399577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.400038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] PATH_INFO: `/v3/projects/63dc76be4464480384f60c098ab58095/users/0db0dab2d8ff4bdfa49ff5ec9335687e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.419926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63dc76be4464480384f60c098ab58095, user_id=0db0dab2d8ff4bdfa49ff5ec9335687e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.425648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd1387-7188-46bc-a4e8-80b2be848f69 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.558634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:24.629931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:24.632471 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2406/4827] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:24 2022] PUT /identity/v3/projects/63dc76be4464480384f60c098ab58095/users/0db0dab2d8ff4bdfa49ff5ec9335687e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:24.633039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:24.646126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.646126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.646383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.658888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b452a-0c49-4cf1-9362-0e498191f3e6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.755829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] MFA Rules not processed for user `0db0dab2d8ff4bdfa49ff5ec9335687e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:24.757489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:24.844246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.848921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.849359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.849703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] PATH_INFO: `/v3/projects/fc93689736c14e8dbfd8d32885abdbb8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.852905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc93689736c14e8dbfd8d32885abdbb8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.861787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:24.937630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2407/4828] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:24.944176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:24.975335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602849d-4dda-4ffe-b3d6-019baf1af315 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:24.987422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:24.989513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:24.990032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:24.990308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:24.990955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:24.998677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:25.110793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc93689736c14e8dbfd8d32885abdbb8', 'request_id': 'req-331736e8-3ce6-4530-9c2c-54bd122db6a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.122570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc93689736c14e8dbfd8d32885abdbb8', 'request_id': 'req-331736e8-3ce6-4530-9c2c-54bd122db6a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.143438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc93689736c14e8dbfd8d32885abdbb8', 'request_id': 'req-331736e8-3ce6-4530-9c2c-54bd122db6a2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.208043 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2408/4829] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:24 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:25.211030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:25.281585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] The token cache is being invalidate because project fc93689736c14e8dbfd8d32885abdbb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:25.282136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.284344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.286436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2422/4830] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:24 2022] DELETE /identity/v3/projects/fc93689736c14e8dbfd8d32885abdbb8 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:25.287593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:25.315495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:25.317774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77a85-d68c-4bf3-a815-799d5d19b04b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:25.329195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:25.330276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:25.330841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:25.331303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:25.332212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:25.335285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6da4fb-262f-48e7-87f7-dbc536e47f14 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:25.538180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331736e8-3ce6-4530-9c2c-54bd122db6a2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:25.544643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:25.561112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:25.561112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:25.561112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] PATH_INFO: `/v3/projects/5120a465cc644d3fb82f9addd1ce1485` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:25.562623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5120a465cc644d3fb82f9addd1ce1485)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:25.565522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:25.692902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:25.704128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2409/4831] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:25 2022] POST /identity/v3/users => generated 284 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:25.708400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e35e6-e1f1-42d0-a4e9-e8eed8b861cc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:25.708611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e35e6-e1f1-42d0-a4e9-e8eed8b861cc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:25.708766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e35e6-e1f1-42d0-a4e9-e8eed8b861cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:25.761016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bb8e35e6-e1f1-42d0-a4e9-e8eed8b861cc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:25.762714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bb8e35e6-e1f1-42d0-a4e9-e8eed8b861cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:25.827846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5120a465cc644d3fb82f9addd1ce1485', 'request_id': 'req-d76933c8-a072-42c0-b5f7-ce41c6e03f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.852941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5120a465cc644d3fb82f9addd1ce1485', 'request_id': 'req-d76933c8-a072-42c0-b5f7-ce41c6e03f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.877650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5120a465cc644d3fb82f9addd1ce1485', 'request_id': 'req-d76933c8-a072-42c0-b5f7-ce41c6e03f99'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.915501 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2410/4832] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:25.921037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:25.921037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:25.921037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:25.967328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] MFA Rules not processed for user `c97d1f9cf2384ad7baf02cfd017430d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:25.968911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:25.988630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] The token cache is being invalidate because project 5120a465cc644d3fb82f9addd1ce1485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:25.990155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.991380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:25.993212 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2423/4833] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:25 2022] DELETE /identity/v3/projects/5120a465cc644d3fb82f9addd1ce1485 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:25.994257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:25.996884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.015796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76933c8-a072-42c0-b5f7-ce41c6e03f99 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.022783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.024179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.024601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.024978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.026412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.032474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3697d-4937-4099-b445-d4ba18763f93 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.056549 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2424/4834] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:26.058665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.058783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.058959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.087779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:26.089289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.099726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2411/4835] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.100749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.110159 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2425/4836] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:26.111720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.114684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.116196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.133537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f131e1a-adca-4ab8-8196-4e4b4a980126 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.140045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.144106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.144106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.144106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] PATH_INFO: `/v3/users/b4f3ccedd3204935a0fe16c7c2e28deb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.144106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f3ccedd3204935a0fe16c7c2e28deb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.144816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.146605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c8b8e-cfdf-40c6-b4b6-02734e6a4e17 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.157378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.158040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.158320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.158743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] PATH_INFO: `/v3/projects/368d3b397ab64d12901bea2008cda339` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.159979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=368d3b397ab64d12901bea2008cda339)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.162622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.408523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368d3b397ab64d12901bea2008cda339', 'request_id': 'req-715c2223-f968-4427-8a47-ed00325f8aec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.416165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f3ccedd3204935a0fe16c7c2e28deb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.425251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368d3b397ab64d12901bea2008cda339', 'request_id': 'req-715c2223-f968-4427-8a47-ed00325f8aec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.487053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f3ccedd3204935a0fe16c7c2e28deb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.511001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f3ccedd3204935a0fe16c7c2e28deb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.535469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f3ccedd3204935a0fe16c7c2e28deb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.537070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f3ccedd3204935a0fe16c7c2e28deb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.545287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368d3b397ab64d12901bea2008cda339', 'request_id': 'req-715c2223-f968-4427-8a47-ed00325f8aec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.551313 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2426/4837] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:26 2022] DELETE /identity/v3/users/b4f3ccedd3204935a0fe16c7c2e28deb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:26.552359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.556900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.570667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] The token cache is being invalidate because project 368d3b397ab64d12901bea2008cda339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:26.571349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.573163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:26.574971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2412/4838] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:26 2022] DELETE /identity/v3/projects/368d3b397ab64d12901bea2008cda339 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:26.576784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.578951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.650755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:26.687163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c2223-f968-4427-8a47-ed00325f8aec admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.812365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbd121-f6b3-4c36-a917-398edefc129b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:26.832836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.837710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.839051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.840157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] PATH_INFO: `/v3/projects/dcea8572fd6c4ba69983263ee636e826/users/7f8e7c264c12434e845116cf5eae50d8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.883004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcea8572fd6c4ba69983263ee636e826, user_id=7f8e7c264c12434e845116cf5eae50d8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.889280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.896134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:26.897508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:26.897921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:26.898237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:26.899023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:26.899394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:26.901735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:26.919486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2413/4839] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:26.920608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.922639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:26.970155 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2427/4840] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:26 2022] PUT /identity/v3/projects/dcea8572fd6c4ba69983263ee636e826/users/7f8e7c264c12434e845116cf5eae50d8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:26.975007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:26.975007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.113512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068cb2a-699f-4916-a6cc-6e96a70fcb68 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.142809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a291-837d-4867-a4c1-579cbff7e991 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.148721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.149510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.149890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.150258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] PATH_INFO: `/v3/users/ab136ae93d774fc18a7fd8aa92671bab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.153622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab136ae93d774fc18a7fd8aa92671bab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.156002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.298217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.299851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.299851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.300589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.303487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.386451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.389387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.401769 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2414/4841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:27.402963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.416339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317cc34-c5dc-4fa0-9d8b-2fe0eee2cb65 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.424153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.425722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.427120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.427737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.429462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.432609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.531008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab136ae93d774fc18a7fd8aa92671bab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.648589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab136ae93d774fc18a7fd8aa92671bab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.677400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2415/4842] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:27 2022] POST /identity/v3/projects => generated 383 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:27.678700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.684377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.688341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab136ae93d774fc18a7fd8aa92671bab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.711557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab136ae93d774fc18a7fd8aa92671bab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.712441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab136ae93d774fc18a7fd8aa92671bab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:27.726431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2428/4843] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:26 2022] DELETE /identity/v3/users/ab136ae93d774fc18a7fd8aa92671bab => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:27.738109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.738109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:27.826674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:27.871150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d8190-65ba-4ec4-87dc-63f47b5a3ae8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.885988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.887080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.887587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.888864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] PATH_INFO: `/v3/projects/b96dfe51bf034e1c86187beade49c456` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.890360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96dfe51bf034e1c86187beade49c456)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.892708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.893721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f3d97-0f67-4b1f-af3a-433e5488f8ab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:27.910232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:27.911020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:27.911304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:27.911580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:27.912254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:27.913928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:27.957078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2416/4844] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:27.959696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:27.967780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.002943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1691d-8360-4488-8b05-187be00f52b6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.019324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.020010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.020598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.020879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.025383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.027580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.148647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96dfe51bf034e1c86187beade49c456', 'request_id': 'req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:28.180267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96dfe51bf034e1c86187beade49c456', 'request_id': 'req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:28.187875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96dfe51bf034e1c86187beade49c456', 'request_id': 'req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:28.305554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2417/4845] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:27 2022] POST /identity/v3/users => generated 292 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:28.306639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.309963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.331247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] The token cache is being invalidate because project b96dfe51bf034e1c86187beade49c456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:28.332791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:28.334653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:28.337645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2429/4846] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:27 2022] DELETE /identity/v3/projects/b96dfe51bf034e1c86187beade49c456 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:28.339971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.351299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.358004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211dab3-dec5-4800-8fac-964912dca059 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.521999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6a5d1-7a49-4989-a0ba-a39e274c057c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.528542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.530255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.531129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.532314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.532777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] PATH_INFO: `/v3/projects/dcea8572fd6c4ba69983263ee636e826/users/7f8e7c264c12434e845116cf5eae50d8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.534012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.534342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.534622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.537964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcea8572fd6c4ba69983263ee636e826, user_id=7f8e7c264c12434e845116cf5eae50d8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.541688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.544050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.575669 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2418/4847] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:28 2022] PUT /identity/v3/projects/dcea8572fd6c4ba69983263ee636e826/users/7f8e7c264c12434e845116cf5eae50d8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:28.581331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.590794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.721478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.725993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4687-f632-4432-888c-e76208bf8b65 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.738172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2430/4848] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:28.739788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f841-68e8-423f-a8cd-fda3da989af4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.740077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f841-68e8-423f-a8cd-fda3da989af4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.740347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f841-68e8-423f-a8cd-fda3da989af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.755602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17a4b8-0879-408e-be7c-4c7564f62e97 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.765360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.766892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.767384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.768172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.768737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.773539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc824869-fe50-475b-823b-da787b72b5b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.776864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cfe4f841-68e8-423f-a8cd-fda3da989af4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:28.779175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cfe4f841-68e8-423f-a8cd-fda3da989af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.790257 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2431/4849] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:28.791995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.792535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.793036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.805792 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2419/4850] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:28.805792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.806497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.806912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.835844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] MFA Rules not processed for user `7f8e7c264c12434e845116cf5eae50d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:28.837521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.858308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:28.860054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.881642 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2420/4851] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:28.885013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.907653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eceb3f0-c616-4a37-86cd-ea72cf54262a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.919070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.919689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.919971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.920245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.920933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.924112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.939602 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2421/4852] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:28.940539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.941336 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2432/4853] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:28.942688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:28.944279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:28.955402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662fdf1d-56bb-4b31-a886-a5e9551396d3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.960417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.961136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.961258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12ec91-d286-4366-9cdf-f4b4b0d170ce None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:28.961459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.961838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.962490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:28.962800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.964716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.966790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:28.967436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:28.967716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:28.967986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] PATH_INFO: `/v3/projects/06be197c461a4cfdac0f0d93b148a313` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:28.969163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=06be197c461a4cfdac0f0d93b148a313)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:28.971078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:28.996766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2422/4854] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:29.000857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:29.040547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f690c2-f32b-4eed-9770-480adf0a1ffd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:29.078163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:29.091068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.091068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.091068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] PATH_INFO: `/v3/projects/952e3a77e8784db5b41f326d932f78b4/users/8e2db6eb17204446a1b19e4c60c2dfa5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.146844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06be197c461a4cfdac0f0d93b148a313', 'request_id': 'req-d51cb930-d49a-46c5-8e00-6542be6a6b1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:29.161822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952e3a77e8784db5b41f326d932f78b4, user_id=8e2db6eb17204446a1b19e4c60c2dfa5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:29.170174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06be197c461a4cfdac0f0d93b148a313', 'request_id': 'req-d51cb930-d49a-46c5-8e00-6542be6a6b1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:29.171713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:29.203156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06be197c461a4cfdac0f0d93b148a313', 'request_id': 'req-d51cb930-d49a-46c5-8e00-6542be6a6b1d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:29.316054 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2423/4855] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:28 2022] PUT /identity/v3/projects/952e3a77e8784db5b41f326d932f78b4/users/8e2db6eb17204446a1b19e4c60c2dfa5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:29.318237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:29.351922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] The token cache is being invalidate because project 06be197c461a4cfdac0f0d93b148a313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:29.352403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:29.353386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:29.359332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2433/4856] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:28 2022] DELETE /identity/v3/projects/06be197c461a4cfdac0f0d93b148a313 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:29.362841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:29.366909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:29.487016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78273ef-d9f5-4d96-941e-a20686a2d637 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:29.501243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f8e7c264c12434e845116cf5eae50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea8572fd6c4ba69983263ee636e826', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:29.502355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.502803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.504158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.505161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:29.505653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:29.507472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbaaeb-7b4e-49b1-b1c3-91abda854f22 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:29.525676 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2424/4857] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:29.536474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626327a-d71c-4fc0-bc77-bb89935b2693 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.536474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626327a-d71c-4fc0-bc77-bb89935b2693 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.536474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626327a-d71c-4fc0-bc77-bb89935b2693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.553932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0626327a-d71c-4fc0-bc77-bb89935b2693 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:29.555492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0626327a-d71c-4fc0-bc77-bb89935b2693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:29.586303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb930-d49a-46c5-8e00-6542be6a6b1d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:29.661719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:29.697567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2425/4858] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:29.699121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.699582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.699864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.703821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:29.706233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.706826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.707252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.714404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:29.719823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:29.732314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:29.733684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:29.753257 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2426/4859] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:29.754624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:29.756440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:29.773357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a73bd4-fe41-447b-8159-078562d57c54 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:29.782525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f8e7c264c12434e845116cf5eae50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea8572fd6c4ba69983263ee636e826', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:29.784782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.784782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.784782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.787901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:29.790104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa2bed-c317-48a6-8cfa-45317f3ab9ac tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:29.863494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2434/4860] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:29 2022] POST /identity/v3/projects => generated 385 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:29.863494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:29.867773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:29.932369 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2427/4861] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:29 2022] POST /identity/v3/projects => generated 348 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:29.934444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:29.934444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:29.934659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:29.978595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:29.979979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:30.017790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:30.046156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155be07-cb97-4882-942e-348f4b7eaa85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.135951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2428/4862] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:30.142679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.163732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db95d11-2527-4668-9936-074e25f33bc4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.169951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.170727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.170995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.171266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.179600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.180422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.180734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.181031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.181680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.183655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.196425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.197929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.221924 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2435/4863] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:30.224003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.362705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2429/4864] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:30 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:30.362705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.383675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0448631-d360-4195-ae54-1c8d14cfcd21 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.401969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b905-23ec-416b-a277-790be1e7fcb9 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.403296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.403921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.404207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.404479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.405170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:30.405477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.419325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.444306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f8e7c264c12434e845116cf5eae50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea8572fd6c4ba69983263ee636e826', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.446179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.448768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.448768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.448768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:30.448768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.449498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.459121 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2430/4865] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:30.460361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.472793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6813ff-0a81-440e-96a1-422396410191 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.477688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.478647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.479112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.479541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.480379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.482141 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2436/4866] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:30.482572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.494941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2431/4867] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:30.502455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.509214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.528033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f31727-2c48-441e-81fe-8f26247555fa tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.545364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.549197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.549197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.549197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.550248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fa3c6-faa7-4e1e-bded-5dce335a78a0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.550409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.550409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.574501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.580756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.580756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.580756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.580756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.580756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.593266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2432/4868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:30.594639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.610846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1291c11-e131-47f8-a53a-4cd3eb60d4c4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.618421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.624145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.624145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.624145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.642918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.647945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.682481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2433/4869] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:30.683525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.713604 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2437/4870] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:30 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:30.713604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:30.715425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:30.730396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c25a17-e130-4561-8eba-dc0bb16b31ff service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.843126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.843918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.844361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.844864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] PATH_INFO: `/v3/projects/279969ef58d34ef3a170de7b43c4cbea/users/cd6a90d43fa24031a856df77bea2bceb/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.867245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=279969ef58d34ef3a170de7b43c4cbea, user_id=cd6a90d43fa24031a856df77bea2bceb, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.879063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:30.889309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dcfea-8425-4664-813c-a522d3702816 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:30.895027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:30.896255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:30.896561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:30.896840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] PATH_INFO: `/v3/users/3ccf6b6cde274e6fbbda8f3c92808415` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:30.898178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ccf6b6cde274e6fbbda8f3c92808415)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:30.900301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.022479 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2434/4871] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:30 2022] PUT /identity/v3/projects/279969ef58d34ef3a170de7b43c4cbea/users/cd6a90d43fa24031a856df77bea2bceb/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:31.032462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.130292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340efe71-06b3-4c65-aea7-9e0e20851a6b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.137248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.137749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.138027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.138300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.139077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.141174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93185b58-7b1e-43ea-a0f1-244c4d44f391 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.198668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ccf6b6cde274e6fbbda8f3c92808415'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:31.268991 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2435/4872] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:31 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:31.274094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.274378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.274646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.295752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ccf6b6cde274e6fbbda8f3c92808415'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:31.310247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] MFA Rules not processed for user `cd6a90d43fa24031a856df77bea2bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:31.311701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:31.347159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ccf6b6cde274e6fbbda8f3c92808415'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:31.373900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ccf6b6cde274e6fbbda8f3c92808415'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:31.374869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ccf6b6cde274e6fbbda8f3c92808415'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:31.386790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2438/4873] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:30 2022] DELETE /identity/v3/users/3ccf6b6cde274e6fbbda8f3c92808415 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:31.386790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.388654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:31.448032 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2436/4874] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:31.453559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.455212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:31.495939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec9748-3f82-4a73-a153-a7c23d0aa390 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.508710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28c929-6c46-4f3b-b56c-661f1bcf225e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.523348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.523580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.524330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.524688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.524871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.524987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.525257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.525375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.526113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.528105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.529750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.533259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.550687 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2439/4875] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:31.559186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.579240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b9fe1-37f0-4c9c-bf4e-a2a84acf7e8a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.593224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.594007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.594411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.594793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.595695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.602608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:31.603158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.625426 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2440/4876] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:31.629681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.649784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c6af-ef76-499c-9f87-d136fb556a93 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.660736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.662275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.662788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.663251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] PATH_INFO: `/v3/projects/51d7fc4440a04b3b96006c1c5109bee2/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.684070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51d7fc4440a04b3b96006c1c5109bee2, user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.694280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:31.733485 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2437/4877] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:31 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:31.734402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.736360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:31.861819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb98487-285a-4ea1-9920-3e387e74916e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:31.880527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f8e7c264c12434e845116cf5eae50d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcea8572fd6c4ba69983263ee636e826', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:31.880527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:31.880527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:31.881027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] PATH_INFO: `/v3/projects/45a90b48a7eb4301bc90c909c4d0bee0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:31.881027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45a90b48a7eb4301bc90c909c4d0bee0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:31.882139 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2441/4878] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:31 2022] PUT /identity/v3/projects/51d7fc4440a04b3b96006c1c5109bee2/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:31.883985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:31.886317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.091314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcb7ee-ffd0-40f9-9648-e024ed821b22 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:32.102180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a90b48a7eb4301bc90c909c4d0bee0', 'request_id': 'req-1d03c029-da2a-4822-9a6e-90ad6ae5e770'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.124071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a90b48a7eb4301bc90c909c4d0bee0', 'request_id': 'req-1d03c029-da2a-4822-9a6e-90ad6ae5e770'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.170754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:32.172053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.172520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.173821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.174555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:32.176655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.247600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a90b48a7eb4301bc90c909c4d0bee0', 'request_id': 'req-1d03c029-da2a-4822-9a6e-90ad6ae5e770'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.263658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] The token cache is being invalidate because project 45a90b48a7eb4301bc90c909c4d0bee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:32.270728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.271662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d03c029-da2a-4822-9a6e-90ad6ae5e770 tempest-QuotasTest-273248343 tempest-QuotasTest-273248343-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.278668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2438/4879] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:31 2022] DELETE /identity/v3/projects/45a90b48a7eb4301bc90c909c4d0bee0 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:32.287175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.287601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.287884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.323955 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2442/4880] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:31 2022] POST /identity/v3/users => generated 298 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:32.323955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:32.324713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:32.352378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] MFA Rules not processed for user `30ad57aedb4b4c8bb7e62a5bc9d0b2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:32.354277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:32.357920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3073c2-39fc-43c6-86e2-874a76362e6c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:32.371445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:32.372288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.373936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.379050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] PATH_INFO: `/v3/projects/a720f4a1648e4aa1b4efaf39bb904f11` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.383907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a720f4a1648e4aa1b4efaf39bb904f11)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:32.389489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.496183 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2439/4881] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:32.497514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:32.501345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:32.523915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b145548-4594-479f-92a5-97de42ad9bcd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:32.530405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:32.531045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.531378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.531655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.533415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:32.535434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.555649 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2440/4882] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:32.556936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:32.560362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:32.577997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c33626-d969-4c24-8480-32239ceda281 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:32.591847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a720f4a1648e4aa1b4efaf39bb904f11', 'request_id': 'req-013deaee-5df8-4a00-b808-b91261f678fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.604870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a720f4a1648e4aa1b4efaf39bb904f11', 'request_id': 'req-013deaee-5df8-4a00-b808-b91261f678fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.618774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a720f4a1648e4aa1b4efaf39bb904f11', 'request_id': 'req-013deaee-5df8-4a00-b808-b91261f678fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.672082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:32.672082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.672082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.672082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] PATH_INFO: `/v3/users/0db0dab2d8ff4bdfa49ff5ec9335687e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.672522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db0dab2d8ff4bdfa49ff5ec9335687e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:32.672522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.732266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] The token cache is being invalidate because project a720f4a1648e4aa1b4efaf39bb904f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:32.733419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.734979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.736688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2443/4883] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:32 2022] DELETE /identity/v3/projects/a720f4a1648e4aa1b4efaf39bb904f11 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:32.737680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:32.745352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:32.784344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013deaee-5df8-4a00-b808-b91261f678fb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:32.800317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:32.801298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:32.802413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:32.802822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:32.804506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:32.808878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:32.957889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db0dab2d8ff4bdfa49ff5ec9335687e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:32.971041 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2444/4884] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:32 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:32.972320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:32.979103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.071845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db0dab2d8ff4bdfa49ff5ec9335687e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:33.120105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db0dab2d8ff4bdfa49ff5ec9335687e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:33.121873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db0dab2d8ff4bdfa49ff5ec9335687e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:33.122489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-937a1f3d-93c2-43ee-9cda-4b8d119a77bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db0dab2d8ff4bdfa49ff5ec9335687e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:33.135623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364cc87-c573-4efc-bcb7-2007c59d8b6c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.140755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.141867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.142306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.142626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] PATH_INFO: `/v3/projects/cdd1c87d09984425a09db7b74f939034/users/bae7b4801c294f21b85d9aee7ab45260/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.152622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2441/4885] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:32 2022] DELETE /identity/v3/users/0db0dab2d8ff4bdfa49ff5ec9335687e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:33.154175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.154466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.154809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.194119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd1c87d09984425a09db7b74f939034, user_id=bae7b4801c294f21b85d9aee7ab45260, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.197144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3bad7-3007-4404-956a-69f9b5ded959 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.225400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:33.226653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.327740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2442/4886] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:33.328946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.330433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.331059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2445/4887] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:32 2022] PUT /identity/v3/projects/cdd1c87d09984425a09db7b74f939034/users/bae7b4801c294f21b85d9aee7ab45260/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:33.333461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd56b-c899-4592-9448-3452261f1630 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.333893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd56b-c899-4592-9448-3452261f1630 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.334262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dd56b-c899-4592-9448-3452261f1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.346295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639af2d-482f-4db7-8d94-c1b9cd33dbd4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.368400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-831dd56b-c899-4592-9448-3452261f1630 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:33.369946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-831dd56b-c899-4592-9448-3452261f1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.426396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.427097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.427494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.427912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.428630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.430702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd7d60-e7a5-4935-915a-84589080edc2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.510219 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2446/4888] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:33.532851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd56b-c899-4592-9448-3452261f1630 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.538703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-831dd56b-c899-4592-9448-3452261f1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.565776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2443/4889] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:33 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:33.565776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.565776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.565776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.578223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dd56b-c899-4592-9448-3452261f1630 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.597862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.598216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.598501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.601165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.601880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.608320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934341a-1899-4ffb-8ec3-5959c8a21649 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.626136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:33.631766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.635510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2447/4890] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:33.638077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.639694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.640007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.654467 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2444/4891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:33.655854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.659118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.681752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] MFA Rules not processed for user `c97d1f9cf2384ad7baf02cfd017430d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:33.689586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:33.766567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:33.824786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f7348-18ee-430a-be4c-ce409e5c85d8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.834492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.835427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.835777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.836062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.844684 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2448/4892] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:33.845669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.852048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.853896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.860653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610549c-f4cf-4c19-b793-989ee737115d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.866378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.867335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.867681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.868205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.869332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.871402 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2445/4893] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:33.872317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.882238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.901652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be55324-7e03-4257-a29e-8b5a4a81f13f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.914801 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2449/4894] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:33.915755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:33.916731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:33.918208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:33.919147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] PATH_INFO: `/v3/projects/cdd1c87d09984425a09db7b74f939034/users/bae7b4801c294f21b85d9aee7ab45260/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:33.924404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:33.928255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd1c87d09984425a09db7b74f939034, user_id=bae7b4801c294f21b85d9aee7ab45260, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:33.931973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:33.957599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae11280-5a58-459b-bf68-cdd8a17eefd6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:33.958766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2446/4895] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:33 2022] PUT /identity/v3/projects/cdd1c87d09984425a09db7b74f939034/users/bae7b4801c294f21b85d9aee7ab45260/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:33.960193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.101529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508cfa49-d102-4485-8e23-f7df8e635bc6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.109947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.110597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.110880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.111159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.111321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.111856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:34.112172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.112669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.113106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.113530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] PATH_INFO: `/v3/projects/483329394c4645408f8545d2e84a2a6e/users/abde51bf22f84e0995fc1ace766f568b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.114452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa85080-94b6-4758-89d4-db520f8f5a22 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.138009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] RBAC: Authorizing `identity:create_grant(project_id=483329394c4645408f8545d2e84a2a6e, user_id=abde51bf22f84e0995fc1ace766f568b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.143839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2450/4896] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:34.143839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.143839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.143839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.147985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.196049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] MFA Rules not processed for user `bae7b4801c294f21b85d9aee7ab45260`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:34.197627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:34.248815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2447/4897] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:33 2022] PUT /identity/v3/projects/483329394c4645408f8545d2e84a2a6e/users/abde51bf22f84e0995fc1ace766f568b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:34.253479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.380163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2451/4898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:34.381639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.408729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bd2a2-8be4-4346-90fb-8c6199e01df5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.415974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.416951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.417224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.417495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.418210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.419874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.424150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b297ca-a11c-49d9-a293-ae42895c571f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.436452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.439336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.439738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.440875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.441656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.446131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2452/4899] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:34.447640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.448776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.460212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba604f2-c88a-48b0-9b1a-48f5c19a9bc3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.471737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:34.477152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.478253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.478533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.478809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] PATH_INFO: `/v3/projects/483329394c4645408f8545d2e84a2a6e/users/abde51bf22f84e0995fc1ace766f568b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.481436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=483329394c4645408f8545d2e84a2a6e, user_id=abde51bf22f84e0995fc1ace766f568b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.484339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3e3be-d994-400b-96eb-e48674fed386 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.501317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2453/4900] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:34 2022] PUT /identity/v3/projects/483329394c4645408f8545d2e84a2a6e/users/abde51bf22f84e0995fc1ace766f568b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:34.519540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.519971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.520126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.563367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] MFA Rules not processed for user `abde51bf22f84e0995fc1ace766f568b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:34.565764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:34.634722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2448/4901] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:34 2022] POST /identity/v3/projects => generated 379 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:34.640054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.747122 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2454/4902] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:34.753169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:34.753169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:34.777286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a7b9a-cf6d-4380-b047-cf52c588cc7c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.791424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.792405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.792756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.793032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.793729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:34.800970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:34.857522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f381a1-9e34-43b9-a9bf-54e209f818b7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:34.938535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:34.938535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:34.938535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:34.938535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:34.972726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2449/4903] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:34 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:34.975165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.070762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.072787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.091936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2455/4904] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:35.092899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.105497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbcb87-6f81-4208-90a6-5e67221894f8 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.106180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee8ba5-7b3e-4dbe-8b6b-f965b76fa243 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.113637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.114714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.115208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.115697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.116875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.119607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.124402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.125409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.125884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.126356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.127444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.135636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.166445 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2456/4905] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:35.168346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.192723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a63cf-f1a7-4e87-b41c-86bc7b0375bc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.202269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.203231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.203686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.204529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.205587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.209836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.231585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2457/4906] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:35.233560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.253084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b535cb-fa06-49b8-beea-01b302b23b34 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.262040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.263123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.263586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.264062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] PATH_INFO: `/v3/projects/4397600a6e7f4af4ab461b1b30f5b750/users/dfba39e9f7574d87b644341c52476e4d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.294278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4397600a6e7f4af4ab461b1b30f5b750, user_id=dfba39e9f7574d87b644341c52476e4d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.304883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf67da9-214a-44e1-bf7a-2d19f553246f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.369937 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2450/4907] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:34 2022] POST /identity/v3/projects => generated 360 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:35.371193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.484850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2458/4908] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:35 2022] PUT /identity/v3/projects/4397600a6e7f4af4ab461b1b30f5b750/users/dfba39e9f7574d87b644341c52476e4d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:35.489782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92199-d9ec-46cf-8991-4a13afb29bd9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.490480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92199-d9ec-46cf-8991-4a13afb29bd9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.490911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac92199-d9ec-46cf-8991-4a13afb29bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.492523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281320d-1d7b-430b-931f-9a11bd3614ba tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9ac92199-d9ec-46cf-8991-4a13afb29bd9 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:35.519291 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:35.520479 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:35.557023 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2459/4909] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:35.559611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.590720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.590720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.615134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:35.616956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.617883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.618861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.619936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.621660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.627371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.635180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:35.782417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2460/4910] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:35.782417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.782417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:35.804886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2451/4911] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:35 2022] POST /identity/v3/users => generated 371 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:35.807214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.829267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc573c8-e1ea-472b-8de3-010a6a48f7a1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.849487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.849487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.850611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.850611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] PATH_INFO: `/v3/projects/63dc76be4464480384f60c098ab58095` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.853866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63dc76be4464480384f60c098ab58095)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.862629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.934853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca73350-6984-4083-9510-ca6c7bae9e6e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.938945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.939693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.940145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.940539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:35.950786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:35.952522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:35.965401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2452/4912] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:35.966640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:35.979319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93c1da-9f60-4780-98b0-6da3983b0cb6 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:35.983439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:35.984222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:35.984641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:35.985035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/2df073c5fb9b43b599fb38ead051f848` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:36.006570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_user(user_id=2df073c5fb9b43b599fb38ead051f848)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:36.007377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:36.010324 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2453/4913] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:35 2022] GET /identity/v3/users/2df073c5fb9b43b599fb38ead051f848 => generated 371 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:36.014986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:36.030901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d607bcd-bcd3-47cf-b396-8eaeffd4a67e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:36.037724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:36.046358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:36.051925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:36.052798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:36.053904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/2df073c5fb9b43b599fb38ead051f848` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:36.058892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2df073c5fb9b43b599fb38ead051f848)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:36.066123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:36.068908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63dc76be4464480384f60c098ab58095', 'request_id': 'req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.084014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63dc76be4464480384f60c098ab58095', 'request_id': 'req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.100683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63dc76be4464480384f60c098ab58095', 'request_id': 'req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.213781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] The token cache is being invalidate because project 63dc76be4464480384f60c098ab58095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:36.214340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.216921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.220648 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2461/4914] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:35 2022] DELETE /identity/v3/projects/63dc76be4464480384f60c098ab58095 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:36.225473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:36.227283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:36.324684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df073c5fb9b43b599fb38ead051f848'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.378139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea4bae-1b1f-4f30-bb32-10cc22e7233e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:36.397563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:36.400164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:36.400942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:36.401388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] PATH_INFO: `/v3/users/7f8e7c264c12434e845116cf5eae50d8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:36.408544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8e7c264c12434e845116cf5eae50d8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:36.423408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:36.533923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df073c5fb9b43b599fb38ead051f848'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.555063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df073c5fb9b43b599fb38ead051f848'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.555955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df073c5fb9b43b599fb38ead051f848'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.556690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df073c5fb9b43b599fb38ead051f848'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.573053 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2454/4915] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:36 2022] DELETE /identity/v3/users/2df073c5fb9b43b599fb38ead051f848 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:36.582292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:36.585972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:36.741474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61bc3d-2234-4d07-bc45-dc8bf01be2f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:36.757532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:36.758697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:36.764665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:36.764665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/0f0a05dc424b495296912add69d65ded` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:36.764665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0f0a05dc424b495296912add69d65ded)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:36.764665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:36.780720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8e7c264c12434e845116cf5eae50d8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.951474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8e7c264c12434e845116cf5eae50d8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:36.989016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8e7c264c12434e845116cf5eae50d8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.009370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0a05dc424b495296912add69d65ded', 'request_id': 'req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.017066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8e7c264c12434e845116cf5eae50d8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.021337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8e7c264c12434e845116cf5eae50d8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.029754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0a05dc424b495296912add69d65ded', 'request_id': 'req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.043290 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2462/4916] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:36 2022] DELETE /identity/v3/users/7f8e7c264c12434e845116cf5eae50d8 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:37.166179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0a05dc424b495296912add69d65ded', 'request_id': 'req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.185076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] The token cache is being invalidate because project 0f0a05dc424b495296912add69d65ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:37.185872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.188324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:37.195738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2455/4917] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:36 2022] DELETE /identity/v3/projects/0f0a05dc424b495296912add69d65ded => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:37.196000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:37.197786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:37.349552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80da2-f3c1-4728-9a52-c890cd4326c1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:37.355624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:37.356611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:37.357302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:37.357798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:37.358692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:37.361311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:37.516052 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2463/4918] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:37 2022] POST /identity/v3/projects => generated 359 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:37.520908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:37.522400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:37.683274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc802e1-1f4b-451e-b5e3-7f6622e4d4f3 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:37.780916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:37.781544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:37.781823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:37.785726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:37.788204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:37.796882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:37.894502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:37.943959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2456/4919] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:37 2022] POST /identity/v3/users => generated 414 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:37.952798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:37.968472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388dbe7-21db-40ee-8348-da277c0950a2 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:37.974061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:37.974693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:37.974979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:37.975787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:37.976076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:37.977993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.074266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2464/4920] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:37 2022] POST /identity/v3/roles => generated 239 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:38.075537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.105983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6d83-a10a-4602-bae7-7563c4eacf37 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.126154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.127023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.127314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.127600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f0a16893c74f47bdbe8c8788428c243c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.166451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_user(user_id=f0a16893c74f47bdbe8c8788428c243c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.170583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.177161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.180924 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2457/4921] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:38 2022] GET /identity/v3/users/f0a16893c74f47bdbe8c8788428c243c => generated 414 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:48:38.200002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e93b15-27a3-49b3-bff0-59f2a3aebe4f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.200002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.200002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.200782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.201284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/roles/15ef3a0ff541479b907ea0649cf65414` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.203326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_role(role_id=15ef3a0ff541479b907ea0649cf65414)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.204649 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:38.204649 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:48:38.204649 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:48:38.206128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.209181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2465/4922] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:38 2022] GET /identity/v3/roles/15ef3a0ff541479b907ea0649cf65414 => generated 239 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:48:38.213078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.226605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671f0-2d0d-4eaa-a9f8-316e80805a9a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.234704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.234704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.234704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.235021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.235021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.237778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.422048 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2458/4923] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:38 2022] POST /identity/v3/projects => generated 359 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:38.434227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.448908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05706744-c660-41fc-935b-367cbc385c2f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.636253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.637603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.637603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.639922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/6e1601b90bf24b2a84fcce190f7be007` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.642468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_project(project_id=6e1601b90bf24b2a84fcce190f7be007)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.654051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.657197 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2466/4924] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:48:38 2022] GET /identity/v3/projects/6e1601b90bf24b2a84fcce190f7be007 => generated 359 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:38.661300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.665130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:38.674133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:38.691932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f0d19-23be-4bc2-b3a3-893d2993854f tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.714973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.718238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.718525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.718809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/6e1601b90bf24b2a84fcce190f7be007/users/f0a16893c74f47bdbe8c8788428c243c/roles/15ef3a0ff541479b907ea0649cf65414` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.738997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e1601b90bf24b2a84fcce190f7be007, user_id=f0a16893c74f47bdbe8c8788428c243c, role_id=15ef3a0ff541479b907ea0649cf65414)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.745632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.791330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:38.875588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb4c1a-0cf1-4f49-9387-bb84cbb2e1e0 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:38.885041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:38.885712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:38.886072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:38.886338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] PATH_INFO: `/v3/projects/dcea8572fd6c4ba69983263ee636e826` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:38.890719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcea8572fd6c4ba69983263ee636e826)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:38.892727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:38.919782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2459/4925] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:38 2022] PUT /identity/v3/projects/6e1601b90bf24b2a84fcce190f7be007/users/f0a16893c74f47bdbe8c8788428c243c/roles/15ef3a0ff541479b907ea0649cf65414 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:38.924806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.056938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcea8572fd6c4ba69983263ee636e826', 'request_id': 'req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:39.078180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcea8572fd6c4ba69983263ee636e826', 'request_id': 'req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:39.094968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcea8572fd6c4ba69983263ee636e826', 'request_id': 'req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:39.108551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0956ef-e6ce-4bd5-aec7-6490149e996e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:39.221736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] The token cache is being invalidate because project dcea8572fd6c4ba69983263ee636e826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:39.229017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:39.233396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e974760e-1ed1-4a1f-bac4-ebc59fc29e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:39.243523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2467/4926] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:38 2022] DELETE /identity/v3/projects/dcea8572fd6c4ba69983263ee636e826 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:39.246305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613a1bb-f633-44f2-8b42-dee0b2b590be None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.246828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613a1bb-f633-44f2-8b42-dee0b2b590be None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.252729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613a1bb-f633-44f2-8b42-dee0b2b590be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.253000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:39.253000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.253000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.253322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.253322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:39.253322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:39.273787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8613a1bb-f633-44f2-8b42-dee0b2b590be None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:39.275834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8613a1bb-f633-44f2-8b42-dee0b2b590be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:39.376773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2468/4927] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:39.387979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.391578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2460/4928] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:38 2022] POST /identity/v3/projects => generated 359 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:39.392758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.393151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.393598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.396728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:39.425861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:39.428895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:39.541364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28756156-0a0d-4d29-be3c-df01628cdf13 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:39.547832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:39.548977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.549425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.549886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.551864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_project(project_id=06c80ebcd8844f5aa482f6a3a91fc722)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:39.554348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:39.556779 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2461/4929] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:48:39 2022] GET /identity/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722 => generated 359 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:48:39.561573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.576978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d0491-f39d-4238-8510-9e1db80dd7f4 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:39.589258 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2469/4930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:39.589780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.594830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:39.595750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.596458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.596937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722/users/f0a16893c74f47bdbe8c8788428c243c/roles/15ef3a0ff541479b907ea0649cf65414` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.603027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=06c80ebcd8844f5aa482f6a3a91fc722, user_id=f0a16893c74f47bdbe8c8788428c243c, role_id=15ef3a0ff541479b907ea0649cf65414)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:39.605630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda42a-977b-4b74-a3a5-25173a9353a2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:39.617299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:39.617458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:39.617458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.617458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.617458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.617878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:39.617878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:39.619913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:39.651080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2470/4931] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:39.653927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.667056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172be5d8-1590-4e98-8180-0cf41360afde admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:39.673730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:39.677575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:39.677575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:39.677575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:39.677575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:39.680408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:39.762415 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2462/4932] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:39 2022] PUT /identity/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722/users/f0a16893c74f47bdbe8c8788428c243c/roles/15ef3a0ff541479b907ea0649cf65414 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:39.766585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.844548 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2471/4933] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:39 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:39.844548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:39.941469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee34c13-5c15-40d3-9d1e-88e059152554 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.042068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e263-c6c1-4d2e-962f-a155bc93f60a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.054318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.054954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.057984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.057984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.058241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.058241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.058419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.058715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f0a16893c74f47bdbe8c8788428c243c/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.059311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.061783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=f0a16893c74f47bdbe8c8788428c243c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.064482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.067404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.135165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2463/4934] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:48:39 2022] GET /identity/v3/users/f0a16893c74f47bdbe8c8788428c243c/projects => generated 842 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:40.137283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.162103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa4c5a-3520-40da-9fca-1b38c6970857 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.167428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.168351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.169524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.170827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.172732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06c80ebcd8844f5aa482f6a3a91fc722)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.176983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.260570 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2472/4935] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:39 2022] POST /identity/v3/users => generated 283 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:40.264292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.277730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b65d2-5227-4a98-9c44-394d1bea95e6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.286516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.287716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.288233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.288804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.289777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.292378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.307794 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2473/4936] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:40 2022] GET /identity/v3/roles => generated 1650 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:40.312258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.325262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97bea1-90c0-4c71-98c5-49b9f9403cae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.334343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.351164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.351164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.351164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.351164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.351164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.359779 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2474/4937] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:40 2022] GET /identity/v3/roles => generated 1650 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:48:40.364805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.381950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12d591-a55a-45ab-b78c-6b17d024d286 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.388683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.391252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.391825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.394494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] PATH_INFO: `/v3/projects/c26d2fe9e5e743059c97bd0af976552c/users/07599fa7402e41958a674d974361b537/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.431434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06c80ebcd8844f5aa482f6a3a91fc722', 'request_id': 'req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:40.444233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26d2fe9e5e743059c97bd0af976552c, user_id=07599fa7402e41958a674d974361b537, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.450896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06c80ebcd8844f5aa482f6a3a91fc722', 'request_id': 'req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:40.458481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb5745-6425-4519-8f86-c90810e7794e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:40.585956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06c80ebcd8844f5aa482f6a3a91fc722', 'request_id': 'req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:40.595842 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2475/4938] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:40 2022] PUT /identity/v3/projects/c26d2fe9e5e743059c97bd0af976552c/users/07599fa7402e41958a674d974361b537/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:40.611666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] The token cache is being invalidate because project 06c80ebcd8844f5aa482f6a3a91fc722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:40.611887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:40.613209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:40.617888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2464/4939] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:40 2022] DELETE /identity/v3/projects/06c80ebcd8844f5aa482f6a3a91fc722 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:40.618394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.619257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.619389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.620539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.622143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:40.688805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] MFA Rules not processed for user `07599fa7402e41958a674d974361b537`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:40.692978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:40.807035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963aa78-8bfc-4f32-8d0d-8207f8f3482e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:40.862985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:40.927084 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2476/4940] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:40.948723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:40.955623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:40.961520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:40.961520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/6e1601b90bf24b2a84fcce190f7be007` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:40.961520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e1601b90bf24b2a84fcce190f7be007)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:40.961789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:40.961789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:40.962719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:41.094113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e66c-38fc-42d0-b5c8-16037f93ecf0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:41.100512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:41.101349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:41.102343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:41.102343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:41.117813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:41.120462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:41.133838 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2477/4941] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:41.423838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1601b90bf24b2a84fcce190f7be007', 'request_id': 'req-d469c134-5070-4d32-817e-13073ad4567c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:41.442312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1601b90bf24b2a84fcce190f7be007', 'request_id': 'req-d469c134-5070-4d32-817e-13073ad4567c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:41.642594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1601b90bf24b2a84fcce190f7be007', 'request_id': 'req-d469c134-5070-4d32-817e-13073ad4567c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:41.682793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] The token cache is being invalidate because project 6e1601b90bf24b2a84fcce190f7be007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:41.683105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:41.684073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:41.693344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2465/4942] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:40 2022] DELETE /identity/v3/projects/6e1601b90bf24b2a84fcce190f7be007 => generated 0 bytes in 1073 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:41.697525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:41.717326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af19c2a-615e-4541-9f10-6b6ec489abfb service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:41.921856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:41.924286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:41.925724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:41.926206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/roles/15ef3a0ff541479b907ea0649cf65414` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:41.933754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=15ef3a0ff541479b907ea0649cf65414)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:41.940809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:42.133032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invalidating the token cache because role 15ef3a0ff541479b907ea0649cf65414 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:42.133831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.134364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.137660 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2478/4943] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:41 2022] DELETE /identity/v3/roles/15ef3a0ff541479b907ea0649cf65414 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:42.142131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:42.143994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:42.166276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469c134-5070-4d32-817e-13073ad4567c tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:42.288180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:42.288613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:42.288899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:42.289188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f0a16893c74f47bdbe8c8788428c243c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:42.290476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f0a16893c74f47bdbe8c8788428c243c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:42.293725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:42.298165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:42.499111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a16893c74f47bdbe8c8788428c243c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.609031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a16893c74f47bdbe8c8788428c243c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.641620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a16893c74f47bdbe8c8788428c243c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.643488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a16893c74f47bdbe8c8788428c243c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.644520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a16893c74f47bdbe8c8788428c243c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.705224 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2466/4944] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:42 2022] DELETE /identity/v3/users/f0a16893c74f47bdbe8c8788428c243c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:42.706521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:42.708819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:42.729320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe1ad-b4c5-4de6-acb3-e59154b3deaf tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:42.817182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:42.819302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:42.819970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:42.820508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/32db9aee9e874c97819fddfa08417936` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:42.822915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32db9aee9e874c97819fddfa08417936)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:42.825579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:42.986794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32db9aee9e874c97819fddfa08417936', 'request_id': 'req-1ffd983c-fe29-4904-ad3e-a86e801c04ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:42.995442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32db9aee9e874c97819fddfa08417936', 'request_id': 'req-1ffd983c-fe29-4904-ad3e-a86e801c04ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.002449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32db9aee9e874c97819fddfa08417936', 'request_id': 'req-1ffd983c-fe29-4904-ad3e-a86e801c04ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.127248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] The token cache is being invalidate because project 32db9aee9e874c97819fddfa08417936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:43.127248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.127924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1ffd983c-fe29-4904-ad3e-a86e801c04ca tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.148690 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2479/4945] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:42 2022] DELETE /identity/v3/projects/32db9aee9e874c97819fddfa08417936 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:43.156084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:43.157613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.176569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35928ab4-afb8-4471-a563-19ec2348b05a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:43.292930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:43.294301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.295316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.302615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.302615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:update_user(user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:43.305803 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:43.305803 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:48:43.305803 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:48:43.309402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:43.464608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.486341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:43.528581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invalidating the token cache because user 30ad57aedb4b4c8bb7e62a5bc9d0b2e9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:43.529014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.529771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa571248-dc19-43b6-8cd7-fdbaf584fd08 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.533120 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2467/4946] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:48:43 2022] PATCH /identity/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9 => generated 296 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:43.542096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121326-0984-4ef3-977e-7e849108144d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.542301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121326-0984-4ef3-977e-7e849108144d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.542594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121326-0984-4ef3-977e-7e849108144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.560233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d4ad-00a5-4b89-b54e-cab92563d177 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.560530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d4ad-00a5-4b89-b54e-cab92563d177 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.560814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107d4ad-00a5-4b89-b54e-cab92563d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.603876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7107d4ad-00a5-4b89-b54e-cab92563d177 None None] MFA Rules not processed for user `8e2db6eb17204446a1b19e4c60c2dfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:43.605990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7107d4ad-00a5-4b89-b54e-cab92563d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.615893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8c121326-0984-4ef3-977e-7e849108144d None None] MFA Rules not processed for user `30ad57aedb4b4c8bb7e62a5bc9d0b2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:43.618285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8c121326-0984-4ef3-977e-7e849108144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.623278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2480/4947] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:43 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:48:43.627951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c121326-0984-4ef3-977e-7e849108144d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:43.632618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8c121326-0984-4ef3-977e-7e849108144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.656953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c121326-0984-4ef3-977e-7e849108144d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:43.663937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:43.664639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.665275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.665567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.666897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:update_user(user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:43.668107 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:48:43.668107 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:48:43.668107 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:48:43.670443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:43.707851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2468/4948] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:43.718147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.730291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.730291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.748916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] MFA Rules not processed for user `8e2db6eb17204446a1b19e4c60c2dfa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:43.750152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.759402 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2469/4949] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:43.782423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:43.782423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.861176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.932342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ee3ed-982c-47dc-932a-e191f605a893 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:43.939328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:43.940956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:43.941454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:43.943144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:43.965564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invalidating the token cache because user 30ad57aedb4b4c8bb7e62a5bc9d0b2e9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:43.971612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.971612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:43.972345 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2481/4950] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:48:43 2022] PATCH /identity/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9 => generated 296 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:43.973635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:43.975421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:43.975915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:43.978448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:44.002929 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2470/4951] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:44.007281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:44.024813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150603-b1a5-4a47-a041-7eb08996d290 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:44.043956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:44.043956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.043956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.044391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.085923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:update_user(user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:44.088326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:44.217193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b4989-db86-4365-816e-ce43bf9b101a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:44.231773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:44.233102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.238043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.239280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.248720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:44.285253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.431369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:44.440276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f920d40-f03a-495b-899e-be8a0811bcde service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:44.476913 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2482/4952] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:44.486341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invalidating the token cache because user 30ad57aedb4b4c8bb7e62a5bc9d0b2e9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:44.486692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.487360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.489475 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2471/4953] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:48:44 2022] PATCH /identity/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9 => generated 296 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:44.501512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fec85-b392-4236-a43c-a288ef518836 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.501949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fec85-b392-4236-a43c-a288ef518836 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.502484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fec85-b392-4236-a43c-a288ef518836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.554610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-004fec85-b392-4236-a43c-a288ef518836 None None] MFA Rules not processed for user `30ad57aedb4b4c8bb7e62a5bc9d0b2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:44.562106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-004fec85-b392-4236-a43c-a288ef518836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:44.562106 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2483/4954] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:44 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:48:44.565274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:44.568557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:44.583479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.598972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.598972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.599547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26d525-ea7a-42e4-9394-3fc939a80816 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:44.599659 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:44.600699 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:44.605857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:44.605857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.605857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.607545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.607545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:update_user(user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:44.607545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:44.617324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2484/4955] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:44.664313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:44.751619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.899578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invalidating the token cache because user 30ad57aedb4b4c8bb7e62a5bc9d0b2e9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:44.899578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.899578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:44.899578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2472/4956] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:48:44 2022] PATCH /identity/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9 => generated 296 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:44.900349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:44.906256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:44.946016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def3d45-ae35-4de8-8ffb-3b481b420282 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:44.952890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:44.953283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:44.953719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:44.954148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:44.954944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:44.957261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037c814-1425-48f8-a975-9f832a0b0394 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:45.100862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2485/4957] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:48:44 2022] POST /identity/v3/users => generated 265 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:45.102904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:45.116846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5409c57-c199-4e5e-adeb-48d9eabaa527 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:45.137309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:45.137309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:45.141318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:45.142833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/e42f3a99b089433d9302b3443a1dc3f2/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:45.369293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:45.800623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2473/4958] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:48:45 2022] POST /identity/v3/users/e42f3a99b089433d9302b3443a1dc3f2/password => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:46.146649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:46.242002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff47c-2199-445a-bd73-d8519ddebef2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:46.242289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff47c-2199-445a-bd73-d8519ddebef2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:46.242572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ff47c-2199-445a-bd73-d8519ddebef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:46.270289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ce8ff47c-2199-445a-bd73-d8519ddebef2 None None] MFA Rules not processed for user `c97d1f9cf2384ad7baf02cfd017430d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:46.271906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce8ff47c-2199-445a-bd73-d8519ddebef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:46.326268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:46.329239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:46.410598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:46.455916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0a28a-d3f5-4967-b2ce-dfc37e52a828 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:46.467919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:46.472320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:46.472863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:46.473308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] PATH_INFO: `/v3/users/cd6a90d43fa24031a856df77bea2bceb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:46.474945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6a90d43fa24031a856df77bea2bceb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:46.477237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:46.634797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2486/4959] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:46.751777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6a90d43fa24031a856df77bea2bceb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:46.806926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:46.807540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:46.808071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:46.837997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] MFA Rules not processed for user `e42f3a99b089433d9302b3443a1dc3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:46.846714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:46.849475 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2487/4960] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:46 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:48:46.854150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:46.871632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c099c-f688-4d6f-bbcf-0e672923cf59 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:46.895130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6a90d43fa24031a856df77bea2bceb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:46.919797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:46.927728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:46.927728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:46.927728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:46.936339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:46.939204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:46.945617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6a90d43fa24031a856df77bea2bceb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:46.953073 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2488/4961] 10.222.0.64 () {56 vars in 1263 bytes} [Wed Nov 2 12:48:46 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Nov 02 12:48:46.956328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6a90d43fa24031a856df77bea2bceb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:46.957046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3a2cfdd-ca20-43e8-9da6-97c1fb84b907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6a90d43fa24031a856df77bea2bceb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:46.957833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:46.974555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c93cf-2ca0-4041-9ac7-f9f864243706 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:46.980384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:46.981132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:46.981410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:46.981685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/e42f3a99b089433d9302b3443a1dc3f2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:46.982935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e42f3a99b089433d9302b3443a1dc3f2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:46.984975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:46.994686 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2474/4962] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:46 2022] DELETE /identity/v3/users/cd6a90d43fa24031a856df77bea2bceb => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:46.999227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:47.003951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:47.003951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:47.031648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:47.034816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:47.155612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:47.204556 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2475/4963] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:47.236238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:47.239288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:47.303945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:47.335807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:47.359906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:47.362747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5f635780-620a-44e9-825c-2a8e04e47f4a tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e42f3a99b089433d9302b3443a1dc3f2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:47.380626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c0ba6-c6ab-4131-a8fb-da6f484bbd76 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:47.396862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2489/4964] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:46 2022] DELETE /identity/v3/users/e42f3a99b089433d9302b3443a1dc3f2 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:47.398401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:47.398688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:47.398965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:47.405142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:47.405784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:47.409478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:47.409954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:47.414636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:48:47.432208 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:48:47.439605 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:48:47.446999 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2490/4965] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:48:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:48:47.453353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:47.469883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:47.471328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:47.471328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:47.492674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2476/4966] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:47.646159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462aa479-be8a-4b53-9696-d6013e251fd6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:47.657158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:47.658768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:47.659265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:47.660375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:47.664253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:47.668630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:47.827814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:47.828451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2491/4967] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:47 2022] POST /identity/v3/users => generated 364 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:47.886396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:48.009275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5a0e-ba48-454b-8def-fde66fb7332d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:48.025141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:48.025854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:48.026295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:48.027360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:48.028095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:48.035775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:48.210470 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2477/4968] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:47 2022] POST /identity/v3/projects => generated 359 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:48.213064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:48.226948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cedbc-0dd8-45a5-a452-261e4166ab60 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:48.292242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:48.366873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:48.367736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:48.368130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:48.368532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f9bd542a0aa14030b852365b33ddcf50` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:48.398249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:update_user(user_id=f9bd542a0aa14030b852365b33ddcf50)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:48.400690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:48.604572 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2492/4969] 10.222.0.64 () {60 vars in 1244 bytes} [Wed Nov 2 12:48:48 2022] PATCH /identity/v3/users/f9bd542a0aa14030b852365b33ddcf50 => generated 521 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:48.606831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:48.624035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ddd2-7d51-4c5f-bf86-75d9bdb7566e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:48.636931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:48.638212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:48.639357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:48.639840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f9bd542a0aa14030b852365b33ddcf50` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:48.673866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:get_user(user_id=f9bd542a0aa14030b852365b33ddcf50)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:48.682039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:48.686752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2478/4970] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:48 2022] GET /identity/v3/users/f9bd542a0aa14030b852365b33ddcf50 => generated 388 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:48.688844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:48.702335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73fef4f-9e96-4dfa-8f5e-0bd14781e991 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:48.716516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:48.717510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:48.718075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:48.718787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/projects/3466ff7dcda340f0aa5ff2f60fb9addc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:48.721220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3466ff7dcda340f0aa5ff2f60fb9addc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:48.725861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:48.940625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3466ff7dcda340f0aa5ff2f60fb9addc', 'request_id': 'req-7d0b7832-05e2-4e72-a87c-f8f9addd907e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:48.953871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3466ff7dcda340f0aa5ff2f60fb9addc', 'request_id': 'req-7d0b7832-05e2-4e72-a87c-f8f9addd907e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:48.967781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3466ff7dcda340f0aa5ff2f60fb9addc', 'request_id': 'req-7d0b7832-05e2-4e72-a87c-f8f9addd907e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.152125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] The token cache is being invalidate because project 3466ff7dcda340f0aa5ff2f60fb9addc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:49.152582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.153868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.160921 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2493/4971] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:48 2022] DELETE /identity/v3/projects/3466ff7dcda340f0aa5ff2f60fb9addc => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:49.162451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:49.164763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:49.188013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f77fde-4161-43c0-9a22-24337b2af734 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:49.214293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:49.216095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:49.333605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abde51bf22f84e0995fc1ace766f568b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '483329394c4645408f8545d2e84a2a6e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:49.335593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:49.335593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:49.337371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] PATH_INFO: `/v3/users/f9bd542a0aa14030b852365b33ddcf50` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:49.339826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f9bd542a0aa14030b852365b33ddcf50)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:49.344769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:49.383088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7832-05e2-4e72-a87c-f8f9addd907e tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:49.417501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:49.418538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:49.418971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:49.419404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] PATH_INFO: `/v3/projects/279969ef58d34ef3a170de7b43c4cbea` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:49.421239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279969ef58d34ef3a170de7b43c4cbea)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:49.427292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:49.573032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bd542a0aa14030b852365b33ddcf50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.591530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279969ef58d34ef3a170de7b43c4cbea', 'request_id': 'req-82bb590c-302e-4e4d-a54c-cbfece981cc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.604511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279969ef58d34ef3a170de7b43c4cbea', 'request_id': 'req-82bb590c-302e-4e4d-a54c-cbfece981cc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.621225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279969ef58d34ef3a170de7b43c4cbea', 'request_id': 'req-82bb590c-302e-4e4d-a54c-cbfece981cc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.698494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bd542a0aa14030b852365b33ddcf50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.738888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bd542a0aa14030b852365b33ddcf50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.740424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bd542a0aa14030b852365b33ddcf50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.742154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bd542a0aa14030b852365b33ddcf50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.773916 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2479/4972] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:49 2022] DELETE /identity/v3/users/f9bd542a0aa14030b852365b33ddcf50 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:49.791456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:49.791456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:49.847008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] The token cache is being invalidate because project 279969ef58d34ef3a170de7b43c4cbea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:49.847443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.848709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:49.851246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2494/4973] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:49 2022] DELETE /identity/v3/projects/279969ef58d34ef3a170de7b43c4cbea => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:49.854197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:49.857177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:49.940013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749ecba8-5bbf-49aa-b725-eee739b0ae71 tempest-UsersV3TestJSON-1787379228 tempest-UsersV3TestJSON-1787379228-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:49.949801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:49.950604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:49.952091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:49.952732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] PATH_INFO: `/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:49.981197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ad57aedb4b4c8bb7e62a5bc9d0b2e9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:49.983432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:49.989835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb590c-302e-4e4d-a54c-cbfece981cc4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:50.009568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:50.013157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:50.016656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:50.016656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] PATH_INFO: `/v3/users/bae7b4801c294f21b85d9aee7ab45260` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:50.017919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae7b4801c294f21b85d9aee7ab45260)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:50.023840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:50.237188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:50.315699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae7b4801c294f21b85d9aee7ab45260'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.319814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.442937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae7b4801c294f21b85d9aee7ab45260'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.487663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae7b4801c294f21b85d9aee7ab45260'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.496612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae7b4801c294f21b85d9aee7ab45260'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.497613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4edf793a-ec5c-48d4-a2da-d88a424ce061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae7b4801c294f21b85d9aee7ab45260'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.508926 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2495/4974] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:49 2022] DELETE /identity/v3/users/bae7b4801c294f21b85d9aee7ab45260 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:50.533772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.559402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.560769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.563564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ad57aedb4b4c8bb7e62a5bc9d0b2e9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:50.599648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2480/4975] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:49 2022] DELETE /identity/v3/users/30ad57aedb4b4c8bb7e62a5bc9d0b2e9 => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:50.604463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:50.604779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:50.605055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:50.646624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:50.646624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:50.772825 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2496/4976] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:50.786170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:50.838672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:50.838672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:50.934724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52670099-3e08-4589-914a-23a493474bd6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:50.945134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:50.946365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:50.946815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:50.947320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:50.961016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:50.963996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5b908-56da-43dd-b8d8-7bda81b5292f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:50.983887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2481/4977] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:51.578882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:51.581712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:51.717857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db5a5e-114e-4ad7-9fb5-30b3f35eef48 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:51.726120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:51.733242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:51.733823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:51.734267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] PATH_INFO: `/v3/projects/cdd1c87d09984425a09db7b74f939034` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:51.736007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd1c87d09984425a09db7b74f939034)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:51.740919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:51.935195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd1c87d09984425a09db7b74f939034', 'request_id': 'req-c688d87b-83b3-447b-a34b-7de954157b41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:51.956558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd1c87d09984425a09db7b74f939034', 'request_id': 'req-c688d87b-83b3-447b-a34b-7de954157b41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:51.969478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd1c87d09984425a09db7b74f939034', 'request_id': 'req-c688d87b-83b3-447b-a34b-7de954157b41'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:52.092011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] The token cache is being invalidate because project cdd1c87d09984425a09db7b74f939034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:52.099636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:52.099636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c688d87b-83b3-447b-a34b-7de954157b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:52.102530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2497/4978] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:51 2022] DELETE /identity/v3/projects/cdd1c87d09984425a09db7b74f939034 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:52.104150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:52.104723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:52.104723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:52.208064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:52.209346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:52.308859 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2482/4979] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:52.313051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:52.313051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:52.313051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:52.359735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:52.363244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:52.396803 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2498/4980] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:52.403751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:52.419915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:52.425046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c531e1-1de8-40a5-bfc9-b722def84568 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:52.434143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:52.435127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:52.435760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:52.436226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:52.437269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:52.437795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:52.440015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:52.477208 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2483/4981] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:52.482022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:52.493734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb3945-7d5d-4d85-bfcc-201e346abedc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:52.526354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:52.530832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:52.531403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:52.531860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:52.532784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:52.535955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:52.611857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:52.718825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:52.728773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2499/4982] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:52 2022] POST /identity/v3/projects => generated 397 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:52.734886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763e1cd-633e-4ba6-bc47-c68711b0149d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:52.827759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:52.828393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:52.828705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:52.828990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:52.830367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:52.835050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:52.990063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2484/4983] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:52 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:52.993971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.013534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21f89-cefd-43e2-b777-a7a8b639a20f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.025967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.026704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.027082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.027457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.028231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.030556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.055841 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2500/4984] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:53.061018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.093657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39249aa3-c8b8-4f8a-b798-8fa756ec15bc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.104340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.105052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.105328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.105677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.107085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.109207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.142695 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2485/4985] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:53.147423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.162655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb2313-a85d-4d81-bb17-fe03021e48f2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.182260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.182910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.183311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.183905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] PATH_INFO: `/v3/projects/3188ff297c7e461e91a0da9ff8bfc61a/users/2aec12daccec44adb552c0ed7f24f421/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.220042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3188ff297c7e461e91a0da9ff8bfc61a, user_id=2aec12daccec44adb552c0ed7f24f421, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.224133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f304f3-b722-4fc3-a3bc-e47c433291bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.244150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.246873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:53.275747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfda94-ee18-4a78-b6a9-c03702d4b37a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.287577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.288560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.289028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.295869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] PATH_INFO: `/v3/projects/51d7fc4440a04b3b96006c1c5109bee2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.299552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51d7fc4440a04b3b96006c1c5109bee2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.302009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.352015 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2501/4986] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:53 2022] PUT /identity/v3/projects/3188ff297c7e461e91a0da9ff8bfc61a/users/2aec12daccec44adb552c0ed7f24f421/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:53.365249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.365567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.365802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.417165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] MFA Rules not processed for user `2aec12daccec44adb552c0ed7f24f421`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:53.418692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:53.537940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2502/4987] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:53.593321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.595089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:53.604661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51d7fc4440a04b3b96006c1c5109bee2', 'request_id': 'req-8b648898-6fc3-447b-84c9-f43b7751159c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:53.620323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51d7fc4440a04b3b96006c1c5109bee2', 'request_id': 'req-8b648898-6fc3-447b-84c9-f43b7751159c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:53.714643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51d7fc4440a04b3b96006c1c5109bee2', 'request_id': 'req-8b648898-6fc3-447b-84c9-f43b7751159c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:53.730564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9fea2-1c45-4bcc-b8b0-205bf76f3b1c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.734291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] The token cache is being invalidate because project 51d7fc4440a04b3b96006c1c5109bee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:53.734522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:53.735202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:53.739584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2486/4988] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:53 2022] DELETE /identity/v3/projects/51d7fc4440a04b3b96006c1c5109bee2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:53.744303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:53.747711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:53.863995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.864756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.865036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.865358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.867603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b648898-6fc3-447b-84c9-f43b7751159c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:53.867869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:53.873192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:53.874063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:53.874534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:53.874927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] PATH_INFO: `/v3/users/abde51bf22f84e0995fc1ace766f568b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:53.876392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abde51bf22f84e0995fc1ace766f568b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.879775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.979100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:53.981734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:53.994221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2503/4989] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:48:54.136811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abde51bf22f84e0995fc1ace766f568b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:54.257199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abde51bf22f84e0995fc1ace766f568b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:54.299475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abde51bf22f84e0995fc1ace766f568b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:54.302748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abde51bf22f84e0995fc1ace766f568b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:54.305853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abde51bf22f84e0995fc1ace766f568b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:54.341165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2487/4990] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:53 2022] DELETE /identity/v3/users/abde51bf22f84e0995fc1ace766f568b => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:54.353641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:55.137434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:55.138983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:55.163406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd82582-8a6c-40ff-a6cf-da564e67c163 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:55.251377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:55.252549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:55.254717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:55.255277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] PATH_INFO: `/v3/users/8e2db6eb17204446a1b19e4c60c2dfa5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:55.256775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2db6eb17204446a1b19e4c60c2dfa5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:55.260553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:55.590396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2db6eb17204446a1b19e4c60c2dfa5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:55.620081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:55.711150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2db6eb17204446a1b19e4c60c2dfa5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:55.734612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2db6eb17204446a1b19e4c60c2dfa5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:55.745321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2db6eb17204446a1b19e4c60c2dfa5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:55.746437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d5ab00dd-40a6-4c26-8532-ad8062b099df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2db6eb17204446a1b19e4c60c2dfa5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:55.750319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:55.752143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:55.759031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2504/4991] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:48:55 2022] DELETE /identity/v3/users/8e2db6eb17204446a1b19e4c60c2dfa5 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:55.776392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56233da8-6a4a-4415-8166-498eeb3e8810 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:55.864878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:55.865806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:55.866252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:55.866652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] PATH_INFO: `/v3/projects/483329394c4645408f8545d2e84a2a6e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:55.868689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=483329394c4645408f8545d2e84a2a6e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:55.870893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:55.880685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:55.990009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '483329394c4645408f8545d2e84a2a6e', 'request_id': 'req-6f25ef08-d04c-4632-98e2-8c39733e2d23'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:56.001950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '483329394c4645408f8545d2e84a2a6e', 'request_id': 'req-6f25ef08-d04c-4632-98e2-8c39733e2d23'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:56.248288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '483329394c4645408f8545d2e84a2a6e', 'request_id': 'req-6f25ef08-d04c-4632-98e2-8c39733e2d23'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:56.264899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] The token cache is being invalidate because project 483329394c4645408f8545d2e84a2a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:56.265404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:56.266306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f25ef08-d04c-4632-98e2-8c39733e2d23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:56.274942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2488/4992] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:55 2022] DELETE /identity/v3/projects/483329394c4645408f8545d2e84a2a6e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:56.277330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:56.277769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:56.277972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:56.313271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:56.314813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:56.435087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2505/4993] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:56.436139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723800-e640-47cf-882b-a0e614005821 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:56.436783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723800-e640-47cf-882b-a0e614005821 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:56.437259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8723800-e640-47cf-882b-a0e614005821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:56.521177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d8723800-e640-47cf-882b-a0e614005821 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:56.531504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8723800-e640-47cf-882b-a0e614005821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:56.572764 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2489/4994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:56.577260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:56.595126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20cac8-8768-4b70-95c0-600fbb543077 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:56.609421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:56.610361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:56.610891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:56.611332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:56.612259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:56.614151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:56.617994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:56.654251 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2506/4995] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:56.659064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8723800-e640-47cf-882b-a0e614005821 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:56.683651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8723800-e640-47cf-882b-a0e614005821 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:56.701338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:56.702118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:56.702505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:56.702881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:56.704473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:56.722159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:56.905201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2490/4996] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:56 2022] POST /identity/v3/projects => generated 381 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:56.906394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:56.922503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57c27-a163-4c1f-b4eb-c7f22bb4860e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:57.108445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:57.110000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.110384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.110777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.112987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:57.115923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:57.264392 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2507/4997] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:56 2022] POST /identity/v3/users => generated 297 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:57.265983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:57.282171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d387ac-0da9-40ec-be14-6b78fe88b098 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:57.283420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:57.285323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:57.302030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:57.307938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.308307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.308942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.309809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:57.311479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:57.319167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd35-e85c-4774-a87f-130acd1a6fc1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:57.331164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:57.337871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:57.338695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.342743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.343059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] PATH_INFO: `/v3/projects/952e3a77e8784db5b41f326d932f78b4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.344360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952e3a77e8784db5b41f326d932f78b4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:57.346344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:57.354676 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2491/4998] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:57.356936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:57.381657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f4f4-d209-4d62-99a7-c4924bb20648 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:57.406005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:57.412866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.414675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.414958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] PATH_INFO: `/v3/projects/9dbf812d0f9b494fafa586d605532dfe/users/d9d5c002c5e847a288f1b882dddd9ea0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.463798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbf812d0f9b494fafa586d605532dfe, user_id=d9d5c002c5e847a288f1b882dddd9ea0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:57.470890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:57.604434 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2492/4999] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:57 2022] PUT /identity/v3/projects/9dbf812d0f9b494fafa586d605532dfe/users/d9d5c002c5e847a288f1b882dddd9ea0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:57.606733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:57.630922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952e3a77e8784db5b41f326d932f78b4', 'request_id': 'req-0c6d9442-021b-474a-a048-b6c498db8c60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:57.652715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952e3a77e8784db5b41f326d932f78b4', 'request_id': 'req-0c6d9442-021b-474a-a048-b6c498db8c60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:57.672856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952e3a77e8784db5b41f326d932f78b4', 'request_id': 'req-0c6d9442-021b-474a-a048-b6c498db8c60'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:57.773622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19fe2f-9e47-4216-92cf-7c506fd54b26 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:57.792468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] The token cache is being invalidate because project 952e3a77e8784db5b41f326d932f78b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:48:57.797251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:57.797251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c6d9442-021b-474a-a048-b6c498db8c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:48:57.797765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2508/5000] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:48:57 2022] DELETE /identity/v3/projects/952e3a77e8784db5b41f326d932f78b4 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:48:57.810089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea345-504b-432a-a921-5dc6c1b8d276 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.810368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea345-504b-432a-a921-5dc6c1b8d276 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.810637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ea345-504b-432a-a921-5dc6c1b8d276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.853931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c90ea345-504b-432a-a921-5dc6c1b8d276 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:57.855661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c90ea345-504b-432a-a921-5dc6c1b8d276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:57.871287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:57.933172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:57.933172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:57.933172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:57.933172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:57.933597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:57.935517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:57.981741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2493/5001] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:48:57.986279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:57.996310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:58.021456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e24637-bd3b-4d41-9700-cd5e4ce45a47 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:58.036315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:58.037131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.037412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.037777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] PATH_INFO: `/v3/projects/9dbf812d0f9b494fafa586d605532dfe/users/d9d5c002c5e847a288f1b882dddd9ea0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.043387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbf812d0f9b494fafa586d605532dfe, user_id=d9d5c002c5e847a288f1b882dddd9ea0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:58.049295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf1a48-2443-433e-9215-d97e1075340d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:58.086874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2509/5002] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:58.107593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.107593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.107593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.110911 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2494/5003] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:57 2022] PUT /identity/v3/projects/9dbf812d0f9b494fafa586d605532dfe/users/d9d5c002c5e847a288f1b882dddd9ea0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:58.131103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.131826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.132299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.156041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:58.159133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:58.193684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] MFA Rules not processed for user `d9d5c002c5e847a288f1b882dddd9ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:58.197200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:58.311897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2510/5004] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:58.313866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:58.332305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec321d-4aba-459c-9e0e-d8254b9f3372 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:58.349185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:58.351444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.351790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.352121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.356850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:48:58.357215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:58.360453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:58.381715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2495/5005] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:58.384658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:58.394291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:58.402631 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2511/5006] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:48:58.403741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:58.424204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7aa3a-b744-4764-8ea5-dce38a8912fb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:58.440303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:58.440303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.440303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.440303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.440756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454a94-1943-4917-afa4-ce0e2b98cd00 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:58.440870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:58.441261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddc8dc-e149-476d-9d03-9ea2382af9df admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:58.456414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:58.457929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.458415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.458790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.459531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:58.461823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:58.598200 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2512/5007] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:58.602627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:58.665935 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2496/5008] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:58.667285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.667801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.668167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.717941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] MFA Rules not processed for user `dfba39e9f7574d87b644341c52476e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:58.738041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:58.794324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8d2ac-a17d-4cd7-9871-01feba775ebe admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:58.887697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2497/5009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:58.889298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:58.951412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:58.955442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:58.960314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:58.964978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:58.965978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:58.974485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60628b57-bc3e-4a69-be95-daddcefca302 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.043601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369032a-dd9a-4515-8eac-5b45ccbee8c0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.049520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.049979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.050322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.050631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.051284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.053335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.094926 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2513/5010] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/users => generated 290 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:48:59.099659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.100065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.100205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.146525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] MFA Rules not processed for user `dfba39e9f7574d87b644341c52476e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:59.148296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:59.166259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2514/5011] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:59.170910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.193395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768899ab-0d90-4e85-bd08-6aea543bfaa4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.200740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.202597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.203847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.210639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.225776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.225776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.226160 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2498/5012] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:48:58 2022] POST /identity/v3/users => generated 291 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:48:59.226160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.233493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:59.236364 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2515/5013] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:59.237714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.267202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ad571-3a9b-4029-8c8b-217c82fb3d61 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.286006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.287561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.288519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.288950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.291115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.294937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.350093 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2516/5014] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:59.350093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.373529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f12b3-14b0-4c96-81df-0eef01c4154e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.386180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.386180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.386629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.386942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.389146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.391628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.412477 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2517/5015] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:59.413582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.432142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b8719-86ee-4770-8c09-a116372bb035 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.438310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5449c-304d-46a0-85ba-ed7d39733c41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.439152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.439904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.440288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.442366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.446912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.446912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.459730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.460390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.460731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.461008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.468544 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2518/5016] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:48:59.473960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:59.475570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.477736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.481585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.496421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f9279-e969-4f7c-9f79-4893878edd06 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.506094 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2499/5017] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:48:59.507024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.507168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.508249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.509719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.529678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139cdc1-987d-4202-9a72-6d864d5a3e4a service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:48:59.531306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] PATH_INFO: `/v3/projects/55a4471c28cb45818f388321acb74608/users/2797455f7ef140948189fab55f654585/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.545873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:48:59.546979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.547126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.548108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] PATH_INFO: `/v3/projects/1184c4115d074cafac2b54e0a55fe796/users/9be4b283c41b412fa487409264127cae/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.560385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a4471c28cb45818f388321acb74608, user_id=2797455f7ef140948189fab55f654585, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.565318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e27701-eb15-4fbb-932b-42f94608dbf8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.607745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1184c4115d074cafac2b54e0a55fe796, user_id=9be4b283c41b412fa487409264127cae, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:48:59.607920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de81da-c5ce-4b9d-9e4d-f95a6af93786 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:48:59.678720 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2519/5018] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:59 2022] PUT /identity/v3/projects/55a4471c28cb45818f388321acb74608/users/2797455f7ef140948189fab55f654585/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:59.685902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.686383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.686764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.715645 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2500/5019] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:48:59 2022] PUT /identity/v3/projects/1184c4115d074cafac2b54e0a55fe796/users/9be4b283c41b412fa487409264127cae/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:48:59.728846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:48:59.729035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:48:59.729269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:48:59.739260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:59.740722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:59.783745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] MFA Rules not processed for user `9be4b283c41b412fa487409264127cae`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:48:59.785067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:59.853949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2520/5020] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:48:59.893730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.897575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:48:59.939068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2501/5021] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:48:59.955923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:48:59.958006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:00.020429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a97e2-a406-47ad-a4ef-7bed4f8b2029 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:00.026488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:00.029095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:00.029095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:00.029095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:00.045060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:00.047824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f6d03-664f-4f35-b536-7f7d26f2bd28 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:00.061686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2521/5022] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:49:00.092229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba89bcd-8210-46ca-8fbd-810e871de6f7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:00.099484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:00.099484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:00.099484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:00.099484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:00.199504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:00.201064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33176daf-3f41-4244-8424-fcc001e60aae service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:00.221940 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2502/5023] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:49:00.240420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:00.461569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa320f-465f-4219-baaf-00dc409673bb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:00.462227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa320f-465f-4219-baaf-00dc409673bb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:00.462227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa320f-465f-4219-baaf-00dc409673bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-0baa320f-465f-4219-baaf-00dc409673bb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:00.469349 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:00.470548 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:00.471699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2522/5024] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:49:00 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:00.502781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:00.502781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:00.503099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:00.533630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] MFA Rules not processed for user `dfba39e9f7574d87b644341c52476e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:00.534916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:00.746184 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2503/5025] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:01.684903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:01.841461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:02.187986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40f3-e21a-42f3-9d69-b2f1705f252d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:02.189858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40f3-e21a-42f3-9d69-b2f1705f252d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:02.190308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d40f3-e21a-42f3-9d69-b2f1705f252d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e44d40f3-e21a-42f3-9d69-b2f1705f252d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:02.217544 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:02.224319 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:02.229821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2523/5026] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:49:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:02.231506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:02.258885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033943f7-e824-486c-90d0-9b33e8bcfedf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:02.270435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:02.271082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:02.271364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:02.271637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] PATH_INFO: `/v3/users/d9d5c002c5e847a288f1b882dddd9ea0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:02.278754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d5c002c5e847a288f1b882dddd9ea0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:02.280876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:02.385599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b469d-042a-4a83-ac79-25c5170ae91f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:02.386174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b469d-042a-4a83-ac79-25c5170ae91f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:02.386621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b469d-042a-4a83-ac79-25c5170ae91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:02.427987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a68b469d-042a-4a83-ac79-25c5170ae91f None None] MFA Rules not processed for user `c97d1f9cf2384ad7baf02cfd017430d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:02.429912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a68b469d-042a-4a83-ac79-25c5170ae91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:02.555315 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2524/5027] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:02.759319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d5c002c5e847a288f1b882dddd9ea0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:02.888159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d5c002c5e847a288f1b882dddd9ea0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:02.923911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d5c002c5e847a288f1b882dddd9ea0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:02.925124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d5c002c5e847a288f1b882dddd9ea0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:02.925971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d5c002c5e847a288f1b882dddd9ea0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:02.956466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2504/5028] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:02 2022] DELETE /identity/v3/users/d9d5c002c5e847a288f1b882dddd9ea0 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:02.964226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7898c1-69e4-42ae-8227-9f68e8a4401c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:02.965551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7898c1-69e4-42ae-8227-9f68e8a4401c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:02.965996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7898c1-69e4-42ae-8227-9f68e8a4401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:03.012259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7a7898c1-69e4-42ae-8227-9f68e8a4401c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:03.015692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a7898c1-69e4-42ae-8227-9f68e8a4401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:03.173431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2525/5029] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:03.196693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:03.198389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:03.412018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44311c9-ec1c-4174-a43f-8bb4ab808e85 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:03.429072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:03.431142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:03.432030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:03.432330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:03.466823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:03.469157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:03.504810 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2505/5030] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:03.980247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:04.230310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:04.230806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:04.231189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:04.240282 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:04.241448 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:04.257320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2526/5031] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:49:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:04.669885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:05.170963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:05.173149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:05.192007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbead65-12d1-4ff2-aa39-43dbc940a8ee service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:05.201968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:05.203167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:05.203648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:05.204433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] PATH_INFO: `/v3/projects/9dbf812d0f9b494fafa586d605532dfe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:05.206242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbf812d0f9b494fafa586d605532dfe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:05.209187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:05.399386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbf812d0f9b494fafa586d605532dfe', 'request_id': 'req-b3f7a078-29eb-45a6-9e19-10b20dd94d18'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:05.414100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:05.466649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbf812d0f9b494fafa586d605532dfe', 'request_id': 'req-b3f7a078-29eb-45a6-9e19-10b20dd94d18'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:05.636964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbf812d0f9b494fafa586d605532dfe', 'request_id': 'req-b3f7a078-29eb-45a6-9e19-10b20dd94d18'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:05.661841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] The token cache is being invalidate because project 9dbf812d0f9b494fafa586d605532dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:05.662538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:05.663454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:05.665610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2506/5032] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:05 2022] DELETE /identity/v3/projects/9dbf812d0f9b494fafa586d605532dfe => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:05.670826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:05.673594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:05.830542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851f4f7-a822-4d5a-84ef-13f57782c9f3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:05.839632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:05.840911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:05.841200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:05.841563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] PATH_INFO: `/v3/users/9be4b283c41b412fa487409264127cae` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:05.843027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be4b283c41b412fa487409264127cae)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:05.846024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:06.171518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:06.256770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be4b283c41b412fa487409264127cae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:06.396769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be4b283c41b412fa487409264127cae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:06.418917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be4b283c41b412fa487409264127cae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:06.433369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be4b283c41b412fa487409264127cae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:06.435013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be4b283c41b412fa487409264127cae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:06.444803 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2527/5033] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:05 2022] DELETE /identity/v3/users/9be4b283c41b412fa487409264127cae => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:07.383029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:07.985337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:07.987202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:08.007793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a078-29eb-45a6-9e19-10b20dd94d18 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:08.098537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:08.099578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:08.100097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:08.100651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] PATH_INFO: `/v3/users/1f968a2793944b0f81a479863dbc76f7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:08.102413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f968a2793944b0f81a479863dbc76f7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:08.106170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:08.353283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:08.355429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:08.405976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:08.417952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269e29c-44ef-4cd5-b204-431b5a73bee3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:08.472022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:08.476419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:08.479588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:08.482733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] PATH_INFO: `/v3/projects/1184c4115d074cafac2b54e0a55fe796` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:08.486781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1184c4115d074cafac2b54e0a55fe796)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:08.493146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f968a2793944b0f81a479863dbc76f7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.495872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:08.618978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f968a2793944b0f81a479863dbc76f7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.662760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f968a2793944b0f81a479863dbc76f7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.663674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f968a2793944b0f81a479863dbc76f7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.664440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f1f09b4-91c6-4390-946f-177e12c07bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f968a2793944b0f81a479863dbc76f7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.690185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2507/5034] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:07 2022] DELETE /identity/v3/users/1f968a2793944b0f81a479863dbc76f7 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:08.699180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:08.701135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:08.703682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:08.711305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:08.757333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:08.760759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:08.767200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1184c4115d074cafac2b54e0a55fe796', 'request_id': 'req-7becb528-7bbc-421c-a232-1641aecc9e08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.789228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1184c4115d074cafac2b54e0a55fe796', 'request_id': 'req-7becb528-7bbc-421c-a232-1641aecc9e08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.821973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1184c4115d074cafac2b54e0a55fe796', 'request_id': 'req-7becb528-7bbc-421c-a232-1641aecc9e08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.881006 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2508/5035] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:08.931763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] The token cache is being invalidate because project 1184c4115d074cafac2b54e0a55fe796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:08.938033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.938033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7becb528-7bbc-421c-a232-1641aecc9e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:08.939281 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2528/5036] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:08 2022] DELETE /identity/v3/projects/1184c4115d074cafac2b54e0a55fe796 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:08.949985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f822-20fb-4089-8cad-3773edb68462 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:08.950187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:08.950608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f822-20fb-4089-8cad-3773edb68462 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:08.951036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f822-20fb-4089-8cad-3773edb68462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:08.952635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:08.986207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-80e7f822-20fb-4089-8cad-3773edb68462 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:08.987783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80e7f822-20fb-4089-8cad-3773edb68462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:09.009669 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2529/5037] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:09.017648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.018231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.018861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.061296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:09.062573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:09.080704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2530/5038] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:09.082563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.121668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79765903-5fb4-45fc-acea-2130a1570c03 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.124134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.124936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.125295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.125645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.128948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:09.129433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.131372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.136592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706b6fa-86e0-4d05-984f-a81fdb9b1b1d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.147428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.148252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.150625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.151012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.153102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:09.155083 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2531/5039] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:09.162663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.177809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c3683-8260-4dcf-86f2-c4ed774a0c7e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.185406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.186131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.186416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.186659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.186777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.187322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.188133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.189501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.213539 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2509/5040] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:09.441118 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2532/5041] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:09 2022] POST /identity/v3/projects => generated 405 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:09.446105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.462618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce5baa-2f5a-46dc-9602-e01dce09fa58 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.542765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.543456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.543805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.544002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.544733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.548824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.695961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2510/5042] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:09 2022] POST /identity/v3/users => generated 303 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:09.697074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.709338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a24f46-53ff-4304-ad0e-24518a80572b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.721941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.722870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.723327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.723760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.725170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.728617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.746120 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2533/5043] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:09.750096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.765373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd3ff1-19fe-4eb0-8ada-ceb46473a0be admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.773312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.774071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.774220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.774507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.775163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.779067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c246f-5d4d-4d2f-954f-8927ec08901b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.809837 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2511/5044] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:09.810082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:09.828030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004c12a-c4b2-4045-985d-bb2f7dfebf12 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:09.836674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:09.837575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.837893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.838122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] PATH_INFO: `/v3/projects/a2fc4ab943a34771986e3e4033a10b08/users/7aaec2e2d3bf4bdd9a18fb7d2a7caf00/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:09.866054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:09.869569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2fc4ab943a34771986e3e4033a10b08, user_id=7aaec2e2d3bf4bdd9a18fb7d2a7caf00, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:09.869569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:09.987007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2534/5045] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:09 2022] PUT /identity/v3/projects/a2fc4ab943a34771986e3e4033a10b08/users/7aaec2e2d3bf4bdd9a18fb7d2a7caf00/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:09.998205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:09.998765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:09.999269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:10.081978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] MFA Rules not processed for user `7aaec2e2d3bf4bdd9a18fb7d2a7caf00`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:10.084254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:10.155253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:10.251292 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2512/5046] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:10.261257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:10.447874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3aa236-9187-4f63-8013-b905be0a0857 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:10.464039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:10.465033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:10.465539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:10.466001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:10.466865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:10.469786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:10.585463 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2535/5047] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:10 2022] POST /identity/v3/projects => generated 407 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:10.589690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:10.609911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e753-6280-4582-b0ad-26d254fec57d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:10.729113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:10.729742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:10.730656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:10.744082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:10.745290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:10.747800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:10.908466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2513/5048] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:10 2022] POST /identity/v3/users => generated 310 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:10.908705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:10.923115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b5e00-678b-4d6d-84df-f0d736023d89 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:10.937391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:10.938013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:10.938292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:10.938562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:10.939221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:10.940952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:10.956504 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2536/5049] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:10.958464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:10.976016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d06ad2-a33d-4762-aff3-8eec9cdf83da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:10.988650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:10.989353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:10.997422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:10.998372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] PATH_INFO: `/v3/projects/40ce69a931574fe6a2ef06caedd549eb/users/463bf5edc6c9430ab5782cc104deabf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.036783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ce69a931574fe6a2ef06caedd549eb, user_id=463bf5edc6c9430ab5782cc104deabf4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.037853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:11.039970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:11.044273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.073070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775aa9dd-d179-4800-a12b-1935017c9719 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:11.105135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:11.106348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.106914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.107502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] PATH_INFO: `/v3/projects/8fabc60192d84a4dad9f31f9c5ff93b5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.118823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fabc60192d84a4dad9f31f9c5ff93b5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.121420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.164035 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2514/5050] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:10 2022] PUT /identity/v3/projects/40ce69a931574fe6a2ef06caedd549eb/users/463bf5edc6c9430ab5782cc104deabf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:11.168424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:11.319459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e266cd-c920-4ebc-b660-484dd5290f78 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:11.326900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fabc60192d84a4dad9f31f9c5ff93b5', 'request_id': 'req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.339073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fabc60192d84a4dad9f31f9c5ff93b5', 'request_id': 'req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.360647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fabc60192d84a4dad9f31f9c5ff93b5', 'request_id': 'req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.472061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:11.473667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.473977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.474288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.475013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.477004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.489774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2515/5051] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:49:11.494378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:11.511314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e30ca84-60b6-4b0b-af13-55d6bd903fa5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:11.513623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] The token cache is being invalidate because project 8fabc60192d84a4dad9f31f9c5ff93b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:11.514089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.514795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.522577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2537/5052] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:11 2022] DELETE /identity/v3/projects/8fabc60192d84a4dad9f31f9c5ff93b5 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:11.526566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:11.528562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:11.529260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.529520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.529792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] PATH_INFO: `/v3/projects/40ce69a931574fe6a2ef06caedd549eb/users/463bf5edc6c9430ab5782cc104deabf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.531316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:11.539348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ce69a931574fe6a2ef06caedd549eb, user_id=463bf5edc6c9430ab5782cc104deabf4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.546314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3003aa5-0e3c-4789-adca-24aa0ab67c21 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.556730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2846fb-5395-4a83-a79b-bd216ba2aaf8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:11.567494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:11.568148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.568426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.571458 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2516/5053] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:11 2022] PUT /identity/v3/projects/40ce69a931574fe6a2ef06caedd549eb/users/463bf5edc6c9430ab5782cc104deabf4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:11.571602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] PATH_INFO: `/v3/users/d37043f6d0d94db5a54ccf16d79933d3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.581710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d37043f6d0d94db5a54ccf16d79933d3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.583778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.587050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.587330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.587753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.654826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:11.662160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] MFA Rules not processed for user `463bf5edc6c9430ab5782cc104deabf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:11.663967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:11.818224 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2517/5054] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:11 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:11.818224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:11.826433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:11.826433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:11.841037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd37043f6d0d94db5a54ccf16d79933d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:11.967412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a184bf-9b82-4132-9c82-7abf89e8075c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:11.981343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:11.982013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:11.982291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:11.982564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] PATH_INFO: `/v3/users/e2be048b612348bc8645e2ff12890db6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:11.983770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2be048b612348bc8645e2ff12890db6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:11.985790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:11.990833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd37043f6d0d94db5a54ccf16d79933d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.020741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd37043f6d0d94db5a54ccf16d79933d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.035640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd37043f6d0d94db5a54ccf16d79933d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.036600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd37043f6d0d94db5a54ccf16d79933d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.056591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2538/5055] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:11 2022] DELETE /identity/v3/users/d37043f6d0d94db5a54ccf16d79933d3 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:12.059677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:12.068750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:12.176801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:12.218158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de375b-2d8b-4e15-95a5-7170a45f24a4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:12.232999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:12.233835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:12.234221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:12.234557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:12.237070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:12.349991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2be048b612348bc8645e2ff12890db6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.380500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:12.382833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:12.395407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2539/5056] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:12 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:12.482474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2be048b612348bc8645e2ff12890db6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.506395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2be048b612348bc8645e2ff12890db6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.507204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2be048b612348bc8645e2ff12890db6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.507823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2be048b612348bc8645e2ff12890db6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:12.539850 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2518/5057] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:11 2022] DELETE /identity/v3/users/e2be048b612348bc8645e2ff12890db6 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:13.178473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:14.325152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:14.326940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:14.501623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:14.503083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:14.508200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ee471-3944-4f13-96ba-1c217f4507e7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:14.658133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:14.659277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:14.659688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:14.660797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] PATH_INFO: `/v3/projects/8f45f7b86c104af5a07c40034429278c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:14.662302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f45f7b86c104af5a07c40034429278c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:14.665814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:14.668082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e598e7-2658-4ea1-b633-773d42c4d8ef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:14.682990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:14.683606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:14.684080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:14.684514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:14.686541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:14.808923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:14.812524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:14.835548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2519/5058] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:49:14.869901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:14.980011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f45f7b86c104af5a07c40034429278c', 'request_id': 'req-28e5b8c8-9b7c-4b51-993a-15f73a10a602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:14.994831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f45f7b86c104af5a07c40034429278c', 'request_id': 'req-28e5b8c8-9b7c-4b51-993a-15f73a10a602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.004342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f45f7b86c104af5a07c40034429278c', 'request_id': 'req-28e5b8c8-9b7c-4b51-993a-15f73a10a602'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.137813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] The token cache is being invalidate because project 8f45f7b86c104af5a07c40034429278c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:15.138129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.140043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.147015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:15.147830 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2540/5059] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:14 2022] DELETE /identity/v3/projects/8f45f7b86c104af5a07c40034429278c => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:15.148575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:15.184927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3046f-6c6a-4edc-9320-1d3847221e3b service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:15.290496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:15.291570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:15.292305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:15.292783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] PATH_INFO: `/v3/users/a891741a9d294fa1b565c18b7c67c887` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:15.294042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a891741a9d294fa1b565c18b7c67c887)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:15.299223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:15.334127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:15.336182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:15.369917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5b8c8-9b7c-4b51-993a-15f73a10a602 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:15.380281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:15.381740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:15.383516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:15.383861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] PATH_INFO: `/v3/projects/e6c0e848b2364e6d93f4e8d9c0e97fe5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:15.386450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c0e848b2364e6d93f4e8d9c0e97fe5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:15.393724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:15.455602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:15.606696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c0e848b2364e6d93f4e8d9c0e97fe5', 'request_id': 'req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.617687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c0e848b2364e6d93f4e8d9c0e97fe5', 'request_id': 'req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.630033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a891741a9d294fa1b565c18b7c67c887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.635297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c0e848b2364e6d93f4e8d9c0e97fe5', 'request_id': 'req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.751574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a891741a9d294fa1b565c18b7c67c887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.783211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a891741a9d294fa1b565c18b7c67c887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.784245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a891741a9d294fa1b565c18b7c67c887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.785140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a891741a9d294fa1b565c18b7c67c887'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.811717 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2520/5060] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:15 2022] DELETE /identity/v3/users/a891741a9d294fa1b565c18b7c67c887 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:15.836691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] The token cache is being invalidate because project e6c0e848b2364e6d93f4e8d9c0e97fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:15.837255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.838047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:15.839651 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2541/5061] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:15 2022] DELETE /identity/v3/projects/e6c0e848b2364e6d93f4e8d9c0e97fe5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:15.843865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:15.845394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:15.994854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d5981-b7cb-4131-aee9-e2ee78ae5f8c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:16.002084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:16.003240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:16.004927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:16.005696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] PATH_INFO: `/v3/users/1768ad5292ca4498bcbcb49f1293f6da` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:16.025662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1768ad5292ca4498bcbcb49f1293f6da)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:16.027883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:16.321412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1768ad5292ca4498bcbcb49f1293f6da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:16.448136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1768ad5292ca4498bcbcb49f1293f6da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:16.477301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1768ad5292ca4498bcbcb49f1293f6da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:16.480642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1768ad5292ca4498bcbcb49f1293f6da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:16.483671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1768ad5292ca4498bcbcb49f1293f6da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:16.517833 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2521/5062] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:15 2022] DELETE /identity/v3/users/1768ad5292ca4498bcbcb49f1293f6da => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:17.437744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:17.630291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:17.957028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:17.958558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:18.107446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:18.112803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:18.179943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d5728-a8b0-4e5d-a5fe-565b5846f8e8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:18.332274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d3827-a9d8-495e-8954-0dda1bf1ee72 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:18.345210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:18.345986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:18.351185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:18.351185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] PATH_INFO: `/v3/users/dfba39e9f7574d87b644341c52476e4d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:18.351185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfba39e9f7574d87b644341c52476e4d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:18.357165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:18.388307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:18.392132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:18.394451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:18.396915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] PATH_INFO: `/v3/projects/ab06f83e0a424658bff125858b807de3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:18.408364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab06f83e0a424658bff125858b807de3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:18.416865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:18.706061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab06f83e0a424658bff125858b807de3', 'request_id': 'req-2524923e-21a1-44f6-ae2b-86a2a2cca77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.715925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab06f83e0a424658bff125858b807de3', 'request_id': 'req-2524923e-21a1-44f6-ae2b-86a2a2cca77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.725783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab06f83e0a424658bff125858b807de3', 'request_id': 'req-2524923e-21a1-44f6-ae2b-86a2a2cca77f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.735188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfba39e9f7574d87b644341c52476e4d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.886020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] The token cache is being invalidate because project ab06f83e0a424658bff125858b807de3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:18.886317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.893043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.897924 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2542/5063] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:17 2022] DELETE /identity/v3/projects/ab06f83e0a424658bff125858b807de3 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:18.901551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:18.901551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:18.978545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfba39e9f7574d87b644341c52476e4d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:18.986784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524923e-21a1-44f6-ae2b-86a2a2cca77f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:18.993109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:18.994256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:18.994882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:18.995423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] PATH_INFO: `/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:18.996880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98c00104ba44fa19d18d03bc5b2ac8e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:18.999130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.009308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfba39e9f7574d87b644341c52476e4d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.011393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfba39e9f7574d87b644341c52476e4d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.013883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1eb2393-9486-4535-b5ca-dc204fe641a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfba39e9f7574d87b644341c52476e4d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.053578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2522/5064] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:18 2022] DELETE /identity/v3/users/dfba39e9f7574d87b644341c52476e4d => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:19.055712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32247f-fad3-4489-a767-176bb71fdc14 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.056784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32247f-fad3-4489-a767-176bb71fdc14 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.057770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32247f-fad3-4489-a767-176bb71fdc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.087302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7e32247f-fad3-4489-a767-176bb71fdc14 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:19.089170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e32247f-fad3-4489-a767-176bb71fdc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:19.183319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98c00104ba44fa19d18d03bc5b2ac8e', 'request_id': 'req-fbd7c76a-43fc-4e3b-b165-8648314411ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.218083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98c00104ba44fa19d18d03bc5b2ac8e', 'request_id': 'req-fbd7c76a-43fc-4e3b-b165-8648314411ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.239218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98c00104ba44fa19d18d03bc5b2ac8e', 'request_id': 'req-fbd7c76a-43fc-4e3b-b165-8648314411ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.251421 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2523/5065] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:19.255716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cbf1-330c-4466-ad63-9f0739c771e2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.256544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cbf1-330c-4466-ad63-9f0739c771e2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.257420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1cbf1-330c-4466-ad63-9f0739c771e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.344602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-10d1cbf1-330c-4466-ad63-9f0739c771e2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:19.346954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10d1cbf1-330c-4466-ad63-9f0739c771e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:19.468651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] The token cache is being invalidate because project f98c00104ba44fa19d18d03bc5b2ac8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:19.468880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.469573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:19.479075 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2543/5066] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:18 2022] DELETE /identity/v3/projects/f98c00104ba44fa19d18d03bc5b2ac8e => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:19.480718 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2524/5067] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:19.484471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.491458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc8f5-4017-43b5-9a7d-c2e68845a287 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.491746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc8f5-4017-43b5-9a7d-c2e68845a287 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.492025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc8f5-4017-43b5-9a7d-c2e68845a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.506502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7c76a-43fc-4e3b-b165-8648314411ae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.521891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.522555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.522835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.523111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.523765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:19.524073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.525741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.552987 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2544/5068] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:19.553936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.561246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-697bc8f5-4017-43b5-9a7d-c2e68845a287 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:19.562441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-697bc8f5-4017-43b5-9a7d-c2e68845a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:19.565064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74aa3-3773-4740-a950-3a2ed42f508b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.570841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.571464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.571749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.572023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.572709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.574892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.584030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2525/5069] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:19.592149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.592443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.592747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.619209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:19.620567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:19.633665 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2526/5070] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:19.641937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.659401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a1819-0056-4833-aad0-6a58af250887 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.682982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.684070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.684710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.685408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.686408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:19.687312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.689396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.711984 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2527/5071] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:19.716841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.727968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d68c79-cd3d-4ce3-84ab-36080f56ba10 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.733727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.734836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.734836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.735125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.736399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.739217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.752243 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2545/5072] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:19.756072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.840955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93334c61-673c-4ef2-806d-dac90041a3b3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.848644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2528/5073] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:19.850287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.853643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.854331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.854618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.854896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.855543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.857844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.967988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcd87b-90ae-4205-8b6d-e801439c05c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:19.976524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:19.977378 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2546/5074] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:19.983764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:19.983764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:19.983764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:19.983764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:19.984157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:19.984243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd6756-ae9e-43ad-84d9-ddeda9e19468 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:19.999074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bc03c-34ca-493a-865c-45b187cd0991 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.009336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:20.011967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.018254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.018254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.018254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.018254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:20.018254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:20.031430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2547/5075] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:49:20.035934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.086617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574b3ad-78ca-4751-a93c-998a9cea99b3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.102800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.103709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.104152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.104714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.105550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:20.107386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:20.126474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2548/5077] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:49:20.126699 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2529/5077] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:19 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:20.128561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018651a-c6dd-4ba1-a626-8136ef545a14 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.128874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018651a-c6dd-4ba1-a626-8136ef545a14 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.131172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7018651a-c6dd-4ba1-a626-8136ef545a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.131365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.152913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc179b33-af23-4f60-8f03-dd37b32d5b6e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.169953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.172938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.172938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.172938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] PATH_INFO: `/v3/projects/ce338ec547424ff38f2537cca88cf3a5/users/b5c0ed1768c543adaa49e1a8f65ed274/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.220676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7018651a-c6dd-4ba1-a626-8136ef545a14 None None] MFA Rules not processed for user `2797455f7ef140948189fab55f654585`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:20.224167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce338ec547424ff38f2537cca88cf3a5, user_id=b5c0ed1768c543adaa49e1a8f65ed274, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:20.226019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7018651a-c6dd-4ba1-a626-8136ef545a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:20.233209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:20.272098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:20.388704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2549/5078] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:20 2022] PUT /identity/v3/projects/ce338ec547424ff38f2537cca88cf3a5/users/b5c0ed1768c543adaa49e1a8f65ed274/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:20.389611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.461874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2530/5079] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:20.466781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.466781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.467093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.515844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e310fff-1f5d-47ca-b05b-465a0a032527 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.518447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.527681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.527681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.527681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.527681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:20.527681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:20.539139 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2550/5080] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:20.540048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.542202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:20.543199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:20.545769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:20.558233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae88a6-7eb3-4d6d-a790-c2770dca7845 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.565001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.565709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.566028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.566307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] PATH_INFO: `/v3/projects/4397600a6e7f4af4ab461b1b30f5b750` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.568063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4397600a6e7f4af4ab461b1b30f5b750)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:20.570896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:20.574526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2531/5081] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:20.575473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.576990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:20.762798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4397600a6e7f4af4ab461b1b30f5b750', 'request_id': 'req-fe0b3c6f-10d8-4540-88fa-255c5631412b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:20.773101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4397600a6e7f4af4ab461b1b30f5b750', 'request_id': 'req-fe0b3c6f-10d8-4540-88fa-255c5631412b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:20.787286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4397600a6e7f4af4ab461b1b30f5b750', 'request_id': 'req-fe0b3c6f-10d8-4540-88fa-255c5631412b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:20.806463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13a82-0dde-47a3-a106-4b8194abf138 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:20.897324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] The token cache is being invalidate because project 4397600a6e7f4af4ab461b1b30f5b750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:20.897641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:20.901365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:20.908816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2551/5082] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:20 2022] DELETE /identity/v3/projects/4397600a6e7f4af4ab461b1b30f5b750 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:20.909808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:20.919447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:20.977803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:20.978700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:20.978875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:20.979157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:20.986340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.103436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b3c6f-10d8-4540-88fa-255c5631412b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:21.117118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:21.117939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.119733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.120263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.121339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:21.134321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:21.141936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2552/5083] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:21.147967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:21.150970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.156933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:21.159128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:21.173246 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2532/5084] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:21.174422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:21.178809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.228793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cf41f-e176-496a-89d0-88c3caade7ad service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:21.234169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:21.235861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.236535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.237065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] PATH_INFO: `/v3/users/c97d1f9cf2384ad7baf02cfd017430d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.239645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97d1f9cf2384ad7baf02cfd017430d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:21.257077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:21.295947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf47662-6671-4452-8bdf-ae017742ec92 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:21.317602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:21.318244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.318526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.318800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.328649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.344101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:21.345604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37660c-ef8a-4d15-8e76-6442e009bfc7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:21.359360 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2553/5085] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:21.360810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.361096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.361690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.396290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:21.397664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.409033 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2554/5086] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:21.410266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:21.426037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc22b21-bf8d-40db-b0f2-84e192ff884d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:21.432669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:21.433522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.433868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.434276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] PATH_INFO: `/v3/projects/391d8c3ea5dd44bda64e207a9587ba4b/users/eefa696a035247cbbffd4735798d8b43/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.471221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=391d8c3ea5dd44bda64e207a9587ba4b, user_id=eefa696a035247cbbffd4735798d8b43, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:21.474977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f554e94-e1a6-4128-b125-95e7e7145cae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:21.612567 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2555/5087] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:21 2022] PUT /identity/v3/projects/391d8c3ea5dd44bda64e207a9587ba4b/users/eefa696a035247cbbffd4735798d8b43/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:21.617038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15699-d678-4780-874b-978b45abfbdc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.617934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15699-d678-4780-874b-978b45abfbdc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.618410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d15699-d678-4780-874b-978b45abfbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.692349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b6d15699-d678-4780-874b-978b45abfbdc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:21.693871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97d1f9cf2384ad7baf02cfd017430d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:21.699862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6d15699-d678-4780-874b-978b45abfbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.799481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2556/5088] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:21.802162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:21.804161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:21.807778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:21.834072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97d1f9cf2384ad7baf02cfd017430d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:21.866404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97d1f9cf2384ad7baf02cfd017430d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:21.868052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97d1f9cf2384ad7baf02cfd017430d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:21.869485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97d1f9cf2384ad7baf02cfd017430d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:21.881373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] MFA Rules not processed for user `eefa696a035247cbbffd4735798d8b43`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:21.889997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:21.900355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2533/5089] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:21 2022] DELETE /identity/v3/users/c97d1f9cf2384ad7baf02cfd017430d2 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:21.903446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:21.905705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:22.040571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2557/5090] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:22.043639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.047751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac5694-8f10-4095-9365-0b5e95b00fb6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.049732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:22.055641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.056369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.056794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.057173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.057946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:22.058588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.060412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.072384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cc825-4288-4cbc-bdcf-3a56de42ee85 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.078981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.080030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.080988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.084118 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2534/5091] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:22.084270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.084270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.084459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.085173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.094977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fff51-888d-48e8-b6e8-1f2ba59c42de admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.100535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.101674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.102061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.102518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.103343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.105715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.245104 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2558/5092] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:22 2022] POST /identity/v3/projects => generated 391 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:22.250385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.290879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2535/5093] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:22 2022] POST /identity/v3/projects => generated 397 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:22.298954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.350152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2888b5-1329-4f20-b241-43b47a7b96a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.405168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:22.442124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064daaa-aafc-4469-8d39-4006b7fc1da0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.463836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.464542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.465037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.465519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.466355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.468348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.492777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.493688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.494213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.494650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.495480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.501579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.509219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:22.646361 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2559/5094] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:22 2022] POST /identity/v3/users => generated 302 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:22.647586 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2536/5095] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:22 2022] POST /identity/v3/users => generated 299 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:22.651382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.652526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.676582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdd43c-9d87-4055-b6a1-816e70dd4324 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.677373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83333e2-75ef-4b0f-bdd1-41ad2450b1da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.686008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.688796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.688953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.689549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.689832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.690076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.690212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.690774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.691542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.692657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.692982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.694994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.712959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2537/5096] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:22.717053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.719537 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2560/5097] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:22.728095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.735235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776ab05-7da9-459b-ae17-0e2422a0b64d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.749115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.749399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1703c8e5-d27f-4274-b853-14beba419c3e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.749863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.750072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.750350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.751004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.755738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.763115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.763803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.764086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.764363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] PATH_INFO: `/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72/users/946aed12003042f3afc16eb3796ff246/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.778359 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2538/5098] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:22.783420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:22.796778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06e6e65e32c4071b6573fdfcdb7dc72, user_id=946aed12003042f3afc16eb3796ff246, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.799475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.810041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0cda0-6ab3-4c75-a0b1-e762cd57d09b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:22.820223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:22.823512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:22.823512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:22.823512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] PATH_INFO: `/v3/projects/892f4c0694c64e21974e5623ede6acfd/users/65b1444789194d61a3a4436630322d31/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:22.888043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892f4c0694c64e21974e5623ede6acfd, user_id=65b1444789194d61a3a4436630322d31, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:22.891155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f2494-dbb3-476f-b9b4-8a511d5e45a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:22.944630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2561/5099] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:22 2022] PUT /identity/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72/users/946aed12003042f3afc16eb3796ff246/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:22.947235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:23.023969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2539/5100] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:22 2022] PUT /identity/v3/projects/892f4c0694c64e21974e5623ede6acfd/users/65b1444789194d61a3a4436630322d31/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:23.027275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.027753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.028286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.075419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ad698-0dee-42c9-8ea6-56da89376fc6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:23.087318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:23.095057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:23.152954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:23.155187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.155692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.156164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.157158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:23.160175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:23.173089 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2562/5101] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:23.177462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:23.190213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564ffd-9b6f-4b86-98de-38e03d89a898 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:23.197984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:23.198894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.199336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.199819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] PATH_INFO: `/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72/users/946aed12003042f3afc16eb3796ff246/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.202115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06e6e65e32c4071b6573fdfcdb7dc72, user_id=946aed12003042f3afc16eb3796ff246, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:23.207984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d9fc-d263-478d-9d3e-46bfa62506d7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:23.223191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2563/5102] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:23 2022] PUT /identity/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72/users/946aed12003042f3afc16eb3796ff246/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:23.234502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.234837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.235159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.257205 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2540/5103] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:23.273595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] MFA Rules not processed for user `946aed12003042f3afc16eb3796ff246`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:23.275671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:23.286493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:23.287818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:23.443156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1705a-c7a4-4282-ba0b-0902c4113ce4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:23.482186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2564/5104] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:23.484384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:23.487060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:23.571465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:23.572087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.572386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.572660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.651676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cae08-3faf-4f03-8094-d5498bf94283 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:23.663388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:23.664050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.664328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.665688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] PATH_INFO: `/v3/projects/50dbedb7dffd4f67adfc30507afc0b98` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.669293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50dbedb7dffd4f67adfc30507afc0b98)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:23.674684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:23.724965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:23.727318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:23.741851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2541/5105] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:23.743626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:23.759790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ead7d-ad77-4020-9a18-91c9ed439e99 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:23.764059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:23.774543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:23.774543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:23.774543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:23.780512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:23.782756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db936112-c6ac-412a-9d4e-404d8bc32b3b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:23.797663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2542/5106] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:23.951318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50dbedb7dffd4f67adfc30507afc0b98', 'request_id': 'req-6448aeaf-9944-4599-8d46-9a935da6deb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:23.961869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50dbedb7dffd4f67adfc30507afc0b98', 'request_id': 'req-6448aeaf-9944-4599-8d46-9a935da6deb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:23.974072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50dbedb7dffd4f67adfc30507afc0b98', 'request_id': 'req-6448aeaf-9944-4599-8d46-9a935da6deb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:24.120280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] The token cache is being invalidate because project 50dbedb7dffd4f67adfc30507afc0b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:24.120794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:24.123150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6448aeaf-9944-4599-8d46-9a935da6deb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:24.131145 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2565/5107] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:23 2022] DELETE /identity/v3/projects/50dbedb7dffd4f67adfc30507afc0b98 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:24.136435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:24.136960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:24.137280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:24.176165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:24.177566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:24.334942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2543/5108] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:24.342844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:24.342844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:24.342844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:24.374513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:24.375747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:24.388539 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2566/5109] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:24.392968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:24.415162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a4fd1-3a53-43cd-8568-be47ea4ecc8e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:24.421374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:24.425067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:24.425982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:24.427166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:24.434965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:24.436366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:24.441174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:24.499014 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2544/5110] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:24.500266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:24.531095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15326fbb-d195-4c9c-be72-686442f4144e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:24.538289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:24.539653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:24.540428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:24.542249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:24.543046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:24.546032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:24.712191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2567/5111] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:24 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:24.716936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:24.730115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:24.737994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021efc-c427-449c-beba-d39b14ad8e56 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:24.875828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:24.879610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:24.879610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:24.879610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:24.879610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:24.881688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:24.995929 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2545/5112] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:24 2022] POST /identity/v3/users => generated 291 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:25.000298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:25.018080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238ddcc-816b-40d7-9dbe-3be3378a99f8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:25.030798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:25.031433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.031777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.035129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.035129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:25.035129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:25.061282 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2568/5113] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:25.066721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:25.080644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bd362-7165-439a-b2ff-b96436ceec10 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:25.090025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:25.090950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.091396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.091917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.094262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:25.096920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1cc90-e0af-468c-92ea-c30064137692 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:25.117413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2546/5114] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:25.120444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:25.136871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4799d-4681-41d9-ab8d-6d203cb569ba admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:25.144276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:25.145207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.146366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.146844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] PATH_INFO: `/v3/projects/d4d92d6616bc4b3aaae1eee2514a74b9/users/3c25208a1dd64b5491cb0635e1928aa8/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.167968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d92d6616bc4b3aaae1eee2514a74b9, user_id=3c25208a1dd64b5491cb0635e1928aa8, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:25.171416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:25.296590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2569/5115] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:25 2022] PUT /identity/v3/projects/d4d92d6616bc4b3aaae1eee2514a74b9/users/3c25208a1dd64b5491cb0635e1928aa8/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:25.307551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.308158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.309002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.360885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] MFA Rules not processed for user `3c25208a1dd64b5491cb0635e1928aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:25.364351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:25.492852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:25.494729 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2547/5116] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:25.572347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:25.604232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde1308-8894-4dfa-90a8-e666d9a12559 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:25.611183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:25.612723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.613685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.614320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.615236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:25.619829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:25.773717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2570/5117] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:25 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:25.776889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:25.807986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d1800-c8f0-4a0c-9296-a72446d5d106 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:25.933993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:25.934708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:25.935375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:25.935925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:25.936694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:25.938904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.037665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:26.093305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2548/5118] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:25 2022] POST /identity/v3/users => generated 297 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:26.094995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.106505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239905f-74d5-468c-bdf5-8dc40c0c7d2d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.117027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.118378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.119223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.119769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.120692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.122578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.149283 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2571/5119] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:26.150411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.169832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75809bce-0f45-4705-b1fa-48fa4ceb76aa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.184416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.185461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.185843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.186218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] PATH_INFO: `/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6/users/719016014b8e489ca55dba94130b1f6e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.219569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5874b8c9efbf455295f93b5b5df7bcf6, user_id=719016014b8e489ca55dba94130b1f6e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.222865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.484253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2549/5120] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:26 2022] PUT /identity/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6/users/719016014b8e489ca55dba94130b1f6e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:26.488390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.499241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573356a-278c-4ad5-b715-1cb246f9ac64 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.611192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.612091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.612565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.613073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.614782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.616761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0fd60-7916-4d5d-a483-b8d325f9d75a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.629454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2572/5121] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:26.633400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.649077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee1ad4-476c-4061-b35b-cb29adc26dbc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.657495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.658587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.659031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.659493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] PATH_INFO: `/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6/users/719016014b8e489ca55dba94130b1f6e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.663328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5874b8c9efbf455295f93b5b5df7bcf6, user_id=719016014b8e489ca55dba94130b1f6e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.666388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.679062 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2550/5122] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:26 2022] PUT /identity/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6/users/719016014b8e489ca55dba94130b1f6e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:26.690106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.690403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.690683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.742791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] MFA Rules not processed for user `719016014b8e489ca55dba94130b1f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:26.744508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:26.856816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2573/5123] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:26.858343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.883716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182aaf6-dc52-4f04-974d-d396e8c6cd8a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.889052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.890228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.890517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.890903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.891692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.893518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invalid input for field 'name': '' is too short Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: On instance['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: On instance['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: '' Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application '' Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.901938 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:49:26.905483 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application '' Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:26.907818 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2551/5124] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:49:26 2022] POST /identity/v3/domains => generated 283 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:26.911121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.921390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb357f-5b15-440c-97e2-121f92c193c8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.926470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.927092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.927377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.927649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.928325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.930127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: On instance['name']: Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: On instance['name']: Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise error Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.937096 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Nov 02 12:49:26.943639 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application On instance['name']: Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:26.945120 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2574/5125] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:49:26 2022] POST /identity/v3/domains => generated 412 bytes in 28 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:49:26.946154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:26.955349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b083c6-247d-4e68-87ad-f030a9415ea6 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:26.961633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:26.962262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:26.962807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:26.963093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:26.963803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:26.965513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:27.182750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2552/5126] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:49:26 2022] POST /identity/v3/domains => generated 276 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:27.191897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:27.204646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de5f83-137d-4adf-a488-d54ca6bbe549 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:27.318365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:27.319537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:27.319998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:27.320546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:27.340866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e24d7ffa6ec94424a4b5e2ccce475b39)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:27.343352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Nov 02 12:49:27.375277 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Nov 02 12:49:27.376646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:27.380598 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2575/5127] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:49:27 2022] DELETE /identity/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39 => generated 120 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:49:27.385240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:27.395844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adb6daf-d9a9-41c5-ab8a-cccb5d5c5c34 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:27.400931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:27.401987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:27.402506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:27.403063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:27.405208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e24d7ffa6ec94424a4b5e2ccce475b39)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:27.407043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:27.444747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:27.445983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:27.598595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:27.620285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:27.622373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:27.626270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2553/5128] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:49:27 2022] PATCH /identity/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39 => generated 277 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:27.631788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:27.634125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:27.651304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a8245-20ed-45f9-b476-351f6225fb5e tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:27.775274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:27.775947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:27.776791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:27.777151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:27.794358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e24d7ffa6ec94424a4b5e2ccce475b39)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:27.797201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:27.840897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:27.847916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.003475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.016826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.028022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.134692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] The token cache is being invalidate because project e24d7ffa6ec94424a4b5e2ccce475b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:28.142505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.142505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.150897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.165086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.167368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e24d7ffa6ec94424a4b5e2ccce475b39', 'request_id': 'req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.187047 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2576/5129] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:49:27 2022] DELETE /identity/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:28.196970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:28.207715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643a110-d957-4785-92c0-827b555bae6d tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:28.316170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:28.317224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:28.318077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:28.318798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/a8a1b2ede0a64764bb0c1a814c8952e3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:28.333141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Could not find domain: a8a1b2ede0a64764bb0c1a814c8952e3.: keystone.exception.DomainNotFound: Could not find domain: a8a1b2ede0a64764bb0c1a814c8952e3. Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a8a1b2ede0a64764bb0c1a814c8952e3. Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:28.349747 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:28.350850 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:49:28.352246 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a8a1b2ede0a64764bb0c1a814c8952e3. Nov 02 12:49:28.359920 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.359920 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2554/5130] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:49:28 2022] DELETE /identity/v3/domains/a8a1b2ede0a64764bb0c1a814c8952e3 => generated 112 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:49:28.361851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:28.361851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:28.386777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a944f-2f18-41b6-ace2-bfd5bcc4d7f9 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:28.406094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:28.406094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:28.406094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:28.406425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:28.406425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:28.406790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:28.563000 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2577/5131] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:49:28 2022] POST /identity/v3/domains => generated 253 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:28.565319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:28.589968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285faa99-5b93-4ba2-ad6c-547fc8252bbd tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:28.715460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:28.716670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:28.717069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:28.717441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:28.718242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:28.722542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:28.788757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.sql.core [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1459891163' for key 'project.ixu_project_name_domain_id'") Nov 02 12:49:28.788757 n-d-857339-6 devstack@keystone.service[82132]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:49:28.788757 n-d-857339-6 devstack@keystone.service[82132]: [parameters: {'id': 'b5a5cb83305b40429ded6867df9a97ca', 'name': 'tempest-domain-dup-1459891163', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:49:28.788757 n-d-857339-6 devstack@keystone.service[82132]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82132) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1459891163.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1459891163. Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:49:28.811452 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1459891163' for key 'project.ixu_project_name_domain_id'") Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Nov 02 12:49:28.812659 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return project_ref.to_dict() Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application yield resource Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise self.value Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application session.commit() Nov 02 12:49:28.813962 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:49:28.815955 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application _emit_insert_statements( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application c = connection._execute_20( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self._execute_context( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Nov 02 12:49:28.818816 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.dialect.do_execute( Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._query(query) Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application conn.query(q) Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result.read() Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:49:28.821205 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application packet.raise_for_error() Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1459891163' for key 'project.ixu_project_name_domain_id'") Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [parameters: {'id': 'b5a5cb83305b40429ded6867df9a97ca', 'name': 'tempest-domain-dup-1459891163', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.829386 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1459891163. Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:28.834487 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.Conflict( Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1459891163. Nov 02 12:49:28.840704 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:28.849058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2555/5132] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:49:28 2022] POST /identity/v3/domains => generated 212 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:49:28.854174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:28.877888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a5a20-51f7-4625-ab91-aa1aa4aedcba tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:28.886531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:28.887457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:28.887735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:28.888005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/2cd16133845e48d18ab1e0d37beb1ab3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:28.917683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2cd16133845e48d18ab1e0d37beb1ab3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:28.920539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:28.961719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:28.962773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.026379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:29.088564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.098779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.108876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:29.111446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:29.116345 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2578/5133] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:49:28 2022] PATCH /identity/v3/domains/2cd16133845e48d18ab1e0d37beb1ab3 => generated 254 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:29.126845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb45ea-54e5-48b1-bbfa-fa80caa216ae tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:29.154719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:29.228201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:29.230576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:29.231205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:29.232203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/2cd16133845e48d18ab1e0d37beb1ab3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:29.247111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2cd16133845e48d18ab1e0d37beb1ab3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:29.249148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:29.281129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.299292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.412136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.424190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.566084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.602065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] The token cache is being invalidate because project 2cd16133845e48d18ab1e0d37beb1ab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:29.603101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.605233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.636766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.654983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.658555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2cd16133845e48d18ab1e0d37beb1ab3', 'request_id': 'req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:29.682888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2556/5134] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:49:29 2022] DELETE /identity/v3/domains/2cd16133845e48d18ab1e0d37beb1ab3 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:29.689151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:29.704063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86030a-9bb0-45da-8b20-d2ee0864143f tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:29.795800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '719016014b8e489ca55dba94130b1f6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5874b8c9efbf455295f93b5b5df7bcf6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:29.797520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:29.798012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:29.798502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] PATH_INFO: `/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:29.812370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7d80b649-ea66-4435-9d26-14f9eb4ae738 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Could not find domain: e24d7ffa6ec94424a4b5e2ccce475b39.: keystone.exception.DomainNotFound: Could not find domain: e24d7ffa6ec94424a4b5e2ccce475b39. Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e24d7ffa6ec94424a4b5e2ccce475b39. Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:29.819187 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:29.820317 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:49:29.821702 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e24d7ffa6ec94424a4b5e2ccce475b39. Nov 02 12:49:29.823294 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:29.828743 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2579/5135] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:49:29 2022] PATCH /identity/v3/domains/e24d7ffa6ec94424a4b5e2ccce475b39 => generated 112 bytes in 140 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:49:29.831210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:29.833294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:29.980959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da55e0-76ba-4fb5-bcae-bd0b3ff07233 tempest-DomainsNegativeTestJSON-110995172 tempest-DomainsNegativeTestJSON-110995172-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:29.986387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:29.987379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:29.988292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:29.989061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] PATH_INFO: `/v3/users/3c25208a1dd64b5491cb0635e1928aa8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:29.990522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c25208a1dd64b5491cb0635e1928aa8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:29.993012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:30.397895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:30.616813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c25208a1dd64b5491cb0635e1928aa8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:30.770661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c25208a1dd64b5491cb0635e1928aa8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:30.825769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:30.828366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c25208a1dd64b5491cb0635e1928aa8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:30.829154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c25208a1dd64b5491cb0635e1928aa8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:30.829950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c25208a1dd64b5491cb0635e1928aa8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:30.859359 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2557/5136] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:29 2022] DELETE /identity/v3/users/3c25208a1dd64b5491cb0635e1928aa8 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:30.860600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:30.861101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:30.861560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:30.904222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:30.906047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:31.164406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2580/5137] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:31.180863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:31.187272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:31.318044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9bf99-d2a8-4589-a847-cdf60a0d54b3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:31.322393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:31.323027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:31.323676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:31.323947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:31.336783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:31.338288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:31.353951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2558/5138] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:32.792031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:33.041459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:33.043813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:33.063397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17ea5d-298e-4ce4-9acd-174329095606 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:33.071698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:33.072822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:33.073243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:33.075595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] PATH_INFO: `/v3/projects/d4d92d6616bc4b3aaae1eee2514a74b9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:33.078265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d92d6616bc4b3aaae1eee2514a74b9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:33.079625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:33.085705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:33.300772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d92d6616bc4b3aaae1eee2514a74b9', 'request_id': 'req-e53d523e-df6a-47f1-a576-18d5ac49ba18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:33.317270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d92d6616bc4b3aaae1eee2514a74b9', 'request_id': 'req-e53d523e-df6a-47f1-a576-18d5ac49ba18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:33.330395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d92d6616bc4b3aaae1eee2514a74b9', 'request_id': 'req-e53d523e-df6a-47f1-a576-18d5ac49ba18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:33.452268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] The token cache is being invalidate because project d4d92d6616bc4b3aaae1eee2514a74b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:33.452858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:33.454051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:33.458268 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2581/5139] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:33 2022] DELETE /identity/v3/projects/d4d92d6616bc4b3aaae1eee2514a74b9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:33.462316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:33.477574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51958a2-4cc0-4987-a7dc-b9aa43e21284 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:33.631122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:33.631653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:33.632139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:33.632623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] PATH_INFO: `/v3/users/719016014b8e489ca55dba94130b1f6e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:33.636325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=719016014b8e489ca55dba94130b1f6e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:33.639230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:33.892664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719016014b8e489ca55dba94130b1f6e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:34.070844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719016014b8e489ca55dba94130b1f6e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:34.094164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719016014b8e489ca55dba94130b1f6e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:34.095009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719016014b8e489ca55dba94130b1f6e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:34.095810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719016014b8e489ca55dba94130b1f6e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:34.136011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2559/5140] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:33 2022] DELETE /identity/v3/users/719016014b8e489ca55dba94130b1f6e => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:34.402878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:34.405404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:34.434156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d523e-df6a-47f1-a576-18d5ac49ba18 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:34.684739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:34.685839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:34.686379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:34.687481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] PATH_INFO: `/v3/users/eefa696a035247cbbffd4735798d8b43` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:34.689785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eefa696a035247cbbffd4735798d8b43)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:34.691901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:34.693540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:35.017988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eefa696a035247cbbffd4735798d8b43'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.099804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:35.099804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:35.113973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee2bb-0f7c-493f-876f-23517a758f4e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:35.140844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:35.140972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:35.140972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:35.140972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:35.140972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] PATH_INFO: `/v3/users/2797455f7ef140948189fab55f654585` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:35.144216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2797455f7ef140948189fab55f654585)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:35.147732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:35.168028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eefa696a035247cbbffd4735798d8b43'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.209195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eefa696a035247cbbffd4735798d8b43'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.227797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eefa696a035247cbbffd4735798d8b43'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.230850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-77ed040c-1234-4984-96aa-c956aa3ce0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eefa696a035247cbbffd4735798d8b43'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.246165 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2582/5141] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:34 2022] DELETE /identity/v3/users/eefa696a035247cbbffd4735798d8b43 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:35.250403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:35.254365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:35.254365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:35.293995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:35.302018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:35.462567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2797455f7ef140948189fab55f654585'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.481415 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2583/5142] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:35.549867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:35.551432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:35.608107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2797455f7ef140948189fab55f654585'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.636148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2797455f7ef140948189fab55f654585'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.637024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2797455f7ef140948189fab55f654585'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.639840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2797455f7ef140948189fab55f654585'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:35.696589 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2560/5143] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:35 2022] DELETE /identity/v3/users/2797455f7ef140948189fab55f654585 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:35.730978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0771b-0abe-469e-ad41-0d14e8a7e239 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:35.856117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:35.856806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:35.857466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:35.857753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:35.869532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:35.972076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:35.996955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:35.998697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845f2ba-2efb-4e97-89de-ea7c41b90030 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:36.025274 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2584/5144] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:49:36.906059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:36.907932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:36.933338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c285e-f6c1-4aeb-b2f5-0a58a49afaf9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:36.946706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:36.947503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:36.948793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:36.951940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] PATH_INFO: `/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:36.954585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5874b8c9efbf455295f93b5b5df7bcf6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:36.958667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:37.005586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:37.185124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5874b8c9efbf455295f93b5b5df7bcf6', 'request_id': 'req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.198943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5874b8c9efbf455295f93b5b5df7bcf6', 'request_id': 'req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.239579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:37.271872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5874b8c9efbf455295f93b5b5df7bcf6', 'request_id': 'req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.286706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] The token cache is being invalidate because project 5874b8c9efbf455295f93b5b5df7bcf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:37.287666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.288663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e6785e1b-c751-41f0-9d05-6d6a7eeea82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.291692 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2561/5145] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:36 2022] DELETE /identity/v3/projects/5874b8c9efbf455295f93b5b5df7bcf6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:37.296478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:37.301393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:37.303167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:37.342610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:37.344875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:37.438582 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2585/5146] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:37.447159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:37.448210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:37.448717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:37.477941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:37.479203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:37.494752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2562/5147] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:37.496973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:37.511362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0d0ac-b20d-474f-bc5c-5d2489d7c5cd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:37.525817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:37.526525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:37.526813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:37.527086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:37.527797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:37.528110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:37.529842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:37.544517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2586/5148] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:49:37.548322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:37.563596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d0ce5-4d08-4dbf-b8e4-b21e5bfdf458 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:37.575993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:37.576522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:37.577833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:37.578409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:37.578957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:37.579507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:37.580604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:37.583787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:37.601824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b10c-11b4-474c-9a44-0b939c7e7965 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:37.618512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:37.619176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:37.619459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:37.619790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] PATH_INFO: `/v3/projects/391d8c3ea5dd44bda64e207a9587ba4b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:37.622228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=391d8c3ea5dd44bda64e207a9587ba4b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:37.627687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:37.736835 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2563/5149] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:37 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:49:37.741613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:37.790537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '391d8c3ea5dd44bda64e207a9587ba4b', 'request_id': 'req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.812623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '391d8c3ea5dd44bda64e207a9587ba4b', 'request_id': 'req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.839807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '391d8c3ea5dd44bda64e207a9587ba4b', 'request_id': 'req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:37.927933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032cdb9-2f1b-4e42-a9e3-dc607a0ae4fc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:38.002517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] The token cache is being invalidate because project 391d8c3ea5dd44bda64e207a9587ba4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:38.002517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.002517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.002517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2587/5150] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:37 2022] DELETE /identity/v3/projects/391d8c3ea5dd44bda64e207a9587ba4b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:38.002517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:38.006240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:38.062272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:38.063595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:38.064067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:38.064525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:38.065397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:38.068437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:38.134610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad76f2-cdaf-4657-9ffd-1a3f873801ae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:38.142662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:38.144188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:38.144804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:38.145301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] PATH_INFO: `/v3/users/7aaec2e2d3bf4bdd9a18fb7d2a7caf00` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:38.148424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aaec2e2d3bf4bdd9a18fb7d2a7caf00)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:38.153599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:38.221549 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2564/5151] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:37 2022] POST /identity/v3/users => generated 294 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:38.223883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:38.227343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:38.258142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f774b4-b1db-4d4c-b44f-c0bc74a4e414 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:38.265405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:38.265405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:38.266073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:38.266793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] PATH_INFO: `/v3/users/946aed12003042f3afc16eb3796ff246` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:38.268379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=946aed12003042f3afc16eb3796ff246)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:38.272966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:38.661366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aaec2e2d3bf4bdd9a18fb7d2a7caf00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.662662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946aed12003042f3afc16eb3796ff246'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.756856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aaec2e2d3bf4bdd9a18fb7d2a7caf00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.782730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aaec2e2d3bf4bdd9a18fb7d2a7caf00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.790374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aaec2e2d3bf4bdd9a18fb7d2a7caf00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.791285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aaec2e2d3bf4bdd9a18fb7d2a7caf00'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.807953 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2588/5152] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:38 2022] DELETE /identity/v3/users/7aaec2e2d3bf4bdd9a18fb7d2a7caf00 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:38.807953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:38.809819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:38.890485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946aed12003042f3afc16eb3796ff246'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.935037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946aed12003042f3afc16eb3796ff246'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.940358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946aed12003042f3afc16eb3796ff246'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.946788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946aed12003042f3afc16eb3796ff246'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:38.982705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2565/5153] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:38 2022] DELETE /identity/v3/users/946aed12003042f3afc16eb3796ff246 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:38.990779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:38.994395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.017263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d13db2-05c1-45a1-9b7d-2ec7fe525095 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:39.087829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:39.166884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:39.167826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.168463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.168982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] PATH_INFO: `/v3/projects/55a4471c28cb45818f388321acb74608` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.175641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a4471c28cb45818f388321acb74608)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:39.176267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50ed56-6e28-4da5-8a36-3547c9a1f7bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:39.181405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:39.182298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:39.183259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.183619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.184015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.186512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:39.189936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd869000-ebae-4784-81a0-68b8bf799e41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:39.207415 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2566/5154] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:39.209693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744a65-f4b8-436f-93c9-75fa2fdfbb5a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.210267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744a65-f4b8-436f-93c9-75fa2fdfbb5a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.211211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49744a65-f4b8-436f-93c9-75fa2fdfbb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.217681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:39.260962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-49744a65-f4b8-436f-93c9-75fa2fdfbb5a None None] MFA Rules not processed for user `b5c0ed1768c543adaa49e1a8f65ed274`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:39.262831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49744a65-f4b8-436f-93c9-75fa2fdfbb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.391703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a4471c28cb45818f388321acb74608', 'request_id': 'req-3455ce83-43cc-453c-8d47-ac6e38baddb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:39.399072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a4471c28cb45818f388321acb74608', 'request_id': 'req-3455ce83-43cc-453c-8d47-ac6e38baddb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:39.406314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a4471c28cb45818f388321acb74608', 'request_id': 'req-3455ce83-43cc-453c-8d47-ac6e38baddb0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:39.424351 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2567/5155] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:39.424351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.424351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.424351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.449163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:39.450579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.562179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2568/5156] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:39.562179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:39.567006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b610029-1f59-4c2f-8f35-1da6e8cac385 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:39.572889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:39.574807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.575324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.575809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.576723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:39.578717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17676-0212-4dbe-9c2c-f20fa676fdc8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:39.593271 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2569/5157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:39.604808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675f8d1-b3c0-4924-ba44-303e7369db74 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.604808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675f8d1-b3c0-4924-ba44-303e7369db74 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.604808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675f8d1-b3c0-4924-ba44-303e7369db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.611907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] The token cache is being invalidate because project 55a4471c28cb45818f388321acb74608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:39.612207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:39.619291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:39.622009 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2589/5158] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:38 2022] DELETE /identity/v3/projects/55a4471c28cb45818f388321acb74608 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:39.622852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:39.626551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3675f8d1-b3c0-4924-ba44-303e7369db74 None None] MFA Rules not processed for user `b5c0ed1768c543adaa49e1a8f65ed274`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:39.629749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.632408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3675f8d1-b3c0-4924-ba44-303e7369db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.648510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455ce83-43cc-453c-8d47-ac6e38baddb0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:39.669129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:39.671642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.672035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.672321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] PATH_INFO: `/v3/projects/ee2905b2825344708641191c0f61f082/users/ab4b5e81e8a84295a8730b37bbd5bec8/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.699375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2905b2825344708641191c0f61f082, user_id=ab4b5e81e8a84295a8730b37bbd5bec8, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:39.702987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:39.724807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2570/5159] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:39.724807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.724807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.724807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.783862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:39.785649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.804361 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2590/5160] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:39 2022] PUT /identity/v3/projects/ee2905b2825344708641191c0f61f082/users/ab4b5e81e8a84295a8730b37bbd5bec8/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:39.805108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:39.811000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.818129 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2571/5161] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:39.819190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:39.820214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.963051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d51f1-3285-47ad-b9b4-049ef46da346 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:39.977306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:39.977940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:39.978224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:39.978500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:39.983200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:39.999989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf311-5421-446f-9f20-e3516bd24d9a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:40.143062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.145169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0ae0e-cf32-42e6-9058-f0629726808a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.166934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:40.167573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.167860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.168136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.172406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2591/5162] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:40.173604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.173748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:40.173931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.174159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.240382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] MFA Rules not processed for user `ab4b5e81e8a84295a8730b37bbd5bec8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:40.240382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:40.308342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.310469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cdca3e-4cba-45e0-b91a-6f267938ad9d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.326890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2572/5163] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:40.328145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.328443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.328758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.355166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2592/5164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:40.370774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:40.375094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:40.375613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:40.376977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:40.396919 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2573/5165] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:40.397411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:40.422531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13803d98-6e77-450e-b571-148b5fba5a14 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:40.422710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88264d61-c282-42b9-a5e3-9ce8a27090a1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:40.435311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:40.441179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.441325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.441325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.441325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.441325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.441666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:40.441775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.443072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.443356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.443709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] PATH_INFO: `/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.445619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06e6e65e32c4071b6573fdfcdb7dc72)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.450151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.585648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2574/5166] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:40 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:40.589373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:40.642405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06e6e65e32c4071b6573fdfcdb7dc72', 'request_id': 'req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:40.655553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06e6e65e32c4071b6573fdfcdb7dc72', 'request_id': 'req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:40.674016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06e6e65e32c4071b6573fdfcdb7dc72', 'request_id': 'req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:40.730407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871f926-e34e-4c50-8189-c26afdb1dc4c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:40.810668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] The token cache is being invalidate because project f06e6e65e32c4071b6573fdfcdb7dc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:40.811146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:40.812918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:40.814735 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2593/5167] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:40 2022] DELETE /identity/v3/projects/f06e6e65e32c4071b6573fdfcdb7dc72 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:40.815332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:40.818830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:40.912014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:40.912767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.913121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.916760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.917741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:40.920120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.920120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac328aa-594c-4468-b688-60a8266cb26b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.920340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ab593-c8ba-4a49-a608-4289fcc8fa6b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:40.925765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:40.926407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.926753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.927039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:40.927689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:40.929762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f6a34d-53d0-44e3-b81a-adb2578f5e6a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:40.940758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.954539 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2575/5168] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:40.955567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:40.957843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:40.958225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.003668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:41.005227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:41.017735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2576/5169] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:41.018683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.026364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:41.033527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2594/5170] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:40 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:41.035309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.037458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.037929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.041291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811f096-1f91-4af7-962a-7cfab00ebffa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.046976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.047692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.048043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.048388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.049131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.051843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.084962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:41.086567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:41.109964 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2595/5171] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:41.112668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.130878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd871-27fc-42e1-ad06-54ce52be9888 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.137593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.138602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.139062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.139508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.140455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.142488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.164652 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2577/5173] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:41 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:41.164652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.165576 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2596/5173] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:41.167586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.181969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708197c1-ed7b-4d25-afae-83df34951244 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.321448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.322222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.322936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.323273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] PATH_INFO: `/v3/projects/4dc6bbb98bc2492397999dea42e67635/users/e870d6eba9a541f39569e416eb32ef2e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.356427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418a3ef-a51f-4176-8d48-6ad4c92dbdcd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.359018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc6bbb98bc2492397999dea42e67635, user_id=e870d6eba9a541f39569e416eb32ef2e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.361110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.361695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.361976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.362336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.367132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:41.370556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.371406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c9e5e-8889-490c-8971-b8d6cdb45e31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.378954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.401317 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2578/5174] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:41.401317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.415745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53647c-fe27-4282-a3ae-c66044cdce17 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.420877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.421513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.421796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.422072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.422717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.424710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.508698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2597/5175] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:41 2022] PUT /identity/v3/projects/4dc6bbb98bc2492397999dea42e67635/users/e870d6eba9a541f39569e416eb32ef2e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:41.508698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.508698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.508698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:41.516874 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:41.518107 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:49:41.525082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2598/5176] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:49:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:41.526200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.603946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2579/5177] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:41 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:41.623294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.623294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:41.652220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4a3d1-b934-49a8-a59b-e7b8366a2882 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.748598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de238d-d3a4-4233-8347-bebc01daf589 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:41.761450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.762117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.762397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.762669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.763327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.774549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.814104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:41.815045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:41.819790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:41.819790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] PATH_INFO: `/v3/projects/a2fc4ab943a34771986e3e4033a10b08` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:41.819790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2fc4ab943a34771986e3e4033a10b08)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:41.820830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:41.919208 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2599/5178] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:41 2022] POST /identity/v3/projects => generated 371 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:41.923825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:41.982946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2fc4ab943a34771986e3e4033a10b08', 'request_id': 'req-ae9892a3-ffab-4033-bc76-98287798702e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.001486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2fc4ab943a34771986e3e4033a10b08', 'request_id': 'req-ae9892a3-ffab-4033-bc76-98287798702e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.100819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d193268-14e8-4e10-bad1-7c3941414b43 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.164760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2fc4ab943a34771986e3e4033a10b08', 'request_id': 'req-ae9892a3-ffab-4033-bc76-98287798702e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.186736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] The token cache is being invalidate because project a2fc4ab943a34771986e3e4033a10b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:42.187031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.187741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.189612 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2580/5179] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:41 2022] DELETE /identity/v3/projects/a2fc4ab943a34771986e3e4033a10b08 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:42.190452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.192990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:42.222209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.223201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.223488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.223766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.224422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.226184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.260589 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2600/5180] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:42.261610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.267700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:42.303444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619201dc-3a66-47c6-b649-8a12fa79ecd1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.317070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.317705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.317984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.318259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.321123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.322611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9892a3-ffab-4033-bc76-98287798702e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.326350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.339163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.339946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.340231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.340558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.344445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.347272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.365835 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2581/5181] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:42.366907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.369678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:42.371092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:42.385618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9362a-4eaa-44ff-bdab-e468e2ffb698 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.392193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.393270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.393862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.394381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] PATH_INFO: `/v3/users/463bf5edc6c9430ab5782cc104deabf4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.396390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=463bf5edc6c9430ab5782cc104deabf4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.399183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.565094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2601/5182] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:42 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:42.570539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.579981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:42.607775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d4db81-77f0-48a8-b7a5-27294d9f8bfc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.622430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.625974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.626563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.627313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] PATH_INFO: `/v3/projects/4dc6bbb98bc2492397999dea42e67635/users/e870d6eba9a541f39569e416eb32ef2e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.630791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc6bbb98bc2492397999dea42e67635, user_id=e870d6eba9a541f39569e416eb32ef2e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.635377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.665578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2602/5183] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:42 2022] PUT /identity/v3/projects/4dc6bbb98bc2492397999dea42e67635/users/e870d6eba9a541f39569e416eb32ef2e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:42.681908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.764801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463bf5edc6c9430ab5782cc104deabf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.842577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21139e78-8a63-493c-8330-6741c269be44 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.860307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:42.861360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:42.861844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:42.862581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:42.863319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:42.867102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:42.880603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463bf5edc6c9430ab5782cc104deabf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.937657 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2603/5184] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:42.939601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:42.953739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463bf5edc6c9430ab5782cc104deabf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.961442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463bf5edc6c9430ab5782cc104deabf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.962023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc799238-cfcd-4e6c-998b-e8312ad4b6cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463bf5edc6c9430ab5782cc104deabf4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:42.977703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617fdb-549e-4029-855d-0280d6624e72 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:42.999641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:43.000331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.000670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.000951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.002023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:43.005515 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2582/5185] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:42 2022] DELETE /identity/v3/users/463bf5edc6c9430ab5782cc104deabf4 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:43.007605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:43.008565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.008928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.009209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.077872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2604/5186] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:43.079185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:43.088689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:43.105432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] MFA Rules not processed for user `e870d6eba9a541f39569e416eb32ef2e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:43.107149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:43.133628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477ded3-6f98-4787-8d2b-f64fa44281c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:43.231899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:43.232740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2583/5187] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:43.234198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:43.235793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:43.356741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:43.358906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.358906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.358906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] PATH_INFO: `/v3/projects/d370c06216734957aebcbad237a18aec/users/850992e758d24a5bbcffd81237623655/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.387334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d370c06216734957aebcbad237a18aec, user_id=850992e758d24a5bbcffd81237623655, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:43.390453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:43.421953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a0191-5764-44ad-9f25-57a493b8ab05 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:43.436405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:43.437569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.440241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.440776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.441599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:43.447554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:43.478111 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2584/5188] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:43.481427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:43.502600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbd6ac-a068-47bc-b926-4d344138ad16 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:43.518675 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2605/5189] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:43 2022] PUT /identity/v3/projects/d370c06216734957aebcbad237a18aec/users/850992e758d24a5bbcffd81237623655/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:43.518675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:43.536156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:43.537013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.537553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.537748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.538488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:43.540763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7dd045-75ef-42bc-a385-2815289380a4 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:43.654532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2df2f-a27d-4fbc-942d-8a815f4f3d78 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:43.662183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:43.663375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.663662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.663987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] PATH_INFO: `/v3/projects/d51481ca43dc4936b4d039170d10afc6/users/ef8649ace0724894a364e01e4fb80250/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.688123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51481ca43dc4936b4d039170d10afc6, user_id=ef8649ace0724894a364e01e4fb80250, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:43.696578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84d6d3-3aed-4b6b-8617-3533ac573db0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:43.716987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2585/5190] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:43 2022] POST /identity/v3/projects => generated 360 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:43.716987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.716987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.716987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.744827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:43.747047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:43.841100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2586/5191] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:43.842201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:43.917791 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2606/5192] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:43 2022] PUT /identity/v3/projects/d51481ca43dc4936b4d039170d10afc6/users/ef8649ace0724894a364e01e4fb80250/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:43.929486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:43.929852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:43.930038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:43.981539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] MFA Rules not processed for user `ef8649ace0724894a364e01e4fb80250`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:43.982934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:43.988760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4581266-13b5-49ee-80a8-14327f96bf30 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:44.062017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:44.100897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2607/5193] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:44.104948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:44.106368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:44.141945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:44.141945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.141945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.142617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-849120912` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.142617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=30521037fb18489eb49df8674bde35dd, value=tempest-tag-849120912)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:44.142617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:44.203646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8a2c6-4162-42cc-adf2-56542c12dedc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:44.218557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:44.219224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.220021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.220305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.335328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:44.337546 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-849120912. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:49:44.337546 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:49:44.337546 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:49:44.338832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:44.346315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2587/5194] 10.222.0.64 () {60 vars in 1330 bytes} [Wed Nov 2 12:49:43 2022] PUT /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-849120912 => generated 0 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Nov 02 12:49:44.347680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:44.357275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:44.372635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402004c-f4c5-4d4b-adab-af796feb1c6b tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:44.384948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2608/5195] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:44.388514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:44.388999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:44.389234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.389807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.392750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.396651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:44.418496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:44.423060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16ebca-d68e-4102-bd82-22e88f59b80b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:44.433273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ec8f8-a1d1-416e-944d-fcaf04202ae4 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:44.448071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:44.448808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.454364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.454364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] PATH_INFO: `/v3/users/2aec12daccec44adb552c0ed7f24f421` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.454635 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2588/5196] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:44.454787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aec12daccec44adb552c0ed7f24f421)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:44.458853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:44.459294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.459575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.459842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.559200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] MFA Rules not processed for user `65b1444789194d61a3a4436630322d31`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:44.560733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:44.670679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2589/5197] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:44.672112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:44.673716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:44.708287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0850139-5ca3-4243-b5cb-7cf564bd1942 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:44.714618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:44.715285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:44.719007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:44.719007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] PATH_INFO: `/v3/projects/40ce69a931574fe6a2ef06caedd549eb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:44.719007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ce69a931574fe6a2ef06caedd549eb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:44.720943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:44.773655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aec12daccec44adb552c0ed7f24f421'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:44.957193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aec12daccec44adb552c0ed7f24f421'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:44.988854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aec12daccec44adb552c0ed7f24f421'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:44.989858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ce69a931574fe6a2ef06caedd549eb', 'request_id': 'req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.004416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aec12daccec44adb552c0ed7f24f421'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.005355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aec12daccec44adb552c0ed7f24f421'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.013612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ce69a931574fe6a2ef06caedd549eb', 'request_id': 'req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.020294 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2609/5198] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:44 2022] DELETE /identity/v3/users/2aec12daccec44adb552c0ed7f24f421 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:45.021373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:45.025359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.073696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:45.148160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ce69a931574fe6a2ef06caedd549eb', 'request_id': 'req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.158540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca3d3d-5227-4087-b300-94d42e7275f8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:45.164419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] The token cache is being invalidate because project 40ce69a931574fe6a2ef06caedd549eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:45.165311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.166773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f1d2fc4e-7c37-4154-b83f-a5fa07713e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:45.171858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:45.172119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2590/5199] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:44 2022] DELETE /identity/v3/projects/40ce69a931574fe6a2ef06caedd549eb => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:45.174218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9550b-ba14-468e-a408-c2867bf77951 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.175382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.175382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.175762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9550b-ba14-468e-a408-c2867bf77951 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.176128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9550b-ba14-468e-a408-c2867bf77951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.177824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-849120912` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.205335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=30521037fb18489eb49df8674bde35dd, value=tempest-tag-849120912)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:45.207729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af00bc2-5dec-4ecf-8a2c-1b74a76314ef tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:45.221255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-90d9550b-ba14-468e-a408-c2867bf77951 None None] MFA Rules not processed for user `65b1444789194d61a3a4436630322d31`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:45.222787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-90d9550b-ba14-468e-a408-c2867bf77951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.234434 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2610/5200] 10.222.0.64 () {58 vars in 1311 bytes} [Wed Nov 2 12:49:45 2022] GET /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-849120912 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:45.241325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.241929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.244629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.287908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:45.291691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.368621 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2591/5201] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:45.371084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.371562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.383936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.420521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2611/5202] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:45.420521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:45.422398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.436615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:45.438418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.455378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f8b27-9160-4395-9888-c39f5aa4032b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:45.458831 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2592/5203] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:45.459875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:45.463452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.467093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:45.468612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.470005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.470400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.475957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=30521037fb18489eb49df8674bde35dd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:45.478274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:45.652009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04c10d-c9ee-44a1-95e5-ba9387df7fb7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:45.661244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:45.662227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.662624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.663009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.666096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.678741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:45.682048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54974e97-9e61-4712-853e-84b36ed13f43 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:45.716792 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2593/5204] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:45.718484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.718868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.719265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.754080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2612/5205] 10.222.0.64 () {60 vars in 1265 bytes} [Wed Nov 2 12:49:45 2022] PUT /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags => generated 141 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:45.754080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:45.773731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.829871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:45.834995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:45.880354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2594/5206] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:45.881944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:45.912398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:45.928733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc6629-83f1-4b5e-a93e-cd3da8d5a766 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:45.948210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:45.949142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:45.970688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:45.970688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:45.982970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=30521037fb18489eb49df8674bde35dd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:45.985859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.015546 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2595/5207] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:49:45 2022] GET /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags => generated 141 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:46.015546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.015790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02f297-04da-4b82-90ed-b599e364c04a tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.027655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.028686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.029152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.029470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55bcd2-1f61-4e75-9711-3fe58aa8dbcd tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.029779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.035109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.037311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.037695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.041663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.041663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:46.041663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.041663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.060425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.064672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.066442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2596/5208] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:46.067656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.094131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2613/5209] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:46.094809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c8179-0fe5-48f3-8b11-9c426b5e15b5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.097533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.102474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.103928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.104335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.104751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-887927489` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.106157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=30521037fb18489eb49df8674bde35dd, value=tempest-tag-887927489)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.109512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.119672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d205-5fac-41b0-9f85-c6e27ed3f071 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.137444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.138759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.138759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.138759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.139530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.141412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.287527 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-887927489. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:49:46.287527 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:49:46.287527 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:49:46.294991 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2614/5210] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:46 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:46.298105 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2597/5211] 10.222.0.64 () {58 vars in 1314 bytes} [Wed Nov 2 12:49:46 2022] DELETE /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-887927489 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:46.303186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.304452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.328267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82e7a0-4aa5-4f90-8225-b70d13d23bfa tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.442907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df205273-5052-475f-b4b3-f517d330b26e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.455299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.457000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.457173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.458058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.461009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.465239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.466146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.467774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.470710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.471118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-887927489` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.493547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=30521037fb18489eb49df8674bde35dd, value=tempest-tag-887927489)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.496092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-6576d36e-feb6-40c1-ab44-086427995c34 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Could not find project tag: tempest-tag-887927489.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-887927489. Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Nov 02 12:49:46.516202 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-887927489. Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2598/5212] 10.222.0.64 () {58 vars in 1311 bytes} [Wed Nov 2 12:49:46 2022] GET /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags/tempest-tag-887927489 => generated 106 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.517618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:49:46.534651 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:49:46.536014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:49:46.562228 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2599/5213] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:49:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 42 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:49:46.562228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.595574 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2615/5214] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:46 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:46.600273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.601532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.613114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.614087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.614549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.614993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.618273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=30521037fb18489eb49df8674bde35dd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.620722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.624137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81bd645-7e4b-4d33-b529-cf39be633498 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.638897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.639532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.640205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.640205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.642837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.649774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.699664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2616/5215] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:49:46.705621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:46.716181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.761746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fe3fc-c668-4627-867c-6675f591205f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.773322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.774161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.774553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.774933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.775713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.780558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.810353 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2617/5216] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:46.817720 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2600/5217] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:49:46 2022] DELETE /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:46.818971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.820249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.841287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0826be-72ba-49aa-ad24-39d1c7e38de8 tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.851617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f45886-e9fb-45ca-af0a-abfee3e05623 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.862430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.863329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.863715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.864174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd/tags` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.872651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.873599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.874464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.875046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] PATH_INFO: `/v3/projects/ea9256b3736f499b91b5f59f34ee6ff8/users/2881d33ec0684ff88f197f0955236d58/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.892046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=30521037fb18489eb49df8674bde35dd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.897647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.925209 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2601/5218] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:49:46 2022] GET /identity/v3/projects/30521037fb18489eb49df8674bde35dd/tags => generated 66 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:49:46.926373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:46.947400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b142661-2fa6-4d1c-a940-78d7f99d05ed tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:46.949444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9256b3736f499b91b5f59f34ee6ff8, user_id=2881d33ec0684ff88f197f0955236d58, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.956775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:46.958426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e870d6eba9a541f39569e416eb32ef2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4dc6bbb98bc2492397999dea42e67635', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:46.959206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:46.962975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:46.963911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] PATH_INFO: `/v3/projects/30521037fb18489eb49df8674bde35dd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:46.965481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30521037fb18489eb49df8674bde35dd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:46.971962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:47.084553 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2618/5219] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:46 2022] PUT /identity/v3/projects/ea9256b3736f499b91b5f59f34ee6ff8/users/2881d33ec0684ff88f197f0955236d58/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:47.086034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:47.091468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:47.162644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30521037fb18489eb49df8674bde35dd', 'request_id': 'req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.191113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30521037fb18489eb49df8674bde35dd', 'request_id': 'req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.235990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d442c4-77ae-4c05-aeb4-6e7529ff6c2f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:47.273631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30521037fb18489eb49df8674bde35dd', 'request_id': 'req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.292580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] The token cache is being invalidate because project 30521037fb18489eb49df8674bde35dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:47.295835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.296894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f5ae04d5-96c3-4306-9e5f-f5f39ae6268f tempest-IdentityV3ProjectTagsTest-1275234007 tempest-IdentityV3ProjectTagsTest-1275234007-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.307261 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2602/5220] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:46 2022] DELETE /identity/v3/projects/30521037fb18489eb49df8674bde35dd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:47.308416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:47.322396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:47.322396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:47.322396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:47.408245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] MFA Rules not processed for user `2881d33ec0684ff88f197f0955236d58`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:47.414560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:47.440433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:47.445459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:47.446157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:47.452454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] PATH_INFO: `/v3/projects/3188ff297c7e461e91a0da9ff8bfc61a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:47.458832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3188ff297c7e461e91a0da9ff8bfc61a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:47.466973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:47.638617 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2603/5221] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:47.646770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:47.648661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:47.667158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:47.691910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f47429-b8b7-41c6-bbbe-c06104cc4c23 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:47.700750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3188ff297c7e461e91a0da9ff8bfc61a', 'request_id': 'req-1231166a-f6e2-43ce-b793-329eb81d5200'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.718633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3188ff297c7e461e91a0da9ff8bfc61a', 'request_id': 'req-1231166a-f6e2-43ce-b793-329eb81d5200'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.726225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3188ff297c7e461e91a0da9ff8bfc61a', 'request_id': 'req-1231166a-f6e2-43ce-b793-329eb81d5200'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.837800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:47.838750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:47.839151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:47.839605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] PATH_INFO: `/v3/users/ab4b5e81e8a84295a8730b37bbd5bec8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:47.841481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4b5e81e8a84295a8730b37bbd5bec8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:47.849947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:47.850103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] The token cache is being invalidate because project 3188ff297c7e461e91a0da9ff8bfc61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:47.850103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.850103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:47.850103 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2619/5222] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:47 2022] DELETE /identity/v3/projects/3188ff297c7e461e91a0da9ff8bfc61a => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:47.850103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:47.850643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:47.980396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231166a-f6e2-43ce-b793-329eb81d5200 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:47.992453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:47.997932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:47.997932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:47.997932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:47.997932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.086333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:48.088253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c431832-8a55-44e8-bd99-53ce49888840 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:48.123424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2620/5223] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:48.125744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ec4e-9015-4c49-b808-54daf11f0430 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.126210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ec4e-9015-4c49-b808-54daf11f0430 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.133612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8ec4e-9015-4c49-b808-54daf11f0430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.216940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4b5e81e8a84295a8730b37bbd5bec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:48.236085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-97d8ec4e-9015-4c49-b808-54daf11f0430 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:48.239102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-97d8ec4e-9015-4c49-b808-54daf11f0430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.256668 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2621/5224] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:48.269296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.270033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.270860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.323730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4b5e81e8a84295a8730b37bbd5bec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:48.339527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:48.342764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.361192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2622/5225] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:48.366087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:48.381567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c811c34-8267-416b-a605-a1194fabea6e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:48.383852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4b5e81e8a84295a8730b37bbd5bec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:48.384841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4b5e81e8a84295a8730b37bbd5bec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:48.385721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-882b3e79-baaf-4fe7-8f38-783e44d02c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4b5e81e8a84295a8730b37bbd5bec8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:48.395392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:48.397537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.397537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.397537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.398036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:48.398488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:48.400641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:48.418533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2623/5226] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:48.422621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:48.424826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.427791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2604/5227] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:47 2022] DELETE /identity/v3/users/ab4b5e81e8a84295a8730b37bbd5bec8 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:48.437501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.437994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.438454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.454633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e60c3-1399-4944-9d43-07ffbe3fe876 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:48.489666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:48.495933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.644839 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2605/5228] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:48.655160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:48.655954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.656337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.657514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.658279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:48.660837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:48.698680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:48.700121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:48.702452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:48.807797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2624/5229] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:48 2022] POST /identity/v3/projects => generated 389 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:48.811704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:48.846657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3ed1c-9031-433c-8a70-55ceb5bd81fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:48.967536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679471af-13f0-4c59-9941-2caf1a1111be admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:48.978781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:48.979842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.980720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:48.994384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.994384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.994655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:48.994655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:48.994655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:48.994655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:48.994655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.008149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:49.009919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.019903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:49.028737 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2606/5230] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:49.155336 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2625/5231] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:48 2022] POST /identity/v3/users => generated 295 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:49.159243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:49.180601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78d0d0-d36f-4572-ab98-aa0b9fcbe317 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:49.196425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:49.206931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:49.206931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:49.206931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:49.206931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:49.206931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.229163 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2607/5232] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:49.230982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:49.250599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab81563-3181-4038-8041-5b8af06838d1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:49.259525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:49.260195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:49.260639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:49.260921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:49.261583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:49.263215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ec65b2-f8a2-4910-a802-b2bc5b09996c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.293850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2626/5233] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:49.302007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:49.339887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7dfc2-f95a-4072-b656-0fe7f780e6a8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:49.367572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:49.370807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:49.371572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:49.373149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] PATH_INFO: `/v3/projects/5300fab6343946668aa03c9b5dd146c8/users/dddad293935746bf941b67f583c8d7ad/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:49.419061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5300fab6343946668aa03c9b5dd146c8, user_id=dddad293935746bf941b67f583c8d7ad, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:49.422118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.563359 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2608/5234] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:49 2022] PUT /identity/v3/projects/5300fab6343946668aa03c9b5dd146c8/users/dddad293935746bf941b67f583c8d7ad/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:49:49.573757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:49.574308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:49.574401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:49.611767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] MFA Rules not processed for user `dddad293935746bf941b67f583c8d7ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:49.614819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:49.753593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2627/5235] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:49.790145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:49.792052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:49.928936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69004507-f122-49a8-9135-298e7423a629 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:49.942179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:49.942831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:49.943237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:49.943675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:49.954460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:49.957525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:49.970273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2609/5236] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:49:50.013988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:51.245285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:51.303490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:51.804939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:51.806762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:51.919082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2378ee-4923-4681-9fca-6649b2f78f5f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:51.926205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:51.926866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:51.927150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:51.927426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] PATH_INFO: `/v3/projects/ee2905b2825344708641191c0f61f082` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:51.928999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2905b2825344708641191c0f61f082)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:51.930615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:52.147522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2905b2825344708641191c0f61f082', 'request_id': 'req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:52.155604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2905b2825344708641191c0f61f082', 'request_id': 'req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:52.176753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2905b2825344708641191c0f61f082', 'request_id': 'req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:52.353410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] The token cache is being invalidate because project ee2905b2825344708641191c0f61f082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:52.359404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:52.359404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:52.359404 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2628/5237] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:51 2022] DELETE /identity/v3/projects/ee2905b2825344708641191c0f61f082 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:52.361882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:52.383716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35345eb0-1501-46b2-89cf-99885518ad58 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:52.552437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:52.553139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:52.553421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:52.553697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] PATH_INFO: `/v3/users/e870d6eba9a541f39569e416eb32ef2e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:52.556369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e870d6eba9a541f39569e416eb32ef2e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:52.560015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:52.871406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e870d6eba9a541f39569e416eb32ef2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:53.037005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e870d6eba9a541f39569e416eb32ef2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:53.053182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e870d6eba9a541f39569e416eb32ef2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:53.053912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e870d6eba9a541f39569e416eb32ef2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:53.055159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e870d6eba9a541f39569e416eb32ef2e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:53.072622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2610/5238] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:52 2022] DELETE /identity/v3/users/e870d6eba9a541f39569e416eb32ef2e => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:53.451162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:53.543043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:54.824998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:54.826698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:54.847677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796f8a6-bc0d-4add-8872-2b8267cc6c0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:54.981287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:55.146358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:55.147809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:55.152146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:55.152730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] PATH_INFO: `/v3/users/b5c0ed1768c543adaa49e1a8f65ed274` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:55.156238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c0ed1768c543adaa49e1a8f65ed274)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:55.162133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:55.670416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c0ed1768c543adaa49e1a8f65ed274'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.714682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:55.718026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:55.747864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82ea08-58b2-4f5b-b800-ab14e63c9490 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:55.765682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:55.766416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:55.766746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:55.767030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] PATH_INFO: `/v3/projects/4dc6bbb98bc2492397999dea42e67635` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:55.770397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc6bbb98bc2492397999dea42e67635)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:55.779161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:55.787419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c0ed1768c543adaa49e1a8f65ed274'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.817612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c0ed1768c543adaa49e1a8f65ed274'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.827680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c0ed1768c543adaa49e1a8f65ed274'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.833226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-18a6a64d-4db8-44d1-b538-5d1447037ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c0ed1768c543adaa49e1a8f65ed274'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.838161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2629/5239] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:54 2022] DELETE /identity/v3/users/b5c0ed1768c543adaa49e1a8f65ed274 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:55.885079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:55.933073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc6bbb98bc2492397999dea42e67635', 'request_id': 'req-3b1fdf75-9200-44fc-bc5e-6f487c729b75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:55.951205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc6bbb98bc2492397999dea42e67635', 'request_id': 'req-3b1fdf75-9200-44fc-bc5e-6f487c729b75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:56.106919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc6bbb98bc2492397999dea42e67635', 'request_id': 'req-3b1fdf75-9200-44fc-bc5e-6f487c729b75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:56.156191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] The token cache is being invalidate because project 4dc6bbb98bc2492397999dea42e67635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:56.156835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:56.158074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3b1fdf75-9200-44fc-bc5e-6f487c729b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:56.161108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2611/5240] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:55 2022] DELETE /identity/v3/projects/4dc6bbb98bc2492397999dea42e67635 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:56.165922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:56.166215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:56.166495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:56.213166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:56.214507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:56.330921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:56.331202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:56.331475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:56.334986 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2630/5241] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:56.366975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:56.368415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:56.385890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2612/5242] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:56.390884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:56.407647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677a6bb-f840-4a74-83fe-5094c50ef4ef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:56.431949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:56.436256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:56.436682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:56.436967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:56.437674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:56.437981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:56.439634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:56.511595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:56.513198 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2631/5243] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:56.531757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1780c-3e86-4929-af54-0eee414d52b5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:56.550466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:56.553213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:56.553792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:56.554336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:56.555233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:56.557550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:56.748346 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2613/5244] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:56 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:49:56.752284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:56.766995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666189-c03b-496a-a418-5bc3b4f8d42d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:56.904198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:56.904827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:56.904955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:56.905187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:56.905829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:56.908420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:57.103068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2632/5245] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:56 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:57.103769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:57.124757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da14b9-0b2a-4583-8af9-c34dc4eb3d30 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:57.135519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:57.136152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:57.136441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:57.137046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:57.137877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:57.139701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:57.165942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2614/5246] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:57.170255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:57.207891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfa98b-530d-4e23-9346-97ae0c504bdd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:57.217679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:57.218609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:57.219057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:57.219492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:57.220651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:57.222566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:57.241293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2633/5247] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:57.245240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:57.261817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599d7f1-846f-4e95-ae5d-ecf486f02c89 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:57.275980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:57.276715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:57.277013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:57.277340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] PATH_INFO: `/v3/projects/36429d035ab44750be6d57f7ba173a01/users/5ec8cf85de7e4e1c9fe6019a494ad3a9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:57.332146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36429d035ab44750be6d57f7ba173a01, user_id=5ec8cf85de7e4e1c9fe6019a494ad3a9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:57.337412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16396b2-c9b4-4544-875e-2acb5503f239 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:57.561106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:57.565732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:57.572652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:57.589514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2c917-4f51-4d48-8134-bed4cb242f31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:57.600148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:57.601194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:57.601946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:57.602519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] PATH_INFO: `/v3/projects/ce338ec547424ff38f2537cca88cf3a5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:57.605179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce338ec547424ff38f2537cca88cf3a5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:57.607458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:57.649249 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2615/5248] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:57 2022] PUT /identity/v3/projects/36429d035ab44750be6d57f7ba173a01/users/5ec8cf85de7e4e1c9fe6019a494ad3a9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:57.661133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:57.661555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:57.663146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:57.747611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] MFA Rules not processed for user `5ec8cf85de7e4e1c9fe6019a494ad3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:57.749457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:57.794399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce338ec547424ff38f2537cca88cf3a5', 'request_id': 'req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:57.816883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce338ec547424ff38f2537cca88cf3a5', 'request_id': 'req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:57.838607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce338ec547424ff38f2537cca88cf3a5', 'request_id': 'req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:57.919191 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2616/5249] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:57.920807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:58.045634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf6bfa-b9cc-458f-a324-5f587ddcb763 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:58.141830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:58.142538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.142827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.144016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.144804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:58.147003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:58.463792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] The token cache is being invalidate because project ce338ec547424ff38f2537cca88cf3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:49:58.467504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:58.467504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5e41f4e0-e18c-4fc3-bff6-7cc17205ac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:58.471151 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2634/5250] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:49:57 2022] DELETE /identity/v3/projects/ce338ec547424ff38f2537cca88cf3a5 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:58.485865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c343-b652-43a2-adb2-c39dc09febcf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.486826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c343-b652-43a2-adb2-c39dc09febcf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.487578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903c343-b652-43a2-adb2-c39dc09febcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.515377 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2617/5251] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:57 2022] POST /identity/v3/projects => generated 385 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:49:58.527080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:58.530615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:58.545914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d903c343-b652-43a2-adb2-c39dc09febcf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:58.547495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d903c343-b652-43a2-adb2-c39dc09febcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:58.709864 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2635/5252] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:49:58.725728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.725728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.725728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.730183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06fda-f7d1-4dc7-bf6e-9e6f7f1eb1ad admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:58.738351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:58.739473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.742085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.743148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.744147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:58.757536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:49:58.762116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:58.788013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2636/5253] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:49:58.793211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:58.810667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:58.827015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3a1ef-f662-489c-b659-0c0a1cd8c9f7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:58.842586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:58.844911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.845215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.845656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.846296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:49:58.846752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:58.849100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:58.879626 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2637/5254] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:49:58.881941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:58.897415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594042-c63b-4ad9-8b45-93e6f49d0861 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:58.904907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:58.907289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:58.907872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:58.908358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:58.910719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:58.912961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:58.954831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:58.963956 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2618/5255] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:58 2022] POST /identity/v3/users => generated 299 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:58.964931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:58.970654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:59.024468 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2638/5256] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:49:58 2022] POST /identity/v3/projects => generated 403 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:59.025519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:59.031877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0780b4-ea63-4cbf-93fc-16b9f1db7a14 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:59.240948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77d849-a458-4165-9392-e25813a53a2e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:59.241788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:59.244011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:59.244305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:59.244609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] PATH_INFO: `/v3/users/65b1444789194d61a3a4436630322d31` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:59.260457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b1444789194d61a3a4436630322d31)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:59.260457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:59.264335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:59.265027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:59.265291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:59.265590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:59.266332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:59.269294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:59.326861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2639/5257] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:49:59.327847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:59.366828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcfc37-3e86-480e-858b-f87c3c6aac6d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:59.385513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:59.385513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:59.385513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:59.385513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:59.385905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:59.387672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:59.565206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:59.582457 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2640/5258] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:49:59 2022] POST /identity/v3/users => generated 302 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:49:59.586603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:59.620711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8fbd9-7832-4979-b932-3fcc64e083ae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:49:59.643429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:49:59.644434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:49:59.644434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:49:59.644705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] PATH_INFO: `/v3/projects/a80227edab4f4b239b0050bdf025c22a/users/aa22bf08a059491ba86bcd536d5422d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:49:59.703878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b1444789194d61a3a4436630322d31'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:59.716301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80227edab4f4b239b0050bdf025c22a, user_id=aa22bf08a059491ba86bcd536d5422d9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:49:59.721197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:49:59.746839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:59.807051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b1444789194d61a3a4436630322d31'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:59.870021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b1444789194d61a3a4436630322d31'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:59.871121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b1444789194d61a3a4436630322d31'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:59.874692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b1444789194d61a3a4436630322d31'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:49:59.876813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2641/5259] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:49:59 2022] PUT /identity/v3/projects/a80227edab4f4b239b0050bdf025c22a/users/aa22bf08a059491ba86bcd536d5422d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:59.878830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:59.891457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:49:59.915428 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2619/5260] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:49:58 2022] DELETE /identity/v3/users/65b1444789194d61a3a4436630322d31 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:49:59.915428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:49:59.915428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:00.126815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3a649-e065-478e-bcff-6ad5bf4f54ce admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.139335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c36ab-5ae3-4fe8-b728-6d6bb6c789ce admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.145764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.147485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.147985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.148442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.149402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.150151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.150859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.151204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.151546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.152480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.154457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.156423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.178527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2642/5261] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:00.182289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:00.196643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2620/5262] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:00.199668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:00.202643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626bd2a5-5c80-49f2-a45b-676650f8ab96 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.216065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.217060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.217541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.217994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.218835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.221378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdff034-adb4-4110-a55b-fb8665b9d66a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.222505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.231993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.233010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.233363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.233736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] PATH_INFO: `/v3/projects/a80227edab4f4b239b0050bdf025c22a/users/aa22bf08a059491ba86bcd536d5422d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.242436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80227edab4f4b239b0050bdf025c22a, user_id=aa22bf08a059491ba86bcd536d5422d9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.252086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a223624-2f46-4a2c-b59f-934014595e08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.254006 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2643/5263] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:00.259775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:00.289709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d468ec-3d82-496a-bce5-4467aac0b2ce admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.295335 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2621/5264] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:00 2022] PUT /identity/v3/projects/a80227edab4f4b239b0050bdf025c22a/users/aa22bf08a059491ba86bcd536d5422d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:00.306534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.307309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.307684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.379417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] MFA Rules not processed for user `aa22bf08a059491ba86bcd536d5422d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:00.379549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:00.508689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.511273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.518978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.519804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] PATH_INFO: `/v3/projects/ed974e0a70584bde8b5ea030e9a5a6cd/users/7646bdf9b14745c5983380cb97f73155/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.571883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed974e0a70584bde8b5ea030e9a5a6cd, user_id=7646bdf9b14745c5983380cb97f73155, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.575923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb2636-8f53-45e7-a3b0-39c6a9b94b23 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.615326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2622/5265] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:00.620693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:00.640752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08261af6-5155-4e12-ab4e-9868e651222b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:00.652058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa22bf08a059491ba86bcd536d5422d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80227edab4f4b239b0050bdf025c22a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:00.653212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.653661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.654123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.654956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:00.657098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:00.710180 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2644/5266] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:00 2022] PUT /identity/v3/projects/ed974e0a70584bde8b5ea030e9a5a6cd/users/7646bdf9b14745c5983380cb97f73155/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:00.723076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:00.724469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:00.725110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:00.795315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] MFA Rules not processed for user `7646bdf9b14745c5983380cb97f73155`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:00.797361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:00.815758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2623/5267] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:00 2022] POST /identity/v3/projects => generated 359 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:00.821984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:00.830496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:00.988581 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2645/5268] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:01.004169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:01.025789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c76aa0b-daf8-413e-92ba-34f097c7954f tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:01.056234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec8cf85de7e4e1c9fe6019a494ad3a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36429d035ab44750be6d57f7ba173a01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:01.058995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:01.060733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:01.062801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] PATH_INFO: `/v3/projects/74a95bc2dc60481ca24724113f34508f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:01.067304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] RBAC: Authorizing `identity:delete_project(project_id=74a95bc2dc60481ca24724113f34508f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Nov 02 12:50:01.083641 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application enforcer_obj._enforce( Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Nov 02 12:50:01.084882 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:01.087240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2624/5269] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:00 2022] DELETE /identity/v3/projects/74a95bc2dc60481ca24724113f34508f => generated 136 bytes in 266 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:01.093274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:01.115854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f259007-39f9-458d-a55f-ef06eed67ed1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:01.238464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:01.239429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:01.239713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:01.239986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] PATH_INFO: `/v3/users/7646bdf9b14745c5983380cb97f73155` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:01.241253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7646bdf9b14745c5983380cb97f73155)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:01.244962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:01.258630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef059ff-4665-4865-a1cf-1c8a92dd0ccd tempest-ProjectsNegativeTestJSON-1995306726 tempest-ProjectsNegativeTestJSON-1995306726-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:01.271981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa22bf08a059491ba86bcd536d5422d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a80227edab4f4b239b0050bdf025c22a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:01.272804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:01.273162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:01.273574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] PATH_INFO: `/v3/projects/74a95bc2dc60481ca24724113f34508f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:01.277175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: Authorizing `identity:delete_project(project_id=74a95bc2dc60481ca24724113f34508f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:01.279390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:01.551963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7646bdf9b14745c5983380cb97f73155'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.573115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74a95bc2dc60481ca24724113f34508f', 'request_id': 'req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.590436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74a95bc2dc60481ca24724113f34508f', 'request_id': 'req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.713190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7646bdf9b14745c5983380cb97f73155'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.729948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:01.753258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7646bdf9b14745c5983380cb97f73155'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.777672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7646bdf9b14745c5983380cb97f73155'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.780543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65f4dd59-ad44-45b4-95da-937e0e1c5f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7646bdf9b14745c5983380cb97f73155'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.793062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74a95bc2dc60481ca24724113f34508f', 'request_id': 'req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.798849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2646/5270] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:01 2022] DELETE /identity/v3/users/7646bdf9b14745c5983380cb97f73155 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:01.803548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:01.804099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:01.804629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:01.809370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] The token cache is being invalidate because project 74a95bc2dc60481ca24724113f34508f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:01.809664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.811587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:01.817042 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2625/5271] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:01 2022] DELETE /identity/v3/projects/74a95bc2dc60481ca24724113f34508f => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:01.824360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:01.826363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:01.861307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:01.869374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:01.995790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:02.013502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7021fd-36ab-41d0-bb73-7cdfeeaaf208 tempest-ProjectsNegativeTestJSON-1790228488 tempest-ProjectsNegativeTestJSON-1790228488-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:02.032357 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2647/5272] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:02.037062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:02.038415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:02.062279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478a136-49d5-438e-9966-ce9e78671994 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:02.073369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:02.074273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:02.074554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:02.074826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] PATH_INFO: `/v3/projects/892f4c0694c64e21974e5623ede6acfd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:02.078662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=892f4c0694c64e21974e5623ede6acfd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:02.080583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:02.165874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:02.181798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:02.182953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:02.184837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] PATH_INFO: `/v3/users/5ec8cf85de7e4e1c9fe6019a494ad3a9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:02.186781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec8cf85de7e4e1c9fe6019a494ad3a9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:02.189333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:02.281316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892f4c0694c64e21974e5623ede6acfd', 'request_id': 'req-d87fa141-3b7e-4697-b843-74fce9f4cdba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.291269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892f4c0694c64e21974e5623ede6acfd', 'request_id': 'req-d87fa141-3b7e-4697-b843-74fce9f4cdba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.308315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892f4c0694c64e21974e5623ede6acfd', 'request_id': 'req-d87fa141-3b7e-4697-b843-74fce9f4cdba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.406318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] The token cache is being invalidate because project 892f4c0694c64e21974e5623ede6acfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:02.412442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.412442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.412442 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2648/5273] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:02 2022] DELETE /identity/v3/projects/892f4c0694c64e21974e5623ede6acfd => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:02.412442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:02.419908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:02.489159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec8cf85de7e4e1c9fe6019a494ad3a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.557613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa141-3b7e-4697-b843-74fce9f4cdba admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:02.563575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:02.563575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:02.564328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:02.564929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:02.568634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:02.599456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec8cf85de7e4e1c9fe6019a494ad3a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.635922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec8cf85de7e4e1c9fe6019a494ad3a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.638861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec8cf85de7e4e1c9fe6019a494ad3a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.640660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ae1b1ef7-8791-41db-afb8-53387a1926e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec8cf85de7e4e1c9fe6019a494ad3a9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:02.693089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2626/5274] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:01 2022] DELETE /identity/v3/users/5ec8cf85de7e4e1c9fe6019a494ad3a9 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:02.698452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:02.699063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:02.701298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:02.779339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:02.783634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bdd83-0f7c-400a-bf3b-3ff583f3b198 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:02.812574 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2649/5275] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:02.817531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbd3a-803c-42e1-a848-47aa1a75155c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:02.819238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbd3a-803c-42e1-a848-47aa1a75155c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:02.819689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adbd3a-803c-42e1-a848-47aa1a75155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:02.869936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98adbd3a-803c-42e1-a848-47aa1a75155c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:02.873183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98adbd3a-803c-42e1-a848-47aa1a75155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:03.078301 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2650/5276] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:03.138542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:03.162146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:03.171365 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2627/5277] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:03.182017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:03.182380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:03.182653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:03.200060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:03.203903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:03.231040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:03.235427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:03.260626 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2651/5278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:03.261521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:03.284868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257078cd-6bd6-4f5f-956e-37417ecd46c3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:03.295001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:03.295716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:03.295992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:03.296326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:03.297098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:03.297460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:03.299219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:03.318151 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2652/5279] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:03.321613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2f5cd-e678-4aa3-b6dc-ef07228c1ef3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:03.323112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:03.331754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:03.336999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:03.337340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:03.338213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:03.348115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384cdbe-eccf-4995-a34e-83d9653a0393 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:03.367361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:03.368390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:03.368939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:03.369411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:03.371119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:03.375604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:03.377600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:03.379241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:03.410141 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2628/5280] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:03.516306 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2653/5281] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:03.522369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:03.539208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc4a05-61a2-4196-aa48-06122fec8c94 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:03.563476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:03.704824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:03.738030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:03.743690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:03.744283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:03.745171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:03.746422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:03.751285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:03.959594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:03.961955 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2629/5282] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:03 2022] POST /identity/v3/users => generated 289 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:03.983249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb61cd4-f253-4d0d-b7bf-1e9eb169e9c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:03.999635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:04.001235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.003436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.004786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.009704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:04.015580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:04.055553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:04.059954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2654/5283] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:04.083865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c5214-2e0e-4786-b199-a58fbf43b1b4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:04.132811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:04.132811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.132811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.132811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.133683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:04.140633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c8c1a-08b0-4fc6-980e-07d4895a16bd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:04.192701 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2630/5284] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:04.196554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:04.230274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80311935-c37d-4226-a884-563dcb59c769 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:04.246118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:04.248294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.249096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.250225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] PATH_INFO: `/v3/projects/658d7b13f50947999abfb7cc7da5cb25/users/b2ee0f7286134291b1f978cbe61fba1f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.310623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658d7b13f50947999abfb7cc7da5cb25, user_id=b2ee0f7286134291b1f978cbe61fba1f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:04.320080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386526a-a515-4857-b040-b38de2437384 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:04.440984 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2655/5285] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:04 2022] PUT /identity/v3/projects/658d7b13f50947999abfb7cc7da5cb25/users/b2ee0f7286134291b1f978cbe61fba1f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:04.447269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.448202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.449023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.499669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:04.502657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:04.647717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621be885-e11a-42fa-9b48-c57467c27514 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.648581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621be885-e11a-42fa-9b48-c57467c27514 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.649543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621be885-e11a-42fa-9b48-c57467c27514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.735710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-621be885-e11a-42fa-9b48-c57467c27514 None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:04.737930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-621be885-e11a-42fa-9b48-c57467c27514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:04.776277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:04.814890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2631/5286] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:04.847200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:04.852717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:04.932940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2656/5287] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:04.936211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:04.936524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:04.936810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:04.969827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:04.972553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:04.988469 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2657/5288] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:04.994710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bd9bf-3a56-469e-9414-68ca51e4d381 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:04.999083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:05.002134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:05.012479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:05.015240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.015646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.017433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.033214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:05.035793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:05.052253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2632/5289] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:05.097020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:05.143187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ea589-dc73-4265-9733-2a38623d1f3c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:05.158700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:05.163511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.163511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.163511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.179901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:05.181909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5371-79a8-4d11-be9a-3a8c81cd0084 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:05.201393 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2658/5290] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:05.239121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:05.241916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:05.263973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f4ec6-ce36-4edd-9532-c91a07b3ce8f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:05.283399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:05.283399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.283399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.283399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] PATH_INFO: `/v3/projects/ed974e0a70584bde8b5ea030e9a5a6cd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.283905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed974e0a70584bde8b5ea030e9a5a6cd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:05.287764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:05.543363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed974e0a70584bde8b5ea030e9a5a6cd', 'request_id': 'req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:05.561470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed974e0a70584bde8b5ea030e9a5a6cd', 'request_id': 'req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:05.667776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed974e0a70584bde8b5ea030e9a5a6cd', 'request_id': 'req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:05.689874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] The token cache is being invalidate because project ed974e0a70584bde8b5ea030e9a5a6cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:05.690672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:05.691720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10a8b53-cf91-41fc-a335-c63f0a8cfdb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:05.697951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2633/5291] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:05 2022] DELETE /identity/v3/projects/ed974e0a70584bde8b5ea030e9a5a6cd => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:05.699534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d592d0-a212-4a0a-a915-3d6c48c9bd16 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.699826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d592d0-a212-4a0a-a915-3d6c48c9bd16 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.700161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d592d0-a212-4a0a-a915-3d6c48c9bd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.744760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a0d592d0-a212-4a0a-a915-3d6c48c9bd16 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:05.746323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0d592d0-a212-4a0a-a915-3d6c48c9bd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:05.870430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2659/5292] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:05.881542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.882041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.884516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.940349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e526-82f4-4f6e-9055-4d6b09983e23 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:05.940818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e526-82f4-4f6e-9055-4d6b09983e23 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:05.940980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:05.941533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e526-82f4-4f6e-9055-4d6b09983e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:05.943119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-efe9e526-82f4-4f6e-9055-4d6b09983e23 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:05.949794 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:05.950889 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:05.961108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2634/5293] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:05.962417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2660/5294] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:05 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:50:05.962569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.013225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.013225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.013225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.015406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38274e5-6430-434e-a523-9ab4e93460d9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.026556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.027611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.027842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.028144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.028835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:06.029151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.041251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:06.045146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:06.061408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.103028 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2635/5295] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:06.107995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.125800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:06.149567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2f659-3095-4787-b28b-3bd4716521c9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.163518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.164947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.165484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.166439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.167331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.170944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.206593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2661/5296] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:06.257322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.258786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:06.323436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2636/5297] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:06 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:06.328231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.420374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e615e5-67d2-4aaa-9524-a18d9bd24aa5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.467092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03929d77-64d7-427a-807e-dfe9871b2ef7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.527334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.528079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.528422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.529404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.530100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.532116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.542221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:06.574482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.575120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.575400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.575718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.588121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:06.677430 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2637/5298] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:06 2022] POST /identity/v3/users => generated 293 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:06.682806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.712408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577260-1dd3-4050-aeae-88315e89ba05 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.730946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.732291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.732600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.732878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.734774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.740953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.774971 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2638/5299] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:06.775982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.788957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.792385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.803495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d16c3-045f-477b-9e29-458b3fd14303 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.820273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.821134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.821684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.821684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.823216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.825215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.844731 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2662/5300] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:06.848851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2639/5301] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:06.850640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.885578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98885f-109c-455f-9f1a-2d3e13ee19ce service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.891931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.894672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.894962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.895237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] PATH_INFO: `/v3/projects/8a5e5bbe2bd149e2be51f8d6ba718c41/users/8d38203277d049a6acb7582883bab681/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.918824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5e5bbe2bd149e2be51f8d6ba718c41, user_id=8d38203277d049a6acb7582883bab681, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:06.939703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9eb3ef-c38c-479a-8e4b-20d15374ac3a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:06.967532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:06.969519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:06.989896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b03b0-9068-4f5b-8595-72cbaa29cf62 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:06.995579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:06.996274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:06.996596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:06.996868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] PATH_INFO: `/v3/projects/36429d035ab44750be6d57f7ba173a01` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:06.999176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36429d035ab44750be6d57f7ba173a01)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:07.001057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:07.114195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2663/5302] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:06 2022] PUT /identity/v3/projects/8a5e5bbe2bd149e2be51f8d6ba718c41/users/8d38203277d049a6acb7582883bab681/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:07.125445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:07.125930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:07.126380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:07.171454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] MFA Rules not processed for user `8d38203277d049a6acb7582883bab681`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:07.174414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:07.266370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36429d035ab44750be6d57f7ba173a01', 'request_id': 'req-dff10d0c-ed6b-4e08-9782-250b9499cd9a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:07.277062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36429d035ab44750be6d57f7ba173a01', 'request_id': 'req-dff10d0c-ed6b-4e08-9782-250b9499cd9a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:07.311521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2664/5303] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:07.325000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:07.326799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:07.482543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4a2f5-08a6-4e37-8a1b-ea21eb7e8dcb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:07.484780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36429d035ab44750be6d57f7ba173a01', 'request_id': 'req-dff10d0c-ed6b-4e08-9782-250b9499cd9a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:07.507180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] The token cache is being invalidate because project 36429d035ab44750be6d57f7ba173a01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:07.507508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:07.509339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dff10d0c-ed6b-4e08-9782-250b9499cd9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:07.518435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2640/5304] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:06 2022] DELETE /identity/v3/projects/36429d035ab44750be6d57f7ba173a01 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:07.526888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:07.526888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:07.526888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:07.539240 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:07.540455 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:07.541731 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2641/5305] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:07 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 21 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:07.569653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:07.569653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:07.676209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:07.676865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:07.677567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:07.677567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:07.681919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:07.729657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:07.736624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:07.738718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:07.739221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:07.739675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] PATH_INFO: `/v3/users/aa22bf08a059491ba86bcd536d5422d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:07.741912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa22bf08a059491ba86bcd536d5422d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:07.745085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:07.770568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:07.822514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:07.825284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bfcf-e0ca-4a4e-87f6-ac32a1f1b8ee service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:07.848105 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2665/5306] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:07.849991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad167-aff0-4e9f-a52b-5ddf5b5cac1c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:07.851912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad167-aff0-4e9f-a52b-5ddf5b5cac1c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:07.852520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ad167-aff0-4e9f-a52b-5ddf5b5cac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:07.880099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f27ad167-aff0-4e9f-a52b-5ddf5b5cac1c None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:07.881359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f27ad167-aff0-4e9f-a52b-5ddf5b5cac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:07.979855 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2666/5307] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:08.028123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa22bf08a059491ba86bcd536d5422d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:08.156865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa22bf08a059491ba86bcd536d5422d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:08.186620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa22bf08a059491ba86bcd536d5422d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:08.187432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa22bf08a059491ba86bcd536d5422d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:08.188126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a18f874d-a1c5-464f-adfc-33f8c33945f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa22bf08a059491ba86bcd536d5422d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:08.226369 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2642/5308] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:07 2022] DELETE /identity/v3/users/aa22bf08a059491ba86bcd536d5422d9 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:08.960623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229a80-094e-455e-92a4-239f06f93cbf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:08.961177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229a80-094e-455e-92a4-239f06f93cbf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:08.961177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92229a80-094e-455e-92a4-239f06f93cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-92229a80-094e-455e-92a4-239f06f93cbf None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:08.968434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:08.969855 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:08.972008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2667/5309] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:09.303601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:09.320804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:09.321511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:09.321882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:09.362698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:09.368680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:09.493610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2643/5310] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:09.936122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:10.085180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f46cce-0326-4445-be2b-aec46bc7ffe5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.086127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f46cce-0326-4445-be2b-aec46bc7ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.086602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f46cce-0326-4445-be2b-aec46bc7ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b2f46cce-0326-4445-be2b-aec46bc7ffe5 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:10.097632 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:10.098871 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:10.101981 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2668/5311] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:10.191207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:10.193865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.260912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.261198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.261477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.307953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:10.312028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.334081 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2669/5312] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:10.380186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66930d0b-a156-4683-be1c-36d4b52065f7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:10.394170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:10.396469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.397309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.397764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] PATH_INFO: `/v3/projects/a80227edab4f4b239b0050bdf025c22a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.401996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80227edab4f4b239b0050bdf025c22a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:10.404376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:10.467136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:10.468906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.531292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:10.609667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80227edab4f4b239b0050bdf025c22a', 'request_id': 'req-409073bc-22de-43dd-a4b1-4c8cc2257808'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:10.634137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80227edab4f4b239b0050bdf025c22a', 'request_id': 'req-409073bc-22de-43dd-a4b1-4c8cc2257808'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:10.670627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4a54-25e7-4a62-b222-f27f136a755b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:10.751889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80227edab4f4b239b0050bdf025c22a', 'request_id': 'req-409073bc-22de-43dd-a4b1-4c8cc2257808'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:10.783444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] The token cache is being invalidate because project a80227edab4f4b239b0050bdf025c22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:10.783764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:10.785614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-409073bc-22de-43dd-a4b1-4c8cc2257808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:10.791561 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2644/5313] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:10 2022] DELETE /identity/v3/projects/a80227edab4f4b239b0050bdf025c22a => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:10.794645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c60-c03b-4ca8-afb3-c45fe21e2402 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.795252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c60-c03b-4ca8-afb3-c45fe21e2402 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.795775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf4c60-c03b-4ca8-afb3-c45fe21e2402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.820248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:10.821435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:10.822620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:10.823339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:10.826369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.834872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3adf4c60-c03b-4ca8-afb3-c45fe21e2402 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:10.836139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3adf4c60-c03b-4ca8-afb3-c45fe21e2402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:10.908607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:10.984245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:10.994237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:11.036577 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2645/5314] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:11.045653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.046344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.047058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.076575 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2670/5315] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:11.134554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:11.143763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:11.173046 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2646/5316] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:11.178156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:11.196151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa642c-7416-4bec-9a6c-f66553f975fe service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:11.201718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:11.212878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.214635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.215813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.219395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:11.220059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:11.227914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:11.284130 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2671/5317] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:11.286713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:11.297771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f183-ed0f-43a6-82c9-4035d455386c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:11.313284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:11.313921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.314220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.314490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.315715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:11.323836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c369ce-6d84-4b70-ae6a-5189d9ee403f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:11.524349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2647/5318] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:11 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:11.526274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:11.558450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6ac7-0e71-4627-affd-ae4ad77c2d48 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:11.715638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:11.716266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.716571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.716842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.717532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:11.719466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c13c9ea-583f-4ad8-b30e-a9694614c89e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:11.831679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.832523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.832893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:11.844415 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:11.845621 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:11.866654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2648/5319] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 31 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:50:11.869931 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2672/5320] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:11 2022] POST /identity/v3/users => generated 285 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:11.885225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:11.925450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7697d7-3831-492b-a881-03a2bafadca4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.925996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7697d7-3831-492b-a881-03a2bafadca4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.926253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7697d7-3831-492b-a881-03a2bafadca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.969435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:11.985298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:11.987707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:11.995071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:11.995493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:11.999611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:11.999611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:12.002118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ae7697d7-3831-492b-a881-03a2bafadca4 None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:12.006432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae7697d7-3831-492b-a881-03a2bafadca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:12.014894 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2649/5321] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:12.020394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:12.073898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa335-e2bb-43ad-9806-d5a7b9de58bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:12.097597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:12.098308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.098638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.098912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.099567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:12.109307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:12.143820 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2650/5322] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:12.150858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2673/5323] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:12.154047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:12.170246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584da720-7fc7-41f3-949b-2ed3327e4e85 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:12.178245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:12.179214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.179881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.180444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] PATH_INFO: `/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/2ba4ffc72a4543f0a77fe0bd0e98c9e6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.201807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e485eda4f2648f1b639dbe2c1504fb2, user_id=2ba4ffc72a4543f0a77fe0bd0e98c9e6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:12.208311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:12.344977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2651/5324] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:12 2022] PUT /identity/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/2ba4ffc72a4543f0a77fe0bd0e98c9e6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:12.357119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac279-fecb-4530-b82b-e2931f7d6eb4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.358056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac279-fecb-4530-b82b-e2931f7d6eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.358556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fac279-fecb-4530-b82b-e2931f7d6eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.409433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-49fac279-fecb-4530-b82b-e2931f7d6eb4 None None] MFA Rules not processed for user `2ba4ffc72a4543f0a77fe0bd0e98c9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:12.411802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-49fac279-fecb-4530-b82b-e2931f7d6eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:12.540266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2674/5325] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:12.543535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:12.631080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614033-91dc-4d2f-bd9d-7db5fd47c3c1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:12.639921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:12.641032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.641368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.641645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.642418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:12.645349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:12.704981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe28e-9468-46f4-99c5-726f7ef274b6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.706357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe28e-9468-46f4-99c5-726f7ef274b6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.706838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe28e-9468-46f4-99c5-726f7ef274b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-afdfe28e-9468-46f4-99c5-726f7ef274b6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:12.714896 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:12.716066 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:12.717233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2675/5326] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:50:12.719289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:12.758863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:12.758863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:12.758863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:12.774277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] MFA Rules not processed for user `850992e758d24a5bbcffd81237623655`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:12.775720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:12.824717 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2652/5327] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:12 2022] POST /identity/v3/projects => generated 369 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:12.828853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:12.846626 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2676/5328] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:12.990658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac130d8-1688-46ba-a107-c41399df37be admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.000856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.005232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.005598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.006109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.007004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.009285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.027022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:13.160887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2653/5329] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:12 2022] POST /identity/v3/users => generated 291 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:13.165427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:13.182336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23240aa-5781-4f2c-8d38-81079d869eef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.197738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.198471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.198755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.199031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.199760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.201999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.204900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:13.207752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:13.224060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dcf70-22e1-4f54-8261-b5e56fab06db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.226600 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2677/5330] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:13.230692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:13.231888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.232674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.239214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.239634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] PATH_INFO: `/v3/users/2881d33ec0684ff88f197f0955236d58` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.242253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2881d33ec0684ff88f197f0955236d58)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.248040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.263500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a290a2-585a-4cbe-9c30-3b268fce9a75 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.291436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.294108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.295851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.297356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] PATH_INFO: `/v3/projects/61d29addecfb45f68efb1add9e638980/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.354449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d29addecfb45f68efb1add9e638980, user_id=a5eb6c7c36064131b2126eb8b4670565, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.360528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f082-3d9f-406b-a3c1-4985c813acdf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.611237 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2678/5331] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:13 2022] PUT /identity/v3/projects/61d29addecfb45f68efb1add9e638980/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:13.616692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.616692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.616692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:13.630013 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:13.631332 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:13.659988 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2679/5332] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:13.659988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:13.711191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2881d33ec0684ff88f197f0955236d58'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:13.788634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.795495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.796436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.796899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.797352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.798180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.801231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.814898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2680/5333] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:13.819272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:13.839900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca889a-e22e-4901-917e-4765d22c4f1c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:13.851276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:13.851276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.851276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.851276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] PATH_INFO: `/v3/projects/61d29addecfb45f68efb1add9e638980/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.854122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d29addecfb45f68efb1add9e638980, user_id=a5eb6c7c36064131b2126eb8b4670565, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:13.858095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c2177-499b-4264-90d7-5307dc30007a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:13.874088 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2681/5334] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:13 2022] PUT /identity/v3/projects/61d29addecfb45f68efb1add9e638980/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:13.888298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:13.890362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:13.890813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:13.928586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2881d33ec0684ff88f197f0955236d58'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:13.979164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2881d33ec0684ff88f197f0955236d58'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:13.984176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2881d33ec0684ff88f197f0955236d58'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:13.988364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b6f294b6-84b9-4741-9073-9ae1a73bc43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2881d33ec0684ff88f197f0955236d58'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:13.999108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] MFA Rules not processed for user `a5eb6c7c36064131b2126eb8b4670565`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:14.004629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:14.021207 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2654/5335] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:13 2022] DELETE /identity/v3/users/2881d33ec0684ff88f197f0955236d58 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:14.022711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:14.023239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:14.023679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:14.069639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:14.071178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:14.145058 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2682/5336] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:14.146780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:14.148323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:14.209376 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2655/5337] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:14.244000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c0d50-fe75-4d19-8866-d61c82af3b67 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:14.251100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:14.252615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:14.253228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:14.255719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:14.256200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:14.257177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:14.258214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:14.260825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:14.336983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa28918-1bdf-4cd2-9ac2-cd628585de9a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:14.343672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:14.350484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:14.350484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:14.350484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:14.361359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:14.363183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:14.382033 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2656/5338] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:14.487181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2683/5339] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:14 2022] POST /identity/v3/projects => generated 367 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:14.491153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:14.521621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398a45-5957-4487-b37e-f3b6a5599a4f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:14.691767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:14.695318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:14.695318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:14.695318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:14.695318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:14.697898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:14.897778 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2657/5340] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:14 2022] POST /identity/v3/users => generated 284 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:14.903975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:14.928703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9b8f-be0a-435f-afc7-bdc79aa49e46 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:14.937246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:14.938545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:14.939569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:14.940120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:14.941204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:14.944124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:14.970293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2684/5341] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:14.973714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:14.990921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3b29-9330-435a-9ed4-bdfc2414d616 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:15.001789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:15.001789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.001789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.001789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.002351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:15.006722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:15.028136 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2658/5342] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:15.032337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.051673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504f6fb-e7d9-47b7-a237-0d9917c90892 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:15.069485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:15.070792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.070792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.077670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] PATH_INFO: `/v3/projects/9988b193cd3741778dbab0aab3ce68fc/users/080d55b2aea5489486f07ff4f9d24dc6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.093794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9988b193cd3741778dbab0aab3ce68fc, user_id=080d55b2aea5489486f07ff4f9d24dc6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:15.097535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b48b63-35df-40b3-8ffa-b5ddc58eaef7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:15.142096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:15.228525 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2685/5343] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:15 2022] PUT /identity/v3/projects/9988b193cd3741778dbab0aab3ce68fc/users/080d55b2aea5489486f07ff4f9d24dc6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:15.233062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.237884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:15.243360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.244457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.244968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.258118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be12a9-ee1d-4d40-a2d1-29114d2d214d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:15.302291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] MFA Rules not processed for user `080d55b2aea5489486f07ff4f9d24dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:15.304632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:15.345261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:15.346841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.347630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.348945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] PATH_INFO: `/v3/projects/ea9256b3736f499b91b5f59f34ee6ff8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.351355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9256b3736f499b91b5f59f34ee6ff8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:15.357590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:15.445793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2686/5344] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:15.458293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.551442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721095f7-8508-4964-b55f-c7b660b29962 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:15.557709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:15.558472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.559000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.559379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.560364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:15.562170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:15.627027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9256b3736f499b91b5f59f34ee6ff8', 'request_id': 'req-22d46c80-cd80-4ac6-b04c-7edd31eacd99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:15.639501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9256b3736f499b91b5f59f34ee6ff8', 'request_id': 'req-22d46c80-cd80-4ac6-b04c-7edd31eacd99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:15.704538 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2687/5345] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:50:15 2022] POST /identity/v3/domains => generated 275 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:15.708630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.754869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:15.757411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9256b3736f499b91b5f59f34ee6ff8', 'request_id': 'req-22d46c80-cd80-4ac6-b04c-7edd31eacd99'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:15.778946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] The token cache is being invalidate because project ea9256b3736f499b91b5f59f34ee6ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:15.779254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:15.779915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22d46c80-cd80-4ac6-b04c-7edd31eacd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:15.782073 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2659/5346] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:15 2022] DELETE /identity/v3/projects/ea9256b3736f499b91b5f59f34ee6ff8 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:15.787344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcaf8-42a6-4581-ab94-d149644feed0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.787823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcaf8-42a6-4581-ab94-d149644feed0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.788101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314dcaf8-42a6-4581-ab94-d149644feed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.813590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-314dcaf8-42a6-4581-ab94-d149644feed0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:15.814965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-314dcaf8-42a6-4581-ab94-d149644feed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:15.847481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45999fd-e27d-46bc-b632-927160129580 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:15.863307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:15.863307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.863307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.863673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.864314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:15.867093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:15.933998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2660/5347] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:15.942129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:15.942477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:15.942798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:15.966188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:15.967542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:15.982100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2661/5348] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:15.990387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.990612 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2688/5349] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:50:15 2022] POST /identity/v3/roles => generated 240 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:15.994341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:15.997660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:16.003393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607a0e-a41c-46a4-9372-4e750b8136e9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.009646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.010213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.010701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.011206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.012035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:16.012351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.014338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.027555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa562122-1183-4a3a-82a3-b82df87b910d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.030084 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2662/5350] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:16.035832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.042199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.042199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.042199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.042669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/9125943c5f234e25b112fc283bbf8584/users/080d55b2aea5489486f07ff4f9d24dc6/roles/76258b2537244862be645b469d68265e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.047393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64587dd5-223b-4d8c-8986-64c387d0ae7b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.053289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.054206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.054588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.055075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.056164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.057807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.061286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9125943c5f234e25b112fc283bbf8584, user_id=080d55b2aea5489486f07ff4f9d24dc6, role_id=76258b2537244862be645b469d68265e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.064389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.177422 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2689/5351] 10.222.0.64 () {60 vars in 1480 bytes} [Wed Nov 2 12:50:15 2022] PUT /identity/v3/domains/9125943c5f234e25b112fc283bbf8584/users/080d55b2aea5489486f07ff4f9d24dc6/roles/76258b2537244862be645b469d68265e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:16.183239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.279219 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2663/5352] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:16 2022] POST /identity/v3/projects => generated 387 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:16.285402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.294425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491b97-7268-4c41-aae0-a690038fc572 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.380814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.382378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.382806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.383182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.386096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.388284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.390572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f26ccd-f865-492c-ac44-17bbef7024c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.398255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.399150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.399581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.400625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.401490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.404803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.513110 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2690/5353] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:50:16 2022] POST /identity/v3/domains => generated 276 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:16.514829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.670977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2664/5354] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:16 2022] POST /identity/v3/users => generated 294 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:16.676044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.680768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0113e-7754-4934-acaa-bbcb9fc7323e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.696915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ce2cd-9266-41df-87f3-a4608cc76e1e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.697555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.698515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.701575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.702186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.705024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.707864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.824349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.825036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.827590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.827943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.828644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.830555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.856845 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2665/5355] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:16 2022] GET /identity/v3/roles => generated 1651 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:16.861852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.865536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2691/5356] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:50:16 2022] POST /identity/v3/roles => generated 240 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:16.870728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.895975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6ce1a-d0ef-43eb-8bc7-7401b009bcd3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.905647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.906553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.906996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.907431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.908277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.910542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.911139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9a6c-e2df-4adc-b01d-09cade388cad tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.927065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.929947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.935829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.935829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.935829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.936183 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2666/5357] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:16 2022] GET /identity/v3/roles => generated 1882 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:16.938681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:16.939101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:16.951286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5a0a-944e-4739-a699-2600474b37c2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:16.960353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:16.962138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:16.963136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:16.963587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] PATH_INFO: `/v3/projects/981eea58b84f4861954ae9ba98f4f3ef/users/f18eb0f70cac4014a6c593989da99e45/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:16.985366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=981eea58b84f4861954ae9ba98f4f3ef, user_id=f18eb0f70cac4014a6c593989da99e45, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:16.988728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e207-c710-49e0-80f3-be737ac5e9f2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:17.075363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2692/5358] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:16 2022] POST /identity/v3/groups => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:17.081975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:17.103138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e00da-dba5-4916-a10c-bf769aa6cef6 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:17.112358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2667/5359] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:16 2022] PUT /identity/v3/projects/981eea58b84f4861954ae9ba98f4f3ef/users/f18eb0f70cac4014a6c593989da99e45/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:17.122642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:17.123278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:17.123840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:17.176170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] MFA Rules not processed for user `f18eb0f70cac4014a6c593989da99e45`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:17.177615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:17.280864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:17.281558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:17.281964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:17.282255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/7f640d374d294478bdc9b7d7d45aca06/users/080d55b2aea5489486f07ff4f9d24dc6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:17.296935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7f640d374d294478bdc9b7d7d45aca06, user_id=080d55b2aea5489486f07ff4f9d24dc6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:17.299861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:17.479853 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2693/5360] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:50:17 2022] PUT /identity/v3/groups/7f640d374d294478bdc9b7d7d45aca06/users/080d55b2aea5489486f07ff4f9d24dc6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:17.482733 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2668/5361] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:17.494649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:17.634961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af2dda-c306-47d6-b3e2-dcc7f61f8976 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:17.650272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:17.651064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:17.651553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:17.652050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/f893565ffe34477292de4313aada8766/groups/7f640d374d294478bdc9b7d7d45aca06/roles/d14d2d890b214569abdb81618125e72d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:17.658334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f893565ffe34477292de4313aada8766, group_id=7f640d374d294478bdc9b7d7d45aca06, role_id=d14d2d890b214569abdb81618125e72d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:17.665029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:17.679580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:17.681061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:17.807176 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2694/5362] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:17 2022] PUT /identity/v3/domains/f893565ffe34477292de4313aada8766/groups/7f640d374d294478bdc9b7d7d45aca06/roles/d14d2d890b214569abdb81618125e72d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:17.812101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:17.829144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c1b38-daa3-4d21-9acf-c937636f0e9f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:17.942111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:17.943734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:17.945569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:17.947094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:17.996896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef613d-978a-4600-9ed6-3a60a499e714 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:17.996896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:18.013485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:18.014310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:18.014722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:18.015101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:18.015966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:18.019795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:18.103911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:18.105528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:18.119285 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2669/5363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:18.212184 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2695/5364] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:50:17 2022] POST /identity/v3/domains => generated 276 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:18.217365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:18.237388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2117b4b-4df6-4f72-ac16-80c603974c6a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:18.379542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:18.380187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:18.380473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:18.380778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:18.381463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:18.383134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:18.396970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:18.500745 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2670/5365] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:50:18 2022] POST /identity/v3/roles => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:18.505164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:18.538785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:18.542605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5971f-deec-463e-858c-7d26d6f09c07 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:18.556429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:18.557154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:18.557438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:18.557720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/6eba7e22d58f4e718e726585d8f199df/users/080d55b2aea5489486f07ff4f9d24dc6/roles/28f6af1317894eabb5f2df48fe3f8fde` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:18.583513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6eba7e22d58f4e718e726585d8f199df, user_id=080d55b2aea5489486f07ff4f9d24dc6, role_id=28f6af1317894eabb5f2df48fe3f8fde)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:18.586630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:18.765638 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2696/5366] 10.222.0.64 () {60 vars in 1480 bytes} [Wed Nov 2 12:50:18 2022] PUT /identity/v3/domains/6eba7e22d58f4e718e726585d8f199df/users/080d55b2aea5489486f07ff4f9d24dc6/roles/28f6af1317894eabb5f2df48fe3f8fde => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:18.771159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:18.801835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd1c15-9255-4921-9bcb-9706b1f4641d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:18.947783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:18.953831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:18.954243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:18.960166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:18.960166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:18.962040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:19.051479 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2671/5367] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:50:18 2022] POST /identity/v3/domains => generated 275 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:19.057157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:19.074925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e70406-a6d3-4223-90b5-958dfa16e9e2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:19.213913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:19.215379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:19.215891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:19.216264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:19.217265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:19.219820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:19.353203 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2697/5368] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:50:19 2022] POST /identity/v3/roles => generated 239 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:19.354404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:19.366280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb4246-ecb0-4b0f-822f-51b577f2815d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:19.398196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:19.398196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:19.398196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:19.398946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:19.398946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:19.398946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:19.623737 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2672/5369] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:19 2022] POST /identity/v3/groups => generated 325 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:19.629807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:19.645239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e742ae-43e9-4653-935e-4a0c45d32f37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:19.654743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:19.656260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:19.658976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:19.659476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/3f41c6285aa145a0b969f6497b4e7363/users/080d55b2aea5489486f07ff4f9d24dc6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:19.705675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3f41c6285aa145a0b969f6497b4e7363, user_id=080d55b2aea5489486f07ff4f9d24dc6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:19.710679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:19.894860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2698/5370] 10.222.0.64 () {60 vars in 1360 bytes} [Wed Nov 2 12:50:19 2022] PUT /identity/v3/groups/3f41c6285aa145a0b969f6497b4e7363/users/080d55b2aea5489486f07ff4f9d24dc6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:19.899318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:19.911594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26775e65-dbf7-41df-8bce-cee0a9514bfe tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:19.979559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:19.980907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:19.981283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:19.981645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/c2abd26542bc4461802e313a732fdd4b/groups/3f41c6285aa145a0b969f6497b4e7363/roles/e852dcf1a97e44a98fd44bd526bda855` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:19.985178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c2abd26542bc4461802e313a732fdd4b, group_id=3f41c6285aa145a0b969f6497b4e7363, role_id=e852dcf1a97e44a98fd44bd526bda855)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:19.989413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:20.169846 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2673/5371] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:19 2022] PUT /identity/v3/domains/c2abd26542bc4461802e313a732fdd4b/groups/3f41c6285aa145a0b969f6497b4e7363/roles/e852dcf1a97e44a98fd44bd526bda855 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:20.173884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:20.175669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:20.289224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557c016-f580-4e56-b431-26dd1915401d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:20.427799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '080d55b2aea5489486f07ff4f9d24dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9988b193cd3741778dbab0aab3ce68fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:20.428828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:20.429147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:20.429412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] PATH_INFO: `/v3/auth/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:20.430364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:20.431572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:20.630653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2699/5372] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:50:20 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:20.634892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:20.753170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5cea8-d8b5-4f16-9d43-06dcfeb63d3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:20.758868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:20.763940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:20.764503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:20.764945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/c2abd26542bc4461802e313a732fdd4b/groups/3f41c6285aa145a0b969f6497b4e7363/roles/e852dcf1a97e44a98fd44bd526bda855` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:20.767527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c2abd26542bc4461802e313a732fdd4b, group_id=3f41c6285aa145a0b969f6497b4e7363, role_id=e852dcf1a97e44a98fd44bd526bda855)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:20.772425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:20.786750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role e852dcf1a97e44a98fd44bd526bda855 was removed from group 3f41c6285aa145a0b969f6497b4e7363 on domain c2abd26542bc4461802e313a732fdd4b. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:20.787381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:20.788467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:20.901516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2674/5373] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:50:20 2022] DELETE /identity/v3/domains/c2abd26542bc4461802e313a732fdd4b/groups/3f41c6285aa145a0b969f6497b4e7363/roles/e852dcf1a97e44a98fd44bd526bda855 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:20.905843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:20.907543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:20.933835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23276aca-366c-4b83-82ca-729699b3c994 tempest-TokensV3TestJSON-826047303 tempest-TokensV3TestJSON-826047303-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:21.016352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:21.112043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:21.113122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:21.113576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:21.114140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/3f41c6285aa145a0b969f6497b4e7363/users/080d55b2aea5489486f07ff4f9d24dc6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:21.118030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3f41c6285aa145a0b969f6497b4e7363, user_id=080d55b2aea5489486f07ff4f9d24dc6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:21.119361 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:50:21.119361 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:50:21.119361 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:50:21.126159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:21.198983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:21.289455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:21.427984 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2700/5374] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:50:20 2022] DELETE /identity/v3/groups/3f41c6285aa145a0b969f6497b4e7363/users/080d55b2aea5489486f07ff4f9d24dc6 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:21.430189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:21.478169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30258f-a5ce-4f21-86d2-5a22ff69f7b5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:21.647987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:21.651651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:21.651996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:21.652801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/3f41c6285aa145a0b969f6497b4e7363` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:21.655420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3f41c6285aa145a0b969f6497b4e7363)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:21.659359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:21.893630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2675/5375] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:50:21 2022] DELETE /identity/v3/groups/3f41c6285aa145a0b969f6497b4e7363 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:21.897667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:21.914689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee6d9e-f34e-4f5c-8a20-27fa9187eb1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:22.027162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:22.027827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.028101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.028910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles/e852dcf1a97e44a98fd44bd526bda855` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.031147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e852dcf1a97e44a98fd44bd526bda855)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:22.032799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:22.267005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role e852dcf1a97e44a98fd44bd526bda855 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:22.267005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.267005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.270097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2701/5376] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:21 2022] DELETE /identity/v3/roles/e852dcf1a97e44a98fd44bd526bda855 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:22.274595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:22.276685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:22.297868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9025-2e1f-44f7-adf8-32e48717652d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:22.458639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:22.468036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.468796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.469332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/c2abd26542bc4461802e313a732fdd4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.473201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c2abd26542bc4461802e313a732fdd4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:22.475812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:22.536363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.537395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.699201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.701147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.711623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2676/5377] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:22 2022] PATCH /identity/v3/domains/c2abd26542bc4461802e313a732fdd4b => generated 276 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:50:22.714866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:22.733830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361126b-3c44-4940-94ec-d32abb37949e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:22.742841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:22.864025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:22.870883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:22.870883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:22.870883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/c2abd26542bc4461802e313a732fdd4b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:22.890638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c2abd26542bc4461802e313a732fdd4b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:22.894198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:22.967892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:22.973799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.185120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.204992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.217840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.343092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:23.344615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:23.354615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project c2abd26542bc4461802e313a732fdd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:23.355293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.357819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.384564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.401455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.402246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c2abd26542bc4461802e313a732fdd4b', 'request_id': 'req-b90ae779-3f50-44b4-9905-858d83a561cd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.425020 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2702/5378] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:50:22 2022] DELETE /identity/v3/domains/c2abd26542bc4461802e313a732fdd4b => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:23.425020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:23.425020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:23.546145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1554-181c-4514-bae6-d478c1e0cc4e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:23.604596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae779-3f50-44b4-9905-858d83a561cd tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:23.614171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:23.616520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:23.616520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:23.616520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/6eba7e22d58f4e718e726585d8f199df/users/080d55b2aea5489486f07ff4f9d24dc6/roles/28f6af1317894eabb5f2df48fe3f8fde` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:23.618020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6eba7e22d58f4e718e726585d8f199df, user_id=080d55b2aea5489486f07ff4f9d24dc6, role_id=28f6af1317894eabb5f2df48fe3f8fde)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:23.620710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:23.638522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 28f6af1317894eabb5f2df48fe3f8fde was removed from user 080d55b2aea5489486f07ff4f9d24dc6 on domain 6eba7e22d58f4e718e726585d8f199df. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:23.639078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.640117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:23.641325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:23.641784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:23.642270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] PATH_INFO: `/v3/users/850992e758d24a5bbcffd81237623655` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:23.643371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.644633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850992e758d24a5bbcffd81237623655)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:23.648522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:23.660573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:23.811350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2703/5379] 10.222.0.64 () {58 vars in 1464 bytes} [Wed Nov 2 12:50:23 2022] DELETE /identity/v3/domains/6eba7e22d58f4e718e726585d8f199df/users/080d55b2aea5489486f07ff4f9d24dc6/roles/28f6af1317894eabb5f2df48fe3f8fde => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:23.820511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:23.822183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:23.964132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd16e-bfea-48f4-85a8-4d06bb1c9576 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:23.967055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850992e758d24a5bbcffd81237623655'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:23.977737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:23.985044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:23.985044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:23.985044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles/28f6af1317894eabb5f2df48fe3f8fde` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:23.985044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28f6af1317894eabb5f2df48fe3f8fde)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:23.985044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:24.206605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850992e758d24a5bbcffd81237623655'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.214863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 28f6af1317894eabb5f2df48fe3f8fde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:24.216416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.217785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.221484 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2704/5380] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:23 2022] DELETE /identity/v3/roles/28f6af1317894eabb5f2df48fe3f8fde => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:24.225986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:24.228604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:24.235862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850992e758d24a5bbcffd81237623655'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.240933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850992e758d24a5bbcffd81237623655'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.242090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850992e758d24a5bbcffd81237623655'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.276927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2677/5381] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:23 2022] DELETE /identity/v3/users/850992e758d24a5bbcffd81237623655 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:24.424245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c68b02-2cf7-4c49-bbd2-a27fedf668d2 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:24.514766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:24.515321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.515747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.516186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/6eba7e22d58f4e718e726585d8f199df` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.518893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6eba7e22d58f4e718e726585d8f199df)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:24.521578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:24.565821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.565821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.657610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:24.760477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.761837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:24.769087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2705/5382] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:24 2022] PATCH /identity/v3/domains/6eba7e22d58f4e718e726585d8f199df => generated 277 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:24.772978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:24.775489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:24.796826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674eb85-cf0a-46c7-914e-2bd6efa20a70 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:24.827784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:24.828736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:24.943113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:24.943947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.944336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.944752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/6eba7e22d58f4e718e726585d8f199df` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.945305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938eda8-a5c4-4778-b9f3-916a80688a1c tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:24.955573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:24.956665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:24.956946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:24.957215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] PATH_INFO: `/v3/projects/d370c06216734957aebcbad237a18aec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:24.959455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d370c06216734957aebcbad237a18aec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:24.965986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:24.969054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6eba7e22d58f4e718e726585d8f199df)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:24.972621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:25.005166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.021651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6eba7e22d58f4e718e726585d8f199df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.172627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd370c06216734957aebcbad237a18aec', 'request_id': 'req-0c69e776-f941-4761-bd70-78d7b30cbd2c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.182281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd370c06216734957aebcbad237a18aec', 'request_id': 'req-0c69e776-f941-4761-bd70-78d7b30cbd2c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.189638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd370c06216734957aebcbad237a18aec', 'request_id': 'req-0c69e776-f941-4761-bd70-78d7b30cbd2c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.215501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.230251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.314414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] The token cache is being invalidate because project d370c06216734957aebcbad237a18aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:25.314740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.326928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0c69e776-f941-4761-bd70-78d7b30cbd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.326928 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2706/5383] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:24 2022] DELETE /identity/v3/projects/d370c06216734957aebcbad237a18aec => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:25.328198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cbd5-9d6b-4090-87dc-a393a8ddd2b6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:25.328772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cbd5-9d6b-4090-87dc-a393a8ddd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:25.329230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9cbd5-9d6b-4090-87dc-a393a8ddd2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:25.363122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cff9cbd5-9d6b-4090-87dc-a393a8ddd2b6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:25.367713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cff9cbd5-9d6b-4090-87dc-a393a8ddd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:25.465620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.509414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project 6eba7e22d58f4e718e726585d8f199df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:25.510146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.511893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.575016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.586710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.587636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6eba7e22d58f4e718e726585d8f199df', 'request_id': 'req-39bb4e8c-0ba3-481f-a741-8820e4021f5d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.623766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2678/5384] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:50:24 2022] DELETE /identity/v3/domains/6eba7e22d58f4e718e726585d8f199df => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:25.625115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:25.628652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2707/5385] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:25.631858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:25.635730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:25.636088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:25.636474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:25.703354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:25.703354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:25.732752 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2708/5386] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:25.736463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:25.748723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664f05c-61a2-48e6-8495-d1565b3db287 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:25.756423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:25.756423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:25.756423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:25.756423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:25.757635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:25.758042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:25.760654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:25.786918 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2709/5387] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:25.789166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:25.791161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:25.807224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c4e6-bf27-477e-b3b7-63e295154780 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:25.809482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb4e8c-0ba3-481f-a741-8820e4021f5d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:25.816363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:25.819314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:25.819457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:25.819587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:25.819587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/f893565ffe34477292de4313aada8766/groups/7f640d374d294478bdc9b7d7d45aca06/roles/d14d2d890b214569abdb81618125e72d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:25.819800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:25.819800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:25.819800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] PATH_INFO: `/v3/users/8d38203277d049a6acb7582883bab681` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:25.820433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d38203277d049a6acb7582883bab681)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:25.821049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f893565ffe34477292de4313aada8766, group_id=7f640d374d294478bdc9b7d7d45aca06, role_id=d14d2d890b214569abdb81618125e72d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:25.825135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:25.825301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:25.833329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role d14d2d890b214569abdb81618125e72d was removed from group 7f640d374d294478bdc9b7d7d45aca06 on domain f893565ffe34477292de4313aada8766. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:25.833737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.834704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:25.927564 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2679/5388] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:50:25 2022] DELETE /identity/v3/domains/f893565ffe34477292de4313aada8766/groups/7f640d374d294478bdc9b7d7d45aca06/roles/d14d2d890b214569abdb81618125e72d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:25.929369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:25.930997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:26.042198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a2ca6-3f77-4a15-82da-d9e64dc9ae19 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:26.053509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:26.053509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:26.053509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:26.053509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:26.054015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:26.055785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:26.151687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d38203277d049a6acb7582883bab681'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.250643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2680/5389] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:25 2022] POST /identity/v3/projects => generated 387 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:26.256360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:26.262030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:26.278527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d38203277d049a6acb7582883bab681'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.302365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d38203277d049a6acb7582883bab681'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.315654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d38203277d049a6acb7582883bab681'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.317295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d38203277d049a6acb7582883bab681'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.336231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2710/5390] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:25 2022] DELETE /identity/v3/users/8d38203277d049a6acb7582883bab681 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:26.338279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:26.339952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:26.429854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad8d9a-9bba-4c4a-b0d7-03a634538139 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:26.509503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc72356-30f5-46c0-9df1-df4c37d948cd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:26.523191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:26.526317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:26.526457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:26.526457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:26.526881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/7f640d374d294478bdc9b7d7d45aca06/users/080d55b2aea5489486f07ff4f9d24dc6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:26.528777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:26.529367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:26.529756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:26.530121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7f640d374d294478bdc9b7d7d45aca06, user_id=080d55b2aea5489486f07ff4f9d24dc6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:26.530928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:26.533656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:26.537730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15e8a2-10b9-4fd0-812d-f4c203d8807c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:26.712914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:26.762824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:26.838774 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2711/5391] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:26 2022] POST /identity/v3/users => generated 294 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:26.840139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:26.840433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:26.842319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:26.845782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2681/5392] 10.222.0.64 () {58 vars in 1344 bytes} [Wed Nov 2 12:50:26 2022] DELETE /identity/v3/groups/7f640d374d294478bdc9b7d7d45aca06/users/080d55b2aea5489486f07ff4f9d24dc6 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:26.852145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:26.892678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:26.894113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:26.987997 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2712/5393] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:26.989060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:26.990724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:27.055898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d401887-272a-407d-a890-ac32b604bcef tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.069496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.070146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.070465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.070785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.071558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.079645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.119529 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2682/5394] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:26 2022] GET /identity/v3/roles => generated 1882 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:27.120458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:27.125942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:27.161197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a9ae-b3d2-4b38-bdcc-ed7230902033 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.172818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.173486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.173770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.174144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/groups/7f640d374d294478bdc9b7d7d45aca06` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.175481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7f640d374d294478bdc9b7d7d45aca06)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.177496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.260979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57355a34-81e1-4c1c-8277-8c44e36b18a9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.269660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.270370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.270864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.271247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.289348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.289348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.302318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2683/5395] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:27.303230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:27.317951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2dca-a89f-4501-b06d-0f094560d837 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.326037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.326914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.327196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.327474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.328383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.331379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.369436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2684/5396] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:27 2022] GET /identity/v3/roles => generated 1882 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:27.374019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:27.378691 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2713/5397] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:50:26 2022] DELETE /identity/v3/groups/7f640d374d294478bdc9b7d7d45aca06 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:27.384283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:27.391276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6623123-1dc5-4e71-bef5-7f664151c2c5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.457120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:27.499388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.500374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.500977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.500977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] PATH_INFO: `/v3/projects/856418ccb26345ca891f6f02e09a2e4c/users/74e8f5f38274470f94b321c405345be5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.514317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f2afe-a947-4ddb-9182-9a79a1f6fc68 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.521303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:27.523064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.523548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.528091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles/d14d2d890b214569abdb81618125e72d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.530373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d14d2d890b214569abdb81618125e72d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.530763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=856418ccb26345ca891f6f02e09a2e4c, user_id=74e8f5f38274470f94b321c405345be5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:27.534780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.535427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc4e4c-45b8-44e4-b6cb-862b9861fdab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:27.663190 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2685/5398] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:27 2022] PUT /identity/v3/projects/856418ccb26345ca891f6f02e09a2e4c/users/74e8f5f38274470f94b321c405345be5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:27.666128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.666850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.667576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.714489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] MFA Rules not processed for user `b2ee0f7286134291b1f978cbe61fba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:27.715930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:27.799144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role d14d2d890b214569abdb81618125e72d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:27.799790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:27.800011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1e70ba6-f5b5-449c-882e-1b67753aebf3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:27.809677 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2714/5399] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:27 2022] DELETE /identity/v3/roles/d14d2d890b214569abdb81618125e72d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:27.811092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37686-6495-4878-b651-a6b5fd449a3f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.811377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37686-6495-4878-b651-a6b5fd449a3f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.811644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a37686-6495-4878-b651-a6b5fd449a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.828579 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2686/5400] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:27.828579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:27.850259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-32a37686-6495-4878-b651-a6b5fd449a3f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:27.851491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32a37686-6495-4878-b651-a6b5fd449a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:27.958766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69222a2d-6605-445a-8333-f18a5cd1ec37 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:27.969137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2715/5401] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:27.971022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:27.971415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:27.971906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:27.995256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] MFA Rules not processed for user `b2ee0f7286134291b1f978cbe61fba1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:27.997760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.053936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:28.054548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.055106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.055393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/f893565ffe34477292de4313aada8766` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.057243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f893565ffe34477292de4313aada8766)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:28.059197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:28.078952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2716/5402] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:28.095207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:28.098243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.103286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:28.104067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:28.197551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271d298-81d4-4371-b875-9eb950a4f7f5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:28.253457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:28.255273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:28.263291 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2687/5403] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:27 2022] PATCH /identity/v3/domains/f893565ffe34477292de4313aada8766 => generated 277 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:28.268708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:28.270972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.342673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:28.344432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:28.345097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.345375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.345661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.354309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.412563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c237d0-cb3d-4bd8-ba89-31b907e7fd17 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:28.456425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:28.458459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.460222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.460775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.469695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.479451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:28.481113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:28.508111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2717/5404] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:28.520034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:28.527823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:28.663957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:28.666767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacbee5-7ff1-433d-a508-069b827ff16b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:28.684337 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2688/5405] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:28.733826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071dcd4-9b70-4785-aff3-cc50f9668dd6 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:28.753594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:28.754398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:28.754687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:28.755025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/f893565ffe34477292de4313aada8766` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:28.785728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f893565ffe34477292de4313aada8766)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:28.808152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:28.827358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:28.833637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f893565ffe34477292de4313aada8766'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.108988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.120588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.128370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.229727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.230336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.230336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:29.239665 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:50:29.240983 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:29.242569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2689/5406] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:50:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:29.288598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:29.293116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project f893565ffe34477292de4313aada8766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:29.293116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.293524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:29.293830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.304165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.309857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.310685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f893565ffe34477292de4313aada8766', 'request_id': 'req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.322332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2718/5407] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:50:28 2022] DELETE /identity/v3/domains/f893565ffe34477292de4313aada8766 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:29.327870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:29.335286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:29.536422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89346a27-0776-404a-8c88-e3626d7c4c7b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:29.553287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:29.553287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.553287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.553287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] PATH_INFO: `/v3/projects/8a5e5bbe2bd149e2be51f8d6ba718c41` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.553754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5e5bbe2bd149e2be51f8d6ba718c41)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:29.553754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:29.554147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e94c-40d1-4a5b-bb61-7829c60fe2c9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:29.570790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:29.571525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.571806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.572088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/9125943c5f234e25b112fc283bbf8584/users/080d55b2aea5489486f07ff4f9d24dc6/roles/76258b2537244862be645b469d68265e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.579185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9125943c5f234e25b112fc283bbf8584, user_id=080d55b2aea5489486f07ff4f9d24dc6, role_id=76258b2537244862be645b469d68265e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:29.582827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:29.598914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 76258b2537244862be645b469d68265e was removed from user 080d55b2aea5489486f07ff4f9d24dc6 on domain 9125943c5f234e25b112fc283bbf8584. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:29.599217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.600182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.687922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2719/5408] 10.222.0.64 () {58 vars in 1464 bytes} [Wed Nov 2 12:50:29 2022] DELETE /identity/v3/domains/9125943c5f234e25b112fc283bbf8584/users/080d55b2aea5489486f07ff4f9d24dc6/roles/76258b2537244862be645b469d68265e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:29.691493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:29.692990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:29.719085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5e5bbe2bd149e2be51f8d6ba718c41', 'request_id': 'req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.730536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5e5bbe2bd149e2be51f8d6ba718c41', 'request_id': 'req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.789553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5e5bbe2bd149e2be51f8d6ba718c41', 'request_id': 'req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.805512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] The token cache is being invalidate because project 8a5e5bbe2bd149e2be51f8d6ba718c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:29.805512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.807740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e47cd4b-4515-40b6-a0d2-84dc38a7f7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:29.809856 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2690/5409] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:29 2022] DELETE /identity/v3/projects/8a5e5bbe2bd149e2be51f8d6ba718c41 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:29.817388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970632-1b76-4d5a-9b7a-f5b7deccdf5e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.818238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970632-1b76-4d5a-9b7a-f5b7deccdf5e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.818735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3970632-1b76-4d5a-9b7a-f5b7deccdf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.834318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270c2f8-215f-4074-9967-9238b72fc769 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:29.840530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:29.856722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a3970632-1b76-4d5a-9b7a-f5b7deccdf5e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:29.858372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3970632-1b76-4d5a-9b7a-f5b7deccdf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:29.913977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:29.914696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.915300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.915931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles/76258b2537244862be645b469d68265e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.917791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=76258b2537244862be645b469d68265e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:29.920518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:29.942791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:29.957788 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2691/5410] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:29.965688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:29.966047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:29.966245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:29.989789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:29.992625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:30.009501 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2692/5411] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:30.011080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:30.022741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40aaca6-68eb-49b6-8785-dd1dc89afe1c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:30.029725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:30.030671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:30.031117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:30.031562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:30.032426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:30.032935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:30.034790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:30.060376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 76258b2537244862be645b469d68265e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:30.061099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.065740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.069016 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2720/5412] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:29 2022] DELETE /identity/v3/roles/76258b2537244862be645b469d68265e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:30.073571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:30.075198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:30.092045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2693/5413] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:30.093859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:30.099639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:30.129391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3993d45-66ef-4dbf-805d-ee339d6e6e65 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:30.221792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3807f8-d26c-44be-994f-d0c277ac18d3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:30.232835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:30.232835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:30.232835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:30.233585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/9125943c5f234e25b112fc283bbf8584` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:30.233585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9125943c5f234e25b112fc283bbf8584)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:30.233585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:30.262584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.263506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.291813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:30.292515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:30.292835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:30.293112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:30.293800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:30.295777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:30.527794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.528588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.534651 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2721/5414] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:30 2022] PATCH /identity/v3/domains/9125943c5f234e25b112fc283bbf8584 => generated 276 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:30.562061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:30.567587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:30.625113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2694/5415] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:30 2022] POST /identity/v3/projects => generated 385 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:30.630700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:30.632585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:30.730293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c74e1-e262-48c2-8361-e73ad73bba6d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:30.744661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:30.746899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:30.746899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:30.746899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:30.748125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:30.755000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:30.811232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92553e-34ca-447f-aeca-bb5122c46872 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:30.891805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:30.892581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:30.892889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:30.893290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/9125943c5f234e25b112fc283bbf8584` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:30.907688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9125943c5f234e25b112fc283bbf8584)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:30.910680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:30.945139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.949992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9125943c5f234e25b112fc283bbf8584'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:30.979326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2695/5416] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:30 2022] POST /identity/v3/users => generated 293 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:30.980371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.007704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a5ef8-0167-4454-aa37-a67fc203277c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.019636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.021234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.023414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.027242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.027242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.028665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.042964 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2696/5417] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:31.049436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.063897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bffa5e4-7a6d-4487-94ce-f67beb856996 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.071348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.071980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.072263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.073069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.073208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.074858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.111738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2697/5418] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:31.115459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.131407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c39771-f1a6-45c2-a674-4972d5d5801b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.156300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.157120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.157331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.157610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] PATH_INFO: `/v3/projects/b7188165c5f64e0984d24db86577d217/users/63515f495fdc4ecfacb1d32689497420/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.187832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7188165c5f64e0984d24db86577d217, user_id=63515f495fdc4ecfacb1d32689497420, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.195832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e63fb-53a5-432b-abc2-ae9290c78264 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.213819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.233517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.257200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.397480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project 9125943c5f234e25b112fc283bbf8584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:31.408663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.409583 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2698/5419] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:31 2022] PUT /identity/v3/projects/b7188165c5f64e0984d24db86577d217/users/63515f495fdc4ecfacb1d32689497420/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:31.410243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.410380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.410649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.411381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.433312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.444024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.446873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9125943c5f234e25b112fc283bbf8584', 'request_id': 'req-97ef74b6-b99f-4d00-a597-a7a4b60400b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:31.461587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] MFA Rules not processed for user `63515f495fdc4ecfacb1d32689497420`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:31.463313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:31.464307 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2722/5420] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:50:30 2022] DELETE /identity/v3/domains/9125943c5f234e25b112fc283bbf8584 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:31.470023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.472086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:31.508198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:31.576044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef74b6-b99f-4d00-a597-a7a4b60400b3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.619124 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2699/5421] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:31.625836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.626142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:31.696313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.711544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.711544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.711544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.711544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.716627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.737986 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2723/5422] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:31.739263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.763035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c3e1a-8c74-420c-a492-ddc2545fd4ba tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.768817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.770141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.770594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.772134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.788660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8e485eda4f2648f1b639dbe2c1504fb2, user_id=a5eb6c7c36064131b2126eb8b4670565, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.791016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979fd5a-c651-416b-a45a-55886cc43a61 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:31.793809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.804749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:31.805538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:31.805816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:31.806430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:31.807586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:31.816645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:31.932266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2724/5423] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:31 2022] PUT /identity/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:31.933356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:31.964162 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2700/5424] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:31 2022] POST /identity/v3/projects => generated 385 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:31.970705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.045735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11437-ce97-41d4-bbc1-7c7c61dda5e1 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.111143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a44ee-8f73-49eb-9e0a-156bd102f878 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.124990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.125549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.125824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.126088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.126872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.130425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.209402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.210079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.210508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.210790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.211439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.214610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.300392 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2701/5425] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:31 2022] POST /identity/v3/users => generated 299 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:32.304315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.329918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971a8a3-8386-4265-857e-e9520666eb47 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.341725 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2725/5426] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:50:31 2022] GET /identity/v3/auth/projects => generated 828 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:32.346541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.359620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.360564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.360936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.361479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.362280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.365161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.381355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45753fa1-aaeb-4d31-898f-d662afb75be9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.386062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:32.395889 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2702/5427] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:32.398342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.399229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.399642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.400058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.401899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.403644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=8e485eda4f2648f1b639dbe2c1504fb2, user_id=a5eb6c7c36064131b2126eb8b4670565, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.410004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.420526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 4a6c8234b6f1406c9820f1c2b4c94c32 was removed from user a5eb6c7c36064131b2126eb8b4670565 on project 8e485eda4f2648f1b639dbe2c1504fb2. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:32.422978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1263e5-8419-4a6b-992c-ed2faae3d8d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.423727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:32.425014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:32.443782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.443782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.443782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.443782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] PATH_INFO: `/v3/projects/f52a08706d544b6cb0d7e3c23b566d98/users/e7ec29c263a14d11bb0a7e6b12ebc166/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.460931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52a08706d544b6cb0d7e3c23b566d98, user_id=e7ec29c263a14d11bb0a7e6b12ebc166, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.463890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.575013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2726/5428] 10.222.0.64 () {58 vars in 1467 bytes} [Wed Nov 2 12:50:32 2022] DELETE /identity/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2/users/a5eb6c7c36064131b2126eb8b4670565/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:32.580753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.582729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:32.608766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2703/5429] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:32 2022] PUT /identity/v3/projects/f52a08706d544b6cb0d7e3c23b566d98/users/e7ec29c263a14d11bb0a7e6b12ebc166/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:32.613088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.615082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:32.715161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853c3eb-9641-4b32-990e-6810d20395e5 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.745199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d3f2-dde4-46b7-92fe-a5a252d619d3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.755733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.756356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.757834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.757834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.757834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.759365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.772692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:32.780753 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2704/5430] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:32.780753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.786943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedc98f-a6ae-4837-ae5f-f71581ab6d9f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:32.791520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.792199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.792477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.792794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] PATH_INFO: `/v3/projects/f52a08706d544b6cb0d7e3c23b566d98/users/e7ec29c263a14d11bb0a7e6b12ebc166/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.795020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f52a08706d544b6cb0d7e3c23b566d98, user_id=e7ec29c263a14d11bb0a7e6b12ebc166, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.797931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ef8b8-9db6-4d9f-8270-aec60db1ef55 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.818539 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2705/5431] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:32 2022] PUT /identity/v3/projects/f52a08706d544b6cb0d7e3c23b566d98/users/e7ec29c263a14d11bb0a7e6b12ebc166/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:32.820411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:32.821083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.837356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.837356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.837356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:32.837356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:32.840475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:32.840904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:32.841288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:32.884355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] MFA Rules not processed for user `e7ec29c263a14d11bb0a7e6b12ebc166`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:32.885815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:32.944568 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2727/5432] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:32 2022] POST /identity/v3/users => generated 323 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:32.949047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:32.963929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b45d5-2c68-40b6-9022-d94e92255b3d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.007935 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2706/5433] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:33.010906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.027799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be7236-4095-439d-b9b8-1ee47023f93f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.037926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.039266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.040563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.041297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.042192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.044267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.063528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.065802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.066088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.066362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.067027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.069654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.144361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2707/5434] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/services => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:33.145672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.170305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbc0ef-4ccb-4d29-b7fc-91682938e800 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.178104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.178950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.179121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.179515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.180075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.181749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: 'False' Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'False' Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.190496 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:50:33.192548 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'False' Nov 02 12:50:33.193852 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.201893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2708/5435] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/endpoints => generated 283 bytes in 56 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:33.203180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.220311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da736-5461-4105-97be-315191bf76c5 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.251869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.257855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.258673 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2728/5436] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:32 2022] POST /identity/v3/projects => generated 363 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:33.259681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.261392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.262935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.270069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.315239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: 'True' Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'True' Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.354283 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:50:33.356407 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'True' Nov 02 12:50:33.357615 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:33.365644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2709/5437] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/endpoints => generated 281 bytes in 159 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:33.368937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.407087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4734382-f803-4aca-918c-85685f20a87c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.484680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea84b1-1db0-4a8c-ba03-7a52f46ff4e9 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.505431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.506809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.506809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.507127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.507946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.517557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.546981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.549536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.553159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.555398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.556455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.559551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.646977 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2729/5438] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/projects => generated 363 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:33.651812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.661801 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2044008495. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:50:33.661801 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:50:33.661801 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:50:33.746778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:33.858303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd502a-e187-4618-866d-bf17ba97f18e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:33.878853 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2710/5439] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/endpoints => generated 361 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:33.883580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:33.897313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:33.897941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:33.898217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:33.898486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:33.899156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:33.900833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:33.948289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:33.975313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47060980-74f0-4282-a170-3016cc4603a3 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.062506 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2730/5440] 10.222.0.64 () {60 vars in 1143 bytes} [Wed Nov 2 12:50:33 2022] POST /identity/v3/roles => generated 240 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:34.065676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.084571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8b0d3-6a61-4a9d-a0a7-450a068b7f93 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.104123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.106601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.107361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.108400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/regions/tempest-region-2044008495` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.109484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2044008495)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.111157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.115613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.115927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2711/5441] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:50:33 2022] GET /identity/v3/regions/tempest-region-2044008495 => generated 180 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:34.116403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.116723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.117004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/6e99e4bb5d2a436aa6c00f721964a30b/users/5bd327367cc148179be2eff5500a5294/roles/0af1abee951b44649a7238dff71cb204` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.125071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.146191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6e99e4bb5d2a436aa6c00f721964a30b, user_id=5bd327367cc148179be2eff5500a5294, role_id=0af1abee951b44649a7238dff71cb204)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.146814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a835b-1bde-428d-87df-b87cd3fd94a6 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.150848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.152851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.153753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.154552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.155883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints/2b5a7d758aeb4d7da933b341e1fc525b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.164685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2b5a7d758aeb4d7da933b341e1fc525b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.166736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: 'False' Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'False' Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.195014 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:50:34.197398 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'False' Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:34.198624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2712/5442] 10.222.0.64 () {60 vars in 1255 bytes} [Wed Nov 2 12:50:34 2022] PATCH /identity/v3/endpoints/2b5a7d758aeb4d7da933b341e1fc525b => generated 283 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:50:34.203590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.221947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d413b-a6ff-4649-81f1-ffcabe97a7b1 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.228265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.229902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.230419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.231151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints/2b5a7d758aeb4d7da933b341e1fc525b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.233054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2b5a7d758aeb4d7da933b341e1fc525b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.235708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.364304 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2731/5443] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:34 2022] PUT /identity/v3/projects/6e99e4bb5d2a436aa6c00f721964a30b/users/5bd327367cc148179be2eff5500a5294/roles/0af1abee951b44649a7238dff71cb204 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:34.367339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.397235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2b5a7d758aeb4d7da933b341e1fc525b', 'request_id': 'req-148bdd3a-988b-4e76-b169-bd8a1b3f242e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:34.420150 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2713/5444] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:34 2022] DELETE /identity/v3/endpoints/2b5a7d758aeb4d7da933b341e1fc525b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:34.426660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.509237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e4ad-bfdf-4f12-883d-832e53070a37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.509495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdd3a-988b-4e76-b169-bd8a1b3f242e tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.549925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.550623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.550944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.551236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00/users/5bd327367cc148179be2eff5500a5294/roles/0af1abee951b44649a7238dff71cb204` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.557694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6bcd00ffdf654eb6aed0fc0510129d00, user_id=5bd327367cc148179be2eff5500a5294, role_id=0af1abee951b44649a7238dff71cb204)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.565127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab998-729d-4104-adb8-3d4ca115bf64 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.657028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2732/5445] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:34 2022] PUT /identity/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00/users/5bd327367cc148179be2eff5500a5294/roles/0af1abee951b44649a7238dff71cb204 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:34.659437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ce25-40e9-468e-a091-6b2c47aa2714 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.660873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ce25-40e9-468e-a091-6b2c47aa2714 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.662554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ce25-40e9-468e-a091-6b2c47aa2714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.680809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:34.707415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:34.708078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.708361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.712990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/regions/tempest-region-2044008495` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.713737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2044008495)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:34.717030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:34.744924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1cd0ce25-40e9-468e-a091-6b2c47aa2714 None None] MFA Rules not processed for user `5bd327367cc148179be2eff5500a5294`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:34.746274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1cd0ce25-40e9-468e-a091-6b2c47aa2714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:34.750350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2733/5446] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:34 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:50:34.755559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:34.755977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:34.756261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:34.770018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] MFA Rules not processed for user `5bd327367cc148179be2eff5500a5294`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:34.771782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:34.837031 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2714/5447] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:50:34 2022] DELETE /identity/v3/regions/tempest-region-2044008495 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:34.843055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:34.890006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22837679-24a3-4bee-b344-2288801901cc tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:34.903166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2734/5448] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:34 2022] POST /identity/v3/auth/tokens => generated 3358 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 02 12:50:34.910059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.053448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.054146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.054439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.054718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.055415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.058237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.103537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7e3e5-fc20-4d42-8740-0006051c7986 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.112383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.113063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.113348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.113792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.126068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.130210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2a57c-f7f6-4940-b010-076d141a6cde tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.222085 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1093451845. To ensure interoperability, identifiers should be a valid uuid. Nov 02 12:50:35.222085 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Nov 02 12:50:35.222085 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:50:35.253636 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2735/5449] 10.222.0.64 () {56 vars in 1308 bytes} [Wed Nov 2 12:50:34 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:35.258853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.261424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.261424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.276516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] MFA Rules not processed for user `5bd327367cc148179be2eff5500a5294`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:35.277789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:35.394259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2736/5450] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3357 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 02 12:50:35.394865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.445194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5935c3-d63c-48cd-9497-403e0443c0cf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.452546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.453760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.454122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.454455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/roles/0af1abee951b44649a7238dff71cb204` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.457887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0af1abee951b44649a7238dff71cb204)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.460876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.484283 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2715/5451] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:50:34 2022] POST /identity/v3/endpoints => generated 361 bytes in 631 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:35.484283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.558268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996fed9-beb6-488b-a7f4-091e4dad31a2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.560983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.561665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.564034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.564361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/regions/tempest-region-1093451845` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.565634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1093451845)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.570068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.572242 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2716/5452] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:50:35 2022] GET /identity/v3/regions/tempest-region-1093451845 => generated 180 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:35.576544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.612049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4acb3-664f-4fc6-8a94-f1dbfdbae25f tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.617437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.618092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.618372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.618660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints/2d9866e4500342f8a7d9cb8a1e3b1ebe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.641850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2d9866e4500342f8a7d9cb8a1e3b1ebe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.643589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: On instance['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: 'True' Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise error Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'True' Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.659568 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Nov 02 12:50:35.665389 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application On instance['enabled']: Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application 'True' Nov 02 12:50:35.667146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:35.675627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2717/5453] 10.222.0.64 () {60 vars in 1255 bytes} [Wed Nov 2 12:50:35 2022] PATCH /identity/v3/endpoints/2d9866e4500342f8a7d9cb8a1e3b1ebe => generated 281 bytes in 98 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 12:50:35.676672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.709100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323acf9-72c1-4bd5-92b4-078b6a6a7f1c tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.728013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:35.728693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:35.728973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:35.730295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/endpoints/2d9866e4500342f8a7d9cb8a1e3b1ebe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:35.733105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2d9866e4500342f8a7d9cb8a1e3b1ebe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:35.734749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:35.811169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invalidating the token cache because role 0af1abee951b44649a7238dff71cb204 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:35.811409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:35.812017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:35.816027 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2737/5454] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:35 2022] DELETE /identity/v3/roles/0af1abee951b44649a7238dff71cb204 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:35.821326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.825024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:35.838117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2d9866e4500342f8a7d9cb8a1e3b1ebe', 'request_id': 'req-7fbf30c9-ab6e-43be-a717-5566a98b3a50'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:35.854897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2718/5455] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:50:35 2022] DELETE /identity/v3/endpoints/2d9866e4500342f8a7d9cb8a1e3b1ebe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:35.859201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:35.862447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:35.922559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf30c9-ab6e-43be-a717-5566a98b3a50 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:35.988126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:36.050863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596220f-6c04-433b-a275-6e063fb37518 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:36.095405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.095405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.095405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.096534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/regions/tempest-region-1093451845` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.096534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1093451845)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.102703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:36.105297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.106498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.106498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.106895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.108703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6bcd00ffdf654eb6aed0fc0510129d00)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.111378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:36.229762 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2719/5456] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:50:35 2022] DELETE /identity/v3/regions/tempest-region-1093451845 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:36.235173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:36.296169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bcd00ffdf654eb6aed0fc0510129d00', 'request_id': 'req-f194151a-8f5c-4427-a88a-b8361375c26d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:36.317457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b40ad-3462-4c7c-b40a-20109b5ec9e2 tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:36.317655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bcd00ffdf654eb6aed0fc0510129d00', 'request_id': 'req-f194151a-8f5c-4427-a88a-b8361375c26d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:36.331385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bcd00ffdf654eb6aed0fc0510129d00', 'request_id': 'req-f194151a-8f5c-4427-a88a-b8361375c26d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:36.335865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:36.407596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7ec29c263a14d11bb0a7e6b12ebc166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f52a08706d544b6cb0d7e3c23b566d98', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.408986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.409278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.409553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] PATH_INFO: `/v3/services/acb933db41fd4b2cadd136b47423b00a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.410153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorizing `identity:delete_service(service_id=acb933db41fd4b2cadd136b47423b00a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.411864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:36.476058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project 6bcd00ffdf654eb6aed0fc0510129d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:36.476514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:36.477932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:36.482626 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2738/5457] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:35 2022] DELETE /identity/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:36.486712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:36.489315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:36.545003 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2720/5458] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:36 2022] DELETE /identity/v3/services/acb933db41fd4b2cadd136b47423b00a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:36.550413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:36.552403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:36.668993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194151a-8f5c-4427-a88a-b8361375c26d tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:36.695433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.696659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.697202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.698633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.709738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6bcd00ffdf654eb6aed0fc0510129d00)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.714248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Could not find project: 6bcd00ffdf654eb6aed0fc0510129d00.: keystone.exception.ProjectNotFound: Could not find project: 6bcd00ffdf654eb6aed0fc0510129d00. Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Nov 02 12:50:36.735884 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6bcd00ffdf654eb6aed0fc0510129d00. Nov 02 12:50:36.737642 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:36.741569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2739/5459] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:36 2022] DELETE /identity/v3/projects/6bcd00ffdf654eb6aed0fc0510129d00 => generated 113 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:50:36.745702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:36.750429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab34a-6ef5-422f-86f5-e56a8e3890cb tempest-EndpointsNegativeTestJSON-319880460 tempest-EndpointsNegativeTestJSON-319880460-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:36.761587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.763954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.763954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.763954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] PATH_INFO: `/v3/users/63515f495fdc4ecfacb1d32689497420` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.766344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] RBAC: Authorizing `identity:delete_user(user_id=63515f495fdc4ecfacb1d32689497420)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.773904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:36.786126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fec613-fa82-4967-a77d-37c1e554feab tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:36.799857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:36.801102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:36.801528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:36.802549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/projects/6e99e4bb5d2a436aa6c00f721964a30b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:36.805583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e99e4bb5d2a436aa6c00f721964a30b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:36.809428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:37.107672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e99e4bb5d2a436aa6c00f721964a30b', 'request_id': 'req-b36ad9aa-087f-417b-b1c5-583ab208ae52'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.112316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63515f495fdc4ecfacb1d32689497420'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.142660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e99e4bb5d2a436aa6c00f721964a30b', 'request_id': 'req-b36ad9aa-087f-417b-b1c5-583ab208ae52'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.161305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e99e4bb5d2a436aa6c00f721964a30b', 'request_id': 'req-b36ad9aa-087f-417b-b1c5-583ab208ae52'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.243392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63515f495fdc4ecfacb1d32689497420'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.295045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63515f495fdc4ecfacb1d32689497420'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.295045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63515f495fdc4ecfacb1d32689497420'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.295884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-720eb9c5-56d4-4539-812d-c55f7ad0806e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63515f495fdc4ecfacb1d32689497420'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.326955 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2721/5460] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:36 2022] DELETE /identity/v3/users/63515f495fdc4ecfacb1d32689497420 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:37.331493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:37.331934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:37.332322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:37.350371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] The token cache is being invalidate because project 6e99e4bb5d2a436aa6c00f721964a30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:37.350954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.357802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.360009 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2740/5461] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:36 2022] DELETE /identity/v3/projects/6e99e4bb5d2a436aa6c00f721964a30b => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:37.364009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:37.367063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:37.398050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:37.399549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:37.568316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:37.594608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad9aa-087f-417b-b1c5-583ab208ae52 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:37.606248 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2722/5462] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:37.625626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:37.628181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:37.724450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:37.728727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:37.728727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:37.728727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/users/5bd327367cc148179be2eff5500a5294` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:37.728727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5bd327367cc148179be2eff5500a5294)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:37.729489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:37.779242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b00a98-dcf3-414e-87bd-ca3b2a545396 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:37.788908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:37.789861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:37.790312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:37.790760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:37.819001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:37.820564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:37.842218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2723/5463] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:50:37.908456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bd327367cc148179be2eff5500a5294'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:37.958485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:37.980874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bd327367cc148179be2eff5500a5294'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.009860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bd327367cc148179be2eff5500a5294'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.041257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bd327367cc148179be2eff5500a5294'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.043028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bd327367cc148179be2eff5500a5294'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.053453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2741/5464] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:37 2022] DELETE /identity/v3/users/5bd327367cc148179be2eff5500a5294 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:38.063241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.083646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070cbd7-0ce8-44ef-b28c-86e8a7d543fb service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.237777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.238597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.238751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.239008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/c2abd26542bc4461802e313a732fdd4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.259403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Could not find domain: c2abd26542bc4461802e313a732fdd4b.: keystone.exception.DomainNotFound: Could not find domain: c2abd26542bc4461802e313a732fdd4b. Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c2abd26542bc4461802e313a732fdd4b. Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:38.264826 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:38.266113 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c2abd26542bc4461802e313a732fdd4b. Nov 02 12:50:38.267279 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:38.268588 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2724/5465] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:38 2022] PATCH /identity/v3/domains/c2abd26542bc4461802e313a732fdd4b => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:38.272276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.275114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:38.301860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8698f-f0d3-451b-a412-0359f54c856e tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.312098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.313109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.316892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.321631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/6eba7e22d58f4e718e726585d8f199df` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.344802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.346642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:50:38.347316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Could not find domain: 6eba7e22d58f4e718e726585d8f199df.: keystone.exception.DomainNotFound: Could not find domain: 6eba7e22d58f4e718e726585d8f199df. Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6eba7e22d58f4e718e726585d8f199df. Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:38.364564 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:38.373442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6eba7e22d58f4e718e726585d8f199df. Nov 02 12:50:38.375101 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.376564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2742/5466] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:38 2022] PATCH /identity/v3/domains/6eba7e22d58f4e718e726585d8f199df => generated 112 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:38.378316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.398681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c1fe-fa01-40dc-aaa2-0b42d0c8df37 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.409531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.410418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.410540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.410793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/f893565ffe34477292de4313aada8766` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.431368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Could not find domain: f893565ffe34477292de4313aada8766.: keystone.exception.DomainNotFound: Could not find domain: f893565ffe34477292de4313aada8766. Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f893565ffe34477292de4313aada8766. Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:38.436825 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:38.441649 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f893565ffe34477292de4313aada8766. Nov 02 12:50:38.442797 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.444070 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2743/5467] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:38 2022] PATCH /identity/v3/domains/f893565ffe34477292de4313aada8766 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:38.444070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.470524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d6b18-7cf3-4cc8-9ec4-5b63061329fc tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.481856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119e1c9-93cf-47ec-921b-c3f9be0dc9f3 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.484543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.485677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.485946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.486440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] PATH_INFO: `/v3/users/dddad293935746bf941b67f583c8d7ad` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.487662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddad293935746bf941b67f583c8d7ad)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:38.489960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:38.491967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5eb6c7c36064131b2126eb8b4670565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61d29addecfb45f68efb1add9e638980', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.492650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.498828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.499717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] PATH_INFO: `/v3/domains/9125943c5f234e25b112fc283bbf8584` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.527560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Could not find domain: 9125943c5f234e25b112fc283bbf8584.: keystone.exception.DomainNotFound: Could not find domain: 9125943c5f234e25b112fc283bbf8584. Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9125943c5f234e25b112fc283bbf8584. Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:38.538625 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:38.539878 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9125943c5f234e25b112fc283bbf8584. Nov 02 12:50:38.541046 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:38.543086 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2744/5468] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:50:38 2022] PATCH /identity/v3/domains/9125943c5f234e25b112fc283bbf8584 => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:38.544019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:38.548766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:38.571449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35cf8a-ee5e-4414-8ea8-7b7a04a13466 tempest-TokensV3TestJSON-1118051254 tempest-TokensV3TestJSON-1118051254-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:38.577705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:38.578669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.579183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.579720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] PATH_INFO: `/v3/users/2ba4ffc72a4543f0a77fe0bd0e98c9e6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.581953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba4ffc72a4543f0a77fe0bd0e98c9e6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:38.586144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:38.797787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddad293935746bf941b67f583c8d7ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.846382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba4ffc72a4543f0a77fe0bd0e98c9e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.902583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddad293935746bf941b67f583c8d7ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.925751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddad293935746bf941b67f583c8d7ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.927189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddad293935746bf941b67f583c8d7ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.929962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9043fa06-8c99-47d2-99fa-855926f1fce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddad293935746bf941b67f583c8d7ad'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:38.953667 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2725/5469] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:38 2022] DELETE /identity/v3/users/dddad293935746bf941b67f583c8d7ad => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:38.959655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:38.961101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:38.961601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:38.998336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba4ffc72a4543f0a77fe0bd0e98c9e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:39.035451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba4ffc72a4543f0a77fe0bd0e98c9e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:39.038501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:39.042269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:39.052318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba4ffc72a4543f0a77fe0bd0e98c9e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:39.053597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a74aa13e-91a9-4c87-98ab-03fa9a45896c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba4ffc72a4543f0a77fe0bd0e98c9e6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:39.067256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2745/5470] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:38 2022] DELETE /identity/v3/users/2ba4ffc72a4543f0a77fe0bd0e98c9e6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:39.073188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:39.074017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:39.074302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:39.119068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:39.120349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:39.196934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2726/5471] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:39.274266 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2746/5472] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:39.343502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:39.346580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:39.347753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:39.349423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:39.443818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:39.533823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63172d30-2b38-4af2-bb3c-2b2257e83a20 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:39.541360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:39.542049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:39.542343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:39.542610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:39.562138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d59dd-bd27-444d-bc93-9da169600ab5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:39.569167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:39.570628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:39.577040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:39.577864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:39.578170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:39.578960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:39.598844 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2727/5473] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:39.610860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:39.638245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:39.641670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:39.678072 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2747/5474] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:40.624520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:40.904593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:40.906475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:40.920290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb272e-7843-40ce-ad99-7f8b50a85812 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:40.927156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:40.932375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:40.932375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:40.932375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] PATH_INFO: `/v3/projects/b7188165c5f64e0984d24db86577d217` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:40.932375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7188165c5f64e0984d24db86577d217)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:40.932375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:40.991258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:40.998101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:41.010541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e1e9b-715b-4da8-9f86-98ae7afbf376 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:41.018656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:41.018656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.018656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.018656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] PATH_INFO: `/v3/projects/5300fab6343946668aa03c9b5dd146c8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.019147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5300fab6343946668aa03c9b5dd146c8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:41.021524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:41.099189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7188165c5f64e0984d24db86577d217', 'request_id': 'req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.106151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7188165c5f64e0984d24db86577d217', 'request_id': 'req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.193411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5300fab6343946668aa03c9b5dd146c8', 'request_id': 'req-f0135ba9-3598-42ed-8767-ee1e3b8161ab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.202238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5300fab6343946668aa03c9b5dd146c8', 'request_id': 'req-f0135ba9-3598-42ed-8767-ee1e3b8161ab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.209879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5300fab6343946668aa03c9b5dd146c8', 'request_id': 'req-f0135ba9-3598-42ed-8767-ee1e3b8161ab'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.213110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:41.214384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7188165c5f64e0984d24db86577d217', 'request_id': 'req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.228286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] The token cache is being invalidate because project b7188165c5f64e0984d24db86577d217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:41.228700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.229499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.231262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2728/5475] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:40 2022] DELETE /identity/v3/projects/b7188165c5f64e0984d24db86577d217 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:41.235255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:41.237289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:41.307449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6922c0d-1541-4d1a-81a0-849f99ad5a1c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:41.368610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:41.369254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.369536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.369821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] PATH_INFO: `/v3/users/e7ec29c263a14d11bb0a7e6b12ebc166` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.371014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ec29c263a14d11bb0a7e6b12ebc166)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:41.373222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:41.403278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] The token cache is being invalidate because project 5300fab6343946668aa03c9b5dd146c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:41.403590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.405052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f0135ba9-3598-42ed-8767-ee1e3b8161ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.407187 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2748/5476] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:40 2022] DELETE /identity/v3/projects/5300fab6343946668aa03c9b5dd146c8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:41.412780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582e56-8429-4a34-a816-8b6a90d7f832 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.413045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582e56-8429-4a34-a816-8b6a90d7f832 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.413646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12582e56-8429-4a34-a816-8b6a90d7f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.452697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-12582e56-8429-4a34-a816-8b6a90d7f832 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:41.454894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-12582e56-8429-4a34-a816-8b6a90d7f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:41.465242 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2749/5477] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:41.474582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.474866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.475363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.495659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:41.496846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:41.505724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2750/5478] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:50:41.512741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:41.524408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775394-c5e1-4220-883c-df4d028ac1d2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:41.530504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:41.531394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.531850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.532340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.534001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:41.534483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:41.539287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:41.559457 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2751/5479] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:41.562872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:41.575312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660e2d0-4260-428c-a18c-fdd2d217f0a5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:41.581266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:41.582590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.582877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.583149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.583795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:41.585981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:41.794530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ec29c263a14d11bb0a7e6b12ebc166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.818281 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2752/5480] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:41 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:41.818281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:41.941767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ec29c263a14d11bb0a7e6b12ebc166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.943214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ceb58-3387-4915-a683-669592a8f178 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:41.949658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:41.950789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:41.951308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:41.951858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:41.952972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:41.956748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:41.962548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ec29c263a14d11bb0a7e6b12ebc166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.965046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ec29c263a14d11bb0a7e6b12ebc166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.966095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ec29c263a14d11bb0a7e6b12ebc166'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:41.987821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2729/5481] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:41 2022] DELETE /identity/v3/users/e7ec29c263a14d11bb0a7e6b12ebc166 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:50:42.018327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.020049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.094423 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2753/5482] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:41 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:42.095514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.099842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.130842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22931-e5b4-47c4-be84-6a0d9da58965 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.162858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a9c8b-c16c-42ac-812e-f58aa210bdcd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.170907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.171788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.172227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.172752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] PATH_INFO: `/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.175318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e485eda4f2648f1b639dbe2c1504fb2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.177664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:42.231973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.233150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.233636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.234118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.235254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.239139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:42.267387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2754/5483] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:42.267387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.269360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.288896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c165-ba1d-4bfa-9ca4-4cffb69b878c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.299668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.300683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.300924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.301201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] PATH_INFO: `/v3/users/b2ee0f7286134291b1f978cbe61fba1f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.302763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ee0f7286134291b1f978cbe61fba1f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.305040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:42.359747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e485eda4f2648f1b639dbe2c1504fb2', 'request_id': 'req-54f7462f-6ee9-4173-9808-bc17b68744d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.378281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e485eda4f2648f1b639dbe2c1504fb2', 'request_id': 'req-54f7462f-6ee9-4173-9808-bc17b68744d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.476990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e485eda4f2648f1b639dbe2c1504fb2', 'request_id': 'req-54f7462f-6ee9-4173-9808-bc17b68744d6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.492396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] The token cache is being invalidate because project 8e485eda4f2648f1b639dbe2c1504fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:42.493052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.494454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.496478 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2730/5484] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:42 2022] DELETE /identity/v3/projects/8e485eda4f2648f1b639dbe2c1504fb2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:42.497582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.499657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.596217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ee0f7286134291b1f978cbe61fba1f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.625324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7462f-6ee9-4173-9808-bc17b68744d6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.635428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.636438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.637567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.638060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.639363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.641443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:42.659272 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2731/5485] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:42.660622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.663145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.681920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf13708-f444-42df-a5ff-f99b18aab4c0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.691612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.693533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.694189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.694668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] PATH_INFO: `/v3/users/a5eb6c7c36064131b2126eb8b4670565` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.697328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5eb6c7c36064131b2126eb8b4670565)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.704372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:42.741066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ee0f7286134291b1f978cbe61fba1f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.764658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ee0f7286134291b1f978cbe61fba1f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.777813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ee0f7286134291b1f978cbe61fba1f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.779209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ee0f7286134291b1f978cbe61fba1f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:42.791289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2755/5486] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:42 2022] DELETE /identity/v3/users/b2ee0f7286134291b1f978cbe61fba1f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:42.792420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:42.794306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:42.866421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:42.946517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d68d9-41cc-403b-9c82-fede7aaba9e9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:42.951753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:42.952433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:42.952778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:42.954263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] PATH_INFO: `/v3/projects/f186122ccc544711bef5dee32ebcc387/users/6475ff3243c04369bbe4939083d936cb/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:42.971989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f186122ccc544711bef5dee32ebcc387, user_id=6475ff3243c04369bbe4939083d936cb, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:42.975301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc4218-9965-4b91-ac06-90db2b8f25ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:43.008882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5eb6c7c36064131b2126eb8b4670565'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:43.123337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2756/5487] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:42 2022] PUT /identity/v3/projects/f186122ccc544711bef5dee32ebcc387/users/6475ff3243c04369bbe4939083d936cb/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:43.141222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5eb6c7c36064131b2126eb8b4670565'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:43.166784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5eb6c7c36064131b2126eb8b4670565'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:43.170182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5eb6c7c36064131b2126eb8b4670565'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:43.171278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5eb6c7c36064131b2126eb8b4670565'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:43.205872 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2732/5488] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:42 2022] DELETE /identity/v3/users/a5eb6c7c36064131b2126eb8b4670565 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:43.225599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:43.226146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:43.226714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:43.274595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] MFA Rules not processed for user `6475ff3243c04369bbe4939083d936cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:43.276551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:43.380917 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2757/5489] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:43.405362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:43.407467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:43.509480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f892c1-249a-4cd2-a8af-1f2819fae771 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:43.519227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:43.520696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:43.521243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:43.522271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:43.541924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:43.543721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:43.558240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2733/5490] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:43.699806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:43.701803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:43.871399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa4cd7-0347-419c-a24c-f5e7cdcc2027 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:43.882908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:43.883719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:43.884074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:43.884413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] PATH_INFO: `/v3/projects/658d7b13f50947999abfb7cc7da5cb25` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:43.886781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=658d7b13f50947999abfb7cc7da5cb25)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:43.896479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:43.994542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:43.996610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:44.030407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948845-d378-46bd-aad5-35d375d5fae5 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:44.045518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:44.046406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.046852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.047341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] PATH_INFO: `/v3/projects/f52a08706d544b6cb0d7e3c23b566d98` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.049287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f52a08706d544b6cb0d7e3c23b566d98)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:44.054112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:44.128669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658d7b13f50947999abfb7cc7da5cb25', 'request_id': 'req-c07cf00a-e655-45fd-80e5-37e209531858'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.151613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658d7b13f50947999abfb7cc7da5cb25', 'request_id': 'req-c07cf00a-e655-45fd-80e5-37e209531858'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.152904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658d7b13f50947999abfb7cc7da5cb25', 'request_id': 'req-c07cf00a-e655-45fd-80e5-37e209531858'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.209163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f52a08706d544b6cb0d7e3c23b566d98', 'request_id': 'req-25fe70a8-9e92-4800-980c-83779fb62a08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.218965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f52a08706d544b6cb0d7e3c23b566d98', 'request_id': 'req-25fe70a8-9e92-4800-980c-83779fb62a08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.285430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] The token cache is being invalidate because project 658d7b13f50947999abfb7cc7da5cb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:44.286025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.286952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c07cf00a-e655-45fd-80e5-37e209531858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.288959 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2758/5491] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:43 2022] DELETE /identity/v3/projects/658d7b13f50947999abfb7cc7da5cb25 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:44.300221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2d7e-1fbf-4d1f-8204-ad3d51986409 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.300776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2d7e-1fbf-4d1f-8204-ad3d51986409 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.301308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e2d7e-1fbf-4d1f-8204-ad3d51986409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.348605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1d4e2d7e-1fbf-4d1f-8204-ad3d51986409 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:44.359445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d4e2d7e-1fbf-4d1f-8204-ad3d51986409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:44.375522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f52a08706d544b6cb0d7e3c23b566d98', 'request_id': 'req-25fe70a8-9e92-4800-980c-83779fb62a08'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.396863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] The token cache is being invalidate because project f52a08706d544b6cb0d7e3c23b566d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:44.397196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.400762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-25fe70a8-9e92-4800-980c-83779fb62a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:44.405146 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2734/5492] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:43 2022] DELETE /identity/v3/projects/f52a08706d544b6cb0d7e3c23b566d98 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:44.411237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8142d-4c28-48bc-8b9a-26231911334a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.411544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8142d-4c28-48bc-8b9a-26231911334a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.414004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8142d-4c28-48bc-8b9a-26231911334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.464580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-daf8142d-4c28-48bc-8b9a-26231911334a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:44.465971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-daf8142d-4c28-48bc-8b9a-26231911334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:44.471405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2759/5493] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:44.480647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.482016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.482016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.496739 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2735/5494] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:44.499755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.500140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.500548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.526916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:44.528191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:44.539728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:44.541005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:44.548381 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2760/5495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:44.561172 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2736/5496] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:44.565207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.567560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.583626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46039003-1b43-4a5a-9333-0cdb6bcceae9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:44.587034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f3cd8-d501-4332-a9d4-9f09ac41c64d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:44.596077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:44.597139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:44.597830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.602634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.602634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.602634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.602634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:44.602634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:44.603245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.603245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.603245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:44.603245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:44.605397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:44.606759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:44.632161 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2737/5497] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:44.633387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.641149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2761/5498] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:44.645675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a666b-996a-4fe8-9cb3-1c1bc8e243fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:44.657519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.667043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:44.668115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.668673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.669166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.670221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:44.672438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f3e5b-c858-4547-a632-2b4912887d86 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:44.673276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:44.679845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:44.681580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:44.681855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:44.682759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:44.683402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:44.686316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:44.698080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:44.805391 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2738/5499] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/projects => generated 369 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:44.806386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.911280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2762/5500] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/projects => generated 365 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:44.912530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:44.947246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3996f4-30be-44b3-aa8b-44c465be91ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.069067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62252031-12d3-46f1-840c-86370d67dc88 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.083299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.085102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.085621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.086115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.088257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.091621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.117365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.118699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.119175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.119445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.120287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.123445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.236104 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2763/5501] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:45.237447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.253025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3d6f-ec31-423b-8ffc-ffa2e92a7878 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.267989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.268666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.268943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.270439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.271139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.272963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.286858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2764/5502] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:45.290472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.305264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44806b-bc3c-4205-a5e2-58f9262a2672 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.322259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2739/5503] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:44 2022] POST /identity/v3/users => generated 285 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:45.322404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.322404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.322404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.322404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.323028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.324842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.327072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.350884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dbca6-513d-47a0-8caa-f0f8381d264c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.358336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.359995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:45.360604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.361810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.362518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.366405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2765/5504] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:45.374415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.382332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.385740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.418569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2740/5505] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:45.420828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500db696-aef8-4932-b899-f9343870d98a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.422242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.427570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.428352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.428736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.429122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] PATH_INFO: `/v3/projects/9033b213f29a41d7b9d5ffcadfdc443e/users/a4e7fe07a39c42cab1ec4d62e67ea2f5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.436243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e425947-1fb7-47bd-b29a-b8758b74c9a8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.441874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.442493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.442770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.443039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.443829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.449718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.462859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9033b213f29a41d7b9d5ffcadfdc443e, user_id=a4e7fe07a39c42cab1ec4d62e67ea2f5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.466200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.473480 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2741/5506] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:45.473480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.477227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:45.490730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868a9d-cdb4-49d6-9c9d-8e5865f964d5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.496642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.497384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.498742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.498742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] PATH_INFO: `/v3/users/6475ff3243c04369bbe4939083d936cb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.499873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6475ff3243c04369bbe4939083d936cb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.503172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.663219 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2766/5507] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:45 2022] PUT /identity/v3/projects/9033b213f29a41d7b9d5ffcadfdc443e/users/a4e7fe07a39c42cab1ec4d62e67ea2f5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:45.664386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:45.804911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d00c6c-e84d-42fe-a1c7-9f3f54e5dad6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:45.825649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:45.826357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:45.826656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:45.826921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] PATH_INFO: `/v3/projects/578f951851ba4fa2a45100a794882f67/users/59aa3a44efa44643b7781125bc3d4d93/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:45.847435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f951851ba4fa2a45100a794882f67, user_id=59aa3a44efa44643b7781125bc3d4d93, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:45.853061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb359cb-e7f6-465f-a057-545cb21a8683 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:45.911462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6475ff3243c04369bbe4939083d936cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.000175 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2767/5508] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:45 2022] PUT /identity/v3/projects/578f951851ba4fa2a45100a794882f67/users/59aa3a44efa44643b7781125bc3d4d93/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:46.004723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.005329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.007677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.016853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6475ff3243c04369bbe4939083d936cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.061403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6475ff3243c04369bbe4939083d936cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.066570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6475ff3243c04369bbe4939083d936cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.067302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac264c0-5fb4-4e4e-966d-d61c8c1942df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6475ff3243c04369bbe4939083d936cb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.134463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2742/5509] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:45 2022] DELETE /identity/v3/users/6475ff3243c04369bbe4939083d936cb => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:46.135479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] MFA Rules not processed for user `a4e7fe07a39c42cab1ec4d62e67ea2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:46.137748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.139679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132ff8a-65b3-4c7b-9b51-499d8bdf2b82 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.139973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132ff8a-65b3-4c7b-9b51-499d8bdf2b82 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.140268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132ff8a-65b3-4c7b-9b51-499d8bdf2b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.196300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e132ff8a-65b3-4c7b-9b51-499d8bdf2b82 None None] MFA Rules not processed for user `59aa3a44efa44643b7781125bc3d4d93`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:46.198463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e132ff8a-65b3-4c7b-9b51-499d8bdf2b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.258269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2768/5510] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:46.260238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:46.263288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.348668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2743/5511] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:46.350943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959b1e4-b782-43ab-90b9-22f04eb55ac1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.350943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959b1e4-b782-43ab-90b9-22f04eb55ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.356654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959b1e4-b782-43ab-90b9-22f04eb55ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.379396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1af54-6637-4e6c-bc55-cf4a3b1f0b7b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:46.386531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:46.387696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.387696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.388059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] PATH_INFO: `/v3/projects/61d29addecfb45f68efb1add9e638980` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.389645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d29addecfb45f68efb1add9e638980)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:46.391966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:46.430630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c959b1e4-b782-43ab-90b9-22f04eb55ac1 None None] MFA Rules not processed for user `74e8f5f38274470f94b321c405345be5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:46.432304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c959b1e4-b782-43ab-90b9-22f04eb55ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.559386 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2744/5512] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:46.562673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.563142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.563515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.566866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d29addecfb45f68efb1add9e638980', 'request_id': 'req-54e0bc85-c0de-47de-8fb8-950f2d1935b6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.595994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d29addecfb45f68efb1add9e638980', 'request_id': 'req-54e0bc85-c0de-47de-8fb8-950f2d1935b6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.613114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d29addecfb45f68efb1add9e638980', 'request_id': 'req-54e0bc85-c0de-47de-8fb8-950f2d1935b6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.633021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:46.640726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.716784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] The token cache is being invalidate because project 61d29addecfb45f68efb1add9e638980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:46.717532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.718521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:46.725627 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2769/5513] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:46 2022] DELETE /identity/v3/projects/61d29addecfb45f68efb1add9e638980 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:46.727065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:46.730244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.770769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:46.815000 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2745/5514] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:46.815000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:46.816711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.933602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0bc85-c0de-47de-8fb8-950f2d1935b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:46.946596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:46.947236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.953052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.953052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.953052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:46.980077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5278a-b5bb-4629-92c9-82ac3724594f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:46.986420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:46.987509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:46.988128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:46.988846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:46.990707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:create_application_credential(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:46.993298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:47.061469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:47.098446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:47.101912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:47.129052 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2770/5515] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:47.132525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:47.136920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:47.174060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e0b1e-2152-44dd-a856-a31e0c43f492 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:47.184857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:47.185570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:47.185847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:47.186119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] PATH_INFO: `/v3/users/080d55b2aea5489486f07ff4f9d24dc6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:47.199658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080d55b2aea5489486f07ff4f9d24dc6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:47.199658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:47.359877 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2746/5516] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:50:46 2022] POST /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials => generated 921 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:47.359877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:47.364227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:47.474483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ff948-2a90-44a1-ba1c-9b950108aea9 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:47.482083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:47.482892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:47.485697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:47.486408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:47.507555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:47.509367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:47.526928 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2747/5517] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:47.528088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:47.530470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:47.562320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121dd7a9-00ac-4fa4-ae02-b46c62e376d0 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:47.570029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:47.571412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:47.571903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:47.572250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] PATH_INFO: `/v3/users/a4e7fe07a39c42cab1ec4d62e67ea2f5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:47.573341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:47.573724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e7fe07a39c42cab1ec4d62e67ea2f5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:47.575912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:47.677253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:47.774937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:47.807675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:47.822546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:47.823608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080d55b2aea5489486f07ff4f9d24dc6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:47.838565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2771/5518] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:47 2022] DELETE /identity/v3/users/080d55b2aea5489486f07ff4f9d24dc6 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:47.839721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:47.842116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:47.944024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f76b7-0d60-4f46-a47a-b6e64ad1a988 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:47.951270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:47.951939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:47.952363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:47.952717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/ec8dc76f387a4474ba252c6fb3a9eb07` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:47.954628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:delete_access_rule(user_id=59aa3a44efa44643b7781125bc3d4d93, access_rule_id=ec8dc76f387a4474ba252c6fb3a9eb07)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:47.958134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application session.delete(ref) Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application yield resource Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application next(self.gen) Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.rollback() Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.force_reraise() Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:50:48.027374 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise self.value Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application session.commit() Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._prepare_impl() Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.session.flush() Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._flush(objects) Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:50:48.028795 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application compat.raise_( Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application flush_context.execute() Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rec.execute(self) Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._synchronize( Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise AssertionError( Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Nov 02 12:50:48.032098 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:48.035070 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2772/5519] 10.222.0.64 () {58 vars in 1362 bytes} [Wed Nov 2 12:50:47 2022] DELETE /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/ec8dc76f387a4474ba252c6fb3a9eb07 => generated 89 bytes in 192 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:50:48.036580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.043962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e7fe07a39c42cab1ec4d62e67ea2f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.089189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd73a36-220d-49dc-8fd5-aca1627c8a17 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.107215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.107966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.108255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.108676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials/d313ed01eff04073bb909949dce7e1e6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.154876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:delete_application_credential(user_id=59aa3a44efa44643b7781125bc3d4d93, application_credential_id=d313ed01eff04073bb909949dce7e1e6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.162865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.207046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e7fe07a39c42cab1ec4d62e67ea2f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.227473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e7fe07a39c42cab1ec4d62e67ea2f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.228612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e7fe07a39c42cab1ec4d62e67ea2f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.229434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e105046-9376-4f5d-bd68-094c1403c1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e7fe07a39c42cab1ec4d62e67ea2f5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.249491 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2748/5520] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:47 2022] DELETE /identity/v3/users/a4e7fe07a39c42cab1ec4d62e67ea2f5 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:48.255546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.255857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.256334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.293123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:48.296310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:48.327797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2773/5521] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:50:48 2022] DELETE /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials/d313ed01eff04073bb909949dce7e1e6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:48.332260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.335386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:48.366051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6877203-685b-429c-a930-5cbccd327f4f tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.481034 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2749/5522] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:48.495695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.496892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.498667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.498667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.501090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:list_access_rules(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.503459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.511750 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2774/5523] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:50:48 2022] GET /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules => generated 369 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:50:48.515905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.533296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5d9f6-96e4-44f5-8046-24ccf53c75bc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.539788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.542005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:48.551471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.553244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.553659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.554378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/ec8dc76f387a4474ba252c6fb3a9eb07` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.558366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:delete_access_rule(user_id=59aa3a44efa44643b7781125bc3d4d93, access_rule_id=ec8dc76f387a4474ba252c6fb3a9eb07)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.562189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.664216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3699b-949f-4ac9-a8e2-bd9476068f63 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.677328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.677923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.678274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.678550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.696254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.697774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.722390 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2775/5524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:48.724599 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2750/5525] 10.222.0.64 () {58 vars in 1362 bytes} [Wed Nov 2 12:50:48 2022] DELETE /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/ec8dc76f387a4474ba252c6fb3a9eb07 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:48.728772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.742372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373e12f-3ee0-4b26-a53d-fbade6f406de service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.748632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.749522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.749816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.754463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.758933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:list_access_rules(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.758933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.762624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.764384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:48.773493 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2776/5526] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:50:48 2022] GET /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules => generated 158 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:48.774449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:48.786841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3aa21a-501d-4a44-8e39-babc49430953 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.795514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fbca8-5b49-42bf-b3de-7d3061df5cbc tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:48.798476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.799274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.799559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.799836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] PATH_INFO: `/v3/projects/f186122ccc544711bef5dee32ebcc387` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.801465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f186122ccc544711bef5dee32ebcc387)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.805076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.808427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:48.809184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:48.809472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:48.809797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:48.810478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:create_application_credential(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:48.811687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:48.923530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f186122ccc544711bef5dee32ebcc387', 'request_id': 'req-5282703a-eeeb-4885-bdf6-478bfec127f9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.935228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f186122ccc544711bef5dee32ebcc387', 'request_id': 'req-5282703a-eeeb-4885-bdf6-478bfec127f9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:48.970170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:49.039366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f186122ccc544711bef5dee32ebcc387', 'request_id': 'req-5282703a-eeeb-4885-bdf6-478bfec127f9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.046420 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2777/5527] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:50:48 2022] POST /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials => generated 921 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:49.050702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.058600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] The token cache is being invalidate because project f186122ccc544711bef5dee32ebcc387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:49.059110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.060107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5282703a-eeeb-4885-bdf6-478bfec127f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.062231 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2751/5528] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:48 2022] DELETE /identity/v3/projects/f186122ccc544711bef5dee32ebcc387 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:49.069518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.070580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.071161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.071602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc578-72d7-4e3e-99fb-b5b40b38979c tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.150265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:49.151747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.216643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.217317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.217603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.217878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.219681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:list_access_rules(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.224803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.241014 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2778/5529] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:50:49 2022] GET /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules => generated 369 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:50:49.245637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.249776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.293712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479db54b-fdd3-44a8-80fd-ebd8f858f116 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.299734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.300712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.301346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.301786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.302651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:create_application_credential(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.304427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc5b3c-445a-4350-8bf2-c58611c69921 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.315356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2752/5530] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:49.317103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.318520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.335333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84d6f-f5cf-4b2e-b1f9-6b4e58b1264d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.345528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.346418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.346806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.347331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] PATH_INFO: `/v3/projects/9988b193cd3741778dbab0aab3ce68fc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.349662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9988b193cd3741778dbab0aab3ce68fc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.352269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.364019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:49.625331 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2779/5531] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/application_credentials => generated 921 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:49.625331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.625331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.625331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.652665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9988b193cd3741778dbab0aab3ce68fc', 'request_id': 'req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.666990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9988b193cd3741778dbab0aab3ce68fc', 'request_id': 'req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.667992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:49.671036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.748776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9988b193cd3741778dbab0aab3ce68fc', 'request_id': 'req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.784771 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2780/5532] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:49.786810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.790726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] The token cache is being invalidate because project 9988b193cd3741778dbab0aab3ce68fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:49.793043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.797796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:49.797796 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2753/5533] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:49 2022] DELETE /identity/v3/projects/9988b193cd3741778dbab0aab3ce68fc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:49.797796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.800949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.822887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5362ba5-c9ad-42bb-bf63-3ff260c9b582 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.830948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.831863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.832704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.833172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.834823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:49.836267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.838236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09d25f-0f19-4abd-a1ab-0bccc7159a5a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.856593 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2754/5534] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:49.858469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.858933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.859403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.896935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:49.898921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:49.918138 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2755/5535] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:49.918138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:49.927845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63c71b-d632-4137-a69a-55d99af228ee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.939819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b9df8-fd25-48c4-91e0-748231572f04 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:49.942140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59aa3a44efa44643b7781125bc3d4d93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '578f951851ba4fa2a45100a794882f67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.943508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.943907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.944546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/8f6216b0ec8f44829c0fd92a0c5db40f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.949749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:49.950662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.951063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorizing `identity:get_access_rule(user_id=59aa3a44efa44643b7781125bc3d4d93, access_rule_id=8f6216b0ec8f44829c0fd92a0c5db40f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.951609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.952114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:49.952979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:49.953222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f427ebb-782c-4bad-8772-ab1fea60e777 tempest-AccessRulesV3Test-351331748 tempest-AccessRulesV3Test-351331748-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.957094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:49.966889 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2781/5536] 10.222.0.64 () {58 vars in 1359 bytes} [Wed Nov 2 12:50:49 2022] GET /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93/access_rules/8f6216b0ec8f44829c0fd92a0c5db40f => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:49.972720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:49.973148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:49.973659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.013059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:50.014562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:50.048609 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2782/5537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:50.050399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.053772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:50.071870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a1ddb-13f5-49c6-b085-b77152a63e36 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.084975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.084975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.084975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.084975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] PATH_INFO: `/v3/users/59aa3a44efa44643b7781125bc3d4d93` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.085466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59aa3a44efa44643b7781125bc3d4d93)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.086371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.120043 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2756/5538] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:49 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:50.130683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.240319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a06db9-c2cb-44af-a5f3-632ca2e64dd1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.246260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.247175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.247457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.247848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.248989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:50.249522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.251501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.274566 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2757/5539] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:50.275880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.294076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415dffc-0604-443c-96ea-0f769b7a6474 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.300908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.301946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.302392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.302849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.303692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.306218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.405495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59aa3a44efa44643b7781125bc3d4d93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:50.432419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:50.463067 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2758/5540] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:50 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:50.464393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.478094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b04e-9a61-473b-9e74-8593862c7586 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.494431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.495239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.496509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.496509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.496509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.498736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.522728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59aa3a44efa44643b7781125bc3d4d93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:50.650885 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2759/5541] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:50 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:50.653214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.766913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2624d-d623-4b72-bb4a-5562262ff19a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.781892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.782944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.784267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.784807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.785843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.792264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.808106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59aa3a44efa44643b7781125bc3d4d93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:50.808843 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2760/5542] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:50.813032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.825714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59aa3a44efa44643b7781125bc3d4d93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:50.826503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59aa3a44efa44643b7781125bc3d4d93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:50.832086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544f168-00a5-484e-a6b9-ce45ecd24f41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.841138 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2783/5543] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:50 2022] DELETE /identity/v3/users/59aa3a44efa44643b7781125bc3d4d93 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:50.844749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:50.849751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:50.851539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.852175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.852452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.852748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.854655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.857265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1014ebe-ea62-4007-a4b5-efb0ae66678f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:50.974388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04d796-65f3-4983-a714-58925967ac75 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:50.988701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:50.989476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:50.989770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:50.990120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:50.990858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:50.992626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.019159 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2761/5544] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:50 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:51.030544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.030544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.030544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.032197 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2784/5545] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:51.038172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.060647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e905d4a-78dd-4d88-85db-07a71f375834 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.067590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:51.069092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.075295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.076053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.076334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.076648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] PATH_INFO: `/v3/projects/e50490f448cd46158427d5122f3528b8/users/ea9c0f07fdde4b56be39fca015883797/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.081406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2762/5546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:51.083159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.086598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.115749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50490f448cd46158427d5122f3528b8, user_id=ea9c0f07fdde4b56be39fca015883797, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.117546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3d2d2-3d0c-4cea-a43c-9486f50c621f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.122743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.130322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.131245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.131754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.132474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.133503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.135762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.151153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2763/5547] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:51.152578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.155374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.234875 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2785/5548] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:51 2022] PUT /identity/v3/projects/e50490f448cd46158427d5122f3528b8/users/ea9c0f07fdde4b56be39fca015883797/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:51.236227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.263156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94624b-f516-43b9-b447-bc8bf7f77940 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.394130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9740f-7982-40f4-bdf7-c635e85b15ae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.403476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.404267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.404681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.405080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.407611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.408272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.408592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.408976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.409636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.411418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f4593-e2bb-4a5a-a108-05e9ca03976e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.423405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.426022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.459863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2786/5549] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:51.461783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.462019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.462589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.482735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2764/5550] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:51.485664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.490641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.511944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] MFA Rules not processed for user `ea9c0f07fdde4b56be39fca015883797`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:51.514283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.526342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e471-06c0-45a0-ad09-c4009bea4d2e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.536906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.537558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.537832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.538097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] PATH_INFO: `/v3/projects/9033b213f29a41d7b9d5ffcadfdc443e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.541127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9033b213f29a41d7b9d5ffcadfdc443e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.543088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.656930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:51.676037 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2787/5551] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:51.676037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.704091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9a869-3fe5-423d-be5b-8b5919bbc9fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:51.712623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:51.714143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.714656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.715105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] PATH_INFO: `/v3/projects/60997a8fc8964176b4f4b0560abc8240/users/89cc13d2bbf8473fbae734ca05aa3e48/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:51.753919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60997a8fc8964176b4f4b0560abc8240, user_id=89cc13d2bbf8473fbae734ca05aa3e48, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:51.756842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:51.762512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9033b213f29a41d7b9d5ffcadfdc443e', 'request_id': 'req-344d4342-c8b9-4e19-a60a-d53afce7a2d5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:51.776123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9033b213f29a41d7b9d5ffcadfdc443e', 'request_id': 'req-344d4342-c8b9-4e19-a60a-d53afce7a2d5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:51.864032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2788/5552] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:51 2022] PUT /identity/v3/projects/60997a8fc8964176b4f4b0560abc8240/users/89cc13d2bbf8473fbae734ca05aa3e48/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:51.876248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:51.878475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:51.935221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9033b213f29a41d7b9d5ffcadfdc443e', 'request_id': 'req-344d4342-c8b9-4e19-a60a-d53afce7a2d5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:51.961664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] The token cache is being invalidate because project 9033b213f29a41d7b9d5ffcadfdc443e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:51.962457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:51.963463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-344d4342-c8b9-4e19-a60a-d53afce7a2d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:51.965396 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2765/5553] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:51 2022] DELETE /identity/v3/projects/9033b213f29a41d7b9d5ffcadfdc443e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:51.966965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:51.967547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:51.968116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.000158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbb968-c82b-4073-b737-05152a52ce89 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.005705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.014051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.014051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.014051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.014051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:52.030921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] MFA Rules not processed for user `89cc13d2bbf8473fbae734ca05aa3e48`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:52.032468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:52.082762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.084955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d32c78-791d-4340-9aff-1320e7237c06 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.099929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2789/5554] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:52.100983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d080be-5c62-486b-8eb8-39cdce8b24e7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.101482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d080be-5c62-486b-8eb8-39cdce8b24e7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.103575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d080be-5c62-486b-8eb8-39cdce8b24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.144682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f7d080be-5c62-486b-8eb8-39cdce8b24e7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:52.148042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f7d080be-5c62-486b-8eb8-39cdce8b24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:52.183055 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2766/5555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:52.187047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.188663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:52.259864 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2790/5556] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:52.262734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.264314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.265068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.294859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:52.297770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:52.314076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2791/5557] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:52.315574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.328240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbae17a-bd9e-4077-aa54-cd33f0dd6664 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.335761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.336440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.336751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.337083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.337747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:52.338117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.339563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086df04e-d36f-4eb7-8b72-0d01576906c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.340006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.354651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.354999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.355278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.355558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.356226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.358234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.362848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2792/5558] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:52.362848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.382163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f0e03-c108-4b64-a38a-ab7806774aa9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.393983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.395853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.395853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.396826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.397603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.400026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.559198 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2767/5559] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/projects => generated 371 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:52.563404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.580523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2793/5560] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/projects => generated 357 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:52.585334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.690492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028fb1f-3182-491d-8b88-ec555f8ab151 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.747567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91a9dd-349b-4435-b99a-d9ba95091ca0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.758387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.759022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.759302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.759575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.760214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.762310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.833451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.834102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.834362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.834641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.835704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.839328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.879744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:52.935319 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2794/5561] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/users => generated 279 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:52.940537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.951874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddcfcb1-4c9c-48ee-aff5-d901d9055634 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:52.959197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:52.959835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:52.960117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:52.960395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:52.961130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:52.963067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:52.966765 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2768/5562] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:52 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:52.970718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.981169 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2795/5563] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:52.983102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:52.994204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb55688-ca21-432a-888f-cec663a7b156 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.001050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495387cb-4e29-473c-b761-5e18d40477e3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.010207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.011092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.013722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.017810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.017810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.017810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.017810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.018758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.018867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.020178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.022069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.024462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.031625 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2769/5564] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:53.037658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:53.042675 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2796/5565] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:53.050417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:53.054276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032b6f77-8dd8-402f-893c-37cb92a00ff7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.067040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.067791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7e551-23dd-4aee-8cd5-7878d8ce0d08 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.069411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.069872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.070475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] PATH_INFO: `/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3/users/8621705d94aa49b190f06a486a9a1187/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.076583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.077188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.077482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.077789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] PATH_INFO: `/v3/projects/6ab34962cdf54e668039b39b6d7fbd15/users/a53e5098afd7400ea3cb8377a9395d02/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.115649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab34962cdf54e668039b39b6d7fbd15, user_id=a53e5098afd7400ea3cb8377a9395d02, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.118672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223085-35af-488d-97a2-c72f1efd8c58 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.124245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3b0db7bfbc47dd8e2b76bd52e8c8b3, user_id=8621705d94aa49b190f06a486a9a1187, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.129502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.210093 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2797/5566] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:53 2022] PUT /identity/v3/projects/6ab34962cdf54e668039b39b6d7fbd15/users/a53e5098afd7400ea3cb8377a9395d02/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:53.223008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.224694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.224694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.267633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2770/5567] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:53 2022] PUT /identity/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3/users/8621705d94aa49b190f06a486a9a1187/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:53.287303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] MFA Rules not processed for user `a53e5098afd7400ea3cb8377a9395d02`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:53.299599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:53.299781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:53.498382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2798/5568] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:53.498382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:53.529255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:53.581945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824f43c-4cde-4fcf-a579-0d569105bcb1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.600769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.601582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.602131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.609958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.609958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.609958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.636386 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2771/5569] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:53.636386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:53.665327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1961e-0d21-48f1-b992-406cf77fa984 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.684957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.686597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.686597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.686597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] PATH_INFO: `/v3/users/a53e5098afd7400ea3cb8377a9395d02` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.689820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53e5098afd7400ea3cb8377a9395d02)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.693854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.698832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a82cfb-6281-4723-8516-1c8a5d9d1cd0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:53.723790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:53.725384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:53.725384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:53.725384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] PATH_INFO: `/v3/projects/578f951851ba4fa2a45100a794882f67` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:53.727456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578f951851ba4fa2a45100a794882f67)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:53.730473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:53.763694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:53.940411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578f951851ba4fa2a45100a794882f67', 'request_id': 'req-93844f76-a698-496d-b8b9-8e89de722da9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:53.957349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578f951851ba4fa2a45100a794882f67', 'request_id': 'req-93844f76-a698-496d-b8b9-8e89de722da9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:53.965679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578f951851ba4fa2a45100a794882f67', 'request_id': 'req-93844f76-a698-496d-b8b9-8e89de722da9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.058588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53e5098afd7400ea3cb8377a9395d02'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.082262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] The token cache is being invalidate because project 578f951851ba4fa2a45100a794882f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:54.082262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.082262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.089721 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2799/5570] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:53 2022] DELETE /identity/v3/projects/578f951851ba4fa2a45100a794882f67 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:54.091712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:54.093562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.199357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53e5098afd7400ea3cb8377a9395d02'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.229836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53e5098afd7400ea3cb8377a9395d02'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.232078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53e5098afd7400ea3cb8377a9395d02'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.232684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee1c1489-9519-4678-92b2-4885cd4b93a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53e5098afd7400ea3cb8377a9395d02'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:54.257796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844f76-a698-496d-b8b9-8e89de722da9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:54.258292 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2772/5571] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:53 2022] DELETE /identity/v3/users/a53e5098afd7400ea3cb8377a9395d02 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:54.259783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaf41-0568-4303-8a7a-313037b6fbea None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.260301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaf41-0568-4303-8a7a-313037b6fbea None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.261430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05aaf41-0568-4303-8a7a-313037b6fbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.302216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b05aaf41-0568-4303-8a7a-313037b6fbea None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:54.304216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b05aaf41-0568-4303-8a7a-313037b6fbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.412817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:54.414669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.425577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.425577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] PATH_INFO: `/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3/users/8621705d94aa49b190f06a486a9a1187/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.425861 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2773/5572] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:54.425861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6ff3a-5ab5-4a83-a85e-5988eee0bf53 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.425861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6ff3a-5ab5-4a83-a85e-5988eee0bf53 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.425861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6ff3a-5ab5-4a83-a85e-5988eee0bf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.426186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3b0db7bfbc47dd8e2b76bd52e8c8b3, user_id=8621705d94aa49b190f06a486a9a1187, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:54.428071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa1566-479c-4d1d-9234-c4d44d561988 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:54.464902 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2800/5573] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:54 2022] PUT /identity/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3/users/8621705d94aa49b190f06a486a9a1187/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:54.471958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.471958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.471958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.472297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-03d6ff3a-5ab5-4a83-a85e-5988eee0bf53 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:54.474509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-03d6ff3a-5ab5-4a83-a85e-5988eee0bf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.494559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:54.496169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.600447 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2774/5574] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:54.601851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048fd01-f803-4609-a898-73929104dc29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.602284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048fd01-f803-4609-a898-73929104dc29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.602598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048fd01-f803-4609-a898-73929104dc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.604446 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2801/5575] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:54.608921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:54.626395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a60be-6e60-4784-b9f3-dd471465c033 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:54.632203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:54.632203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.632592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.633012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.633782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:54.634185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:54.636197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:54.641962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1048fd01-f803-4609-a898-73929104dc29 None None] MFA Rules not processed for user `8621705d94aa49b190f06a486a9a1187`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:54.643678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1048fd01-f803-4609-a898-73929104dc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.656219 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2802/5576] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:54.657475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:54.661346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:54.766421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de784e2-fd9d-45ff-ac70-b395d8759ab9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:54.772797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:54.773750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.774062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.774434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.787056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:54.789286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:54.803163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2803/5577] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:54.805838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:54.807672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2775/5578] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:54.814853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048fd01-f803-4609-a898-73929104dc29 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:54.816294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14692129-fc2e-4e3c-86be-5493f49704cb service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:54.821028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048fd01-f803-4609-a898-73929104dc29 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:54.822787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:54.823415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.823699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.823971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.825170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:54.827158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:54.834339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:54.834976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:54.835263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:54.835541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:54.836248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:54.840303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:54.994145 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2804/5579] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:55.000613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.072923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2776/5580] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/projects => generated 360 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:55.075940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.135054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:55.207447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c6afb-a780-4ae3-829d-57ff7e32ccfb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.253373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41dc41-6af0-4218-b4ef-cad9d0a3467b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.260975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.262532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.262992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.263679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.265499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.270026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.278574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:55.358477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.359143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.359431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.359710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.362665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.367579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.505569 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2777/5581] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:55 2022] POST /identity/v3/users => generated 373 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:50:55.523996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.535518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b090e3-95a5-43a4-bc5a-a1e4338f0223 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.541148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.545321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.545321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.545321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.545321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:55.545321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.545874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.581705 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2805/5582] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:54 2022] POST /identity/v3/users => generated 285 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:50:55.585400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2778/5583] 10.222.0.64 () {58 vars in 1157 bytes} [Wed Nov 2 12:50:55 2022] GET /identity/v3/users?domain_id=default => generated 7160 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:55.586289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.589071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.602974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347909-9143-4b7d-8d31-ca7d3867b4dc tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.607216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80cfc69-4052-477b-a7bd-1a0a385949b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.613225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.614069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.614481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.615358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/users/08bcbedfb15b440d9d913124a6a746d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.624652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.625634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.626003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.626417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.627216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.630039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.662187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:update_user(user_id=08bcbedfb15b440d9d913124a6a746d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.664696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.671594 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2806/5584] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:50:55.674490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.697464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e00c8-0d53-49f6-8e1b-510ac2502850 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.713609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.714377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.715701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.716373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.717046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.719132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.741724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2807/5585] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:50:55.743571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:55.764221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45294d82-7cf7-4229-89ce-0e517efd33c2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:55.786988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:55.788445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.788941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.789877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] PATH_INFO: `/v3/projects/c62bde6eb894462e94c607407632084e/users/3982fa95cd8747d2aa324116c6c7e0e7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.810945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62bde6eb894462e94c607407632084e, user_id=3982fa95cd8747d2aa324116c6c7e0e7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:55.814202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97c671-eb64-4442-a2ba-e04b79d42c27 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:55.856156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:55.946998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invalidating the token cache because user 08bcbedfb15b440d9d913124a6a746d9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:55.947389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:55.948283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c59df4da-13db-4e79-9efb-c3e9ab96d737 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:55.952333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2779/5586] 10.222.0.64 () {60 vars in 1244 bytes} [Wed Nov 2 12:50:55 2022] PATCH /identity/v3/users/08bcbedfb15b440d9d913124a6a746d9 => generated 488 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:55.956861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2808/5587] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:50:55 2022] PUT /identity/v3/projects/c62bde6eb894462e94c607407632084e/users/3982fa95cd8747d2aa324116c6c7e0e7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:55.967775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.968124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.969031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.971494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:55.971785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:55.972057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:55.997930 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.auth.plugins.core [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] User is disabled: 08bcbedfb15b440d9d913124a6a746d9: AssertionError: User is disabled: 08bcbedfb15b440d9d913124a6a746d9 Nov 02 12:50:56.011682 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.application [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:50:56.016576 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2780/5588] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:55 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 60 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Nov 02 12:50:56.018105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.022606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:56.027379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] MFA Rules not processed for user `3982fa95cd8747d2aa324116c6c7e0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:56.043509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:56.178165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbf0c4-2504-4f2e-a299-ca370f2ff15c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.195432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.196434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.202296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.202841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/users/08bcbedfb15b440d9d913124a6a746d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.231070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:delete_user(user_id=08bcbedfb15b440d9d913124a6a746d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:56.233390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:56.243075 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2809/5589] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:56.252220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.263543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d558c3-015f-4ef5-8458-38285870c258 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.271378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3982fa95cd8747d2aa324116c6c7e0e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62bde6eb894462e94c607407632084e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.272020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.272301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.272604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] PATH_INFO: `/v3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.274327 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2810/5590] 10.222.0.64 () {58 vars in 1104 bytes} [Wed Nov 2 12:50:56 2022] GET /identity/v3 => generated 255 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:56.280106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.296947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fea1db-eef3-4ccc-aca3-cb3070be0522 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.305409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3982fa95cd8747d2aa324116c6c7e0e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62bde6eb894462e94c607407632084e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.306177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.306590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.306960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] PATH_INFO: `/v3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.309317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2811/5591] 10.222.0.64 () {58 vars in 1104 bytes} [Wed Nov 2 12:50:56 2022] GET /identity/v3 => generated 255 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:56.315239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.332751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e00755-44fe-4123-9d27-fd39f4b2adaf tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.341896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16626b9a-3eb9-4cba-b76f-0103c1bd6801 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3982fa95cd8747d2aa324116c6c7e0e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c62bde6eb894462e94c607407632084e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.342707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16626b9a-3eb9-4cba-b76f-0103c1bd6801 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.343229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16626b9a-3eb9-4cba-b76f-0103c1bd6801 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.343737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16626b9a-3eb9-4cba-b76f-0103c1bd6801 tempest-TestApiDiscovery-1427843091 tempest-TestApiDiscovery-1427843091-project] PATH_INFO: `/v3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.345907 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2812/5592] 10.222.0.64 () {58 vars in 1104 bytes} [Wed Nov 2 12:50:56 2022] GET /identity/v3 => generated 255 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:56.353807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab156f-750b-457f-9009-fbc9ed0ab300 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.354217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab156f-750b-457f-9009-fbc9ed0ab300 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.354737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab156f-750b-457f-9009-fbc9ed0ab300 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.357166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2813/5593] 10.222.0.64 () {56 vars in 895 bytes} [Wed Nov 2 12:50:56 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:50:56.362860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.364999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.365495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.371698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2814/5594] 10.222.0.64 () {56 vars in 895 bytes} [Wed Nov 2 12:50:56 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 02 12:50:56.377240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.381032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:56.475255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.495823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcb4ea-8535-4282-a08b-25842625d05f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.516538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.516538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.516538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.516538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] PATH_INFO: `/v3/users/3982fa95cd8747d2aa324116c6c7e0e7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.518580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3982fa95cd8747d2aa324116c6c7e0e7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:56.523051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:56.678365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.715852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.717511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.718701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08bcbedfb15b440d9d913124a6a746d9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.740390 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2781/5595] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:56 2022] DELETE /identity/v3/users/08bcbedfb15b440d9d913124a6a746d9 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:56.744854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:56.746901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:56.859487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db150c4-c145-41b7-b227-be695faed52b tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:56.869252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:56.870238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:56.872920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:56.872920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/projects/d4697e70eae24d98b239059c43ad1129` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:56.876325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4697e70eae24d98b239059c43ad1129)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:56.889656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:56.901608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3982fa95cd8747d2aa324116c6c7e0e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:56.964301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:57.038336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3982fa95cd8747d2aa324116c6c7e0e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.064930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3982fa95cd8747d2aa324116c6c7e0e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.069444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4697e70eae24d98b239059c43ad1129', 'request_id': 'req-799484bb-2300-435a-ab39-f05ff4b241bf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.079335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3982fa95cd8747d2aa324116c6c7e0e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.082713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3982fa95cd8747d2aa324116c6c7e0e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.086736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4697e70eae24d98b239059c43ad1129', 'request_id': 'req-799484bb-2300-435a-ab39-f05ff4b241bf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.096390 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2815/5596] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:56 2022] DELETE /identity/v3/users/3982fa95cd8747d2aa324116c6c7e0e7 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:57.106378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:57.110419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:57.209946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4697e70eae24d98b239059c43ad1129', 'request_id': 'req-799484bb-2300-435a-ab39-f05ff4b241bf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.232143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] The token cache is being invalidate because project d4697e70eae24d98b239059c43ad1129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:57.232796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.233704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.241697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2782/5597] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:56 2022] DELETE /identity/v3/projects/d4697e70eae24d98b239059c43ad1129 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:57.242721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:57.244318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:57.299513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9e4e-099a-4dbd-929b-18071dd17419 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:57.309164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:57.310351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:57.321168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:57.321868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] PATH_INFO: `/v3/users/74e8f5f38274470f94b321c405345be5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:57.323562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e8f5f38274470f94b321c405345be5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:57.325769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:57.356715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799484bb-2300-435a-ab39-f05ff4b241bf tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:57.375240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:57.376208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:57.377948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:57.378386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] PATH_INFO: `/v3/projects/6ab34962cdf54e668039b39b6d7fbd15` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:57.384827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab34962cdf54e668039b39b6d7fbd15)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:57.387218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:57.706011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e8f5f38274470f94b321c405345be5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.708860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab34962cdf54e668039b39b6d7fbd15', 'request_id': 'req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.718114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab34962cdf54e668039b39b6d7fbd15', 'request_id': 'req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.804459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e8f5f38274470f94b321c405345be5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.819984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e8f5f38274470f94b321c405345be5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.829298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e8f5f38274470f94b321c405345be5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.831227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f8f8fee3-ef0a-487d-9b18-d1947c86d484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e8f5f38274470f94b321c405345be5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.837667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2816/5598] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:57 2022] DELETE /identity/v3/users/74e8f5f38274470f94b321c405345be5 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:57.839079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:57.843271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:57.843271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:57.843271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:57.881479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:57.882943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:57.901036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab34962cdf54e668039b39b6d7fbd15', 'request_id': 'req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.918820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] The token cache is being invalidate because project 6ab34962cdf54e668039b39b6d7fbd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:57.921012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.923322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:57.936896 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2783/5599] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:57 2022] DELETE /identity/v3/projects/6ab34962cdf54e668039b39b6d7fbd15 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:57.937127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:57.938536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.048764 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2817/5600] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:58.049969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:58.056108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.077079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14a8c8-97ba-45be-bc22-19fd0efae199 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:58.084876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:58.085923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.086930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.087395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] PATH_INFO: `/v3/users/f18eb0f70cac4014a6c593989da99e45` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.088918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18eb0f70cac4014a6c593989da99e45)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:58.092243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:58.143842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab765b-4c9b-4ef8-bd65-2824c230cc73 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:58.339737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8621705d94aa49b190f06a486a9a1187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:58.340426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.340686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.340966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.341619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:58.343841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-6fc7faf9-9bb0-4c1f-9efa-d14c9df76a38 tempest-UsersNegativeTest-1510143677 tempest-UsersNegativeTest-1510143677-project-admin] Could not find domain: 82cd6855dfe144be942f157fde416b56.: keystone.exception.DomainNotFound: Could not find domain: 82cd6855dfe144be942f157fde416b56. Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 82cd6855dfe144be942f157fde416b56. Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:50:58.379617 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:50:58.380939 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:50:58.382146 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:50:58.383371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:50:58.383371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:50:58.383371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 82cd6855dfe144be942f157fde416b56. Nov 02 12:50:58.383371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:50:58.387497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2784/5601] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:50:57 2022] POST /identity/v3/users => generated 112 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:50:58.389865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.393486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.393983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.405867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18eb0f70cac4014a6c593989da99e45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:58.435234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:58.436897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.459500 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2785/5602] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:58.465426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:58.473398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.592850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18eb0f70cac4014a6c593989da99e45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:58.613139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18eb0f70cac4014a6c593989da99e45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:58.621120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f11f98-7e24-4a34-947c-4e3350922d9b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:58.625800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:58.627148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.627753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.628100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.628645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18eb0f70cac4014a6c593989da99e45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:58.630741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18eb0f70cac4014a6c593989da99e45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:58.639351 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2818/5603] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:58 2022] DELETE /identity/v3/users/f18eb0f70cac4014a6c593989da99e45 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:58.640692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:58.641427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:58.643633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.644205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6769b4c-7181-42b7-9196-7f2aca584cc0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:58.663097 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2786/5604] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:58.664543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.664881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.665160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.693439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:58.694969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.805340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782a221-8db5-4814-a256-29e74ffb442c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:58.807920 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2787/5605] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:58.808771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:58.810918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:58.815577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:58.816516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.817143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.817815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] PATH_INFO: `/v3/users/89cc13d2bbf8473fbae734ca05aa3e48` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.819600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89cc13d2bbf8473fbae734ca05aa3e48)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:58.823218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:58.824619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc852d2-63b8-4813-9221-ab8f27384c7a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:58.831806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:58.832566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:58.832855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:58.833195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] PATH_INFO: `/v3/projects/856418ccb26345ca891f6f02e09a2e4c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:58.835079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856418ccb26345ca891f6f02e09a2e4c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:58.837770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:59.082068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89cc13d2bbf8473fbae734ca05aa3e48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.089588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856418ccb26345ca891f6f02e09a2e4c', 'request_id': 'req-fdff3c29-44ec-4540-acda-0a0fa4d65c44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.124010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856418ccb26345ca891f6f02e09a2e4c', 'request_id': 'req-fdff3c29-44ec-4540-acda-0a0fa4d65c44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.221981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89cc13d2bbf8473fbae734ca05aa3e48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.247122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89cc13d2bbf8473fbae734ca05aa3e48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.258439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89cc13d2bbf8473fbae734ca05aa3e48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.259329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cc2fe4f-6a1f-4fd4-9f1f-b2177fad9913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89cc13d2bbf8473fbae734ca05aa3e48'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.271204 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2819/5606] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:50:58 2022] DELETE /identity/v3/users/89cc13d2bbf8473fbae734ca05aa3e48 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:59.273092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d85e-6ba5-498b-8789-f7d839d9ffe2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.273563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d85e-6ba5-498b-8789-f7d839d9ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.274049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2d85e-6ba5-498b-8789-f7d839d9ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.302891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-29f2d85e-6ba5-498b-8789-f7d839d9ffe2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:59.304800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-29f2d85e-6ba5-498b-8789-f7d839d9ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.341024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856418ccb26345ca891f6f02e09a2e4c', 'request_id': 'req-fdff3c29-44ec-4540-acda-0a0fa4d65c44'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.367557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] The token cache is being invalidate because project 856418ccb26345ca891f6f02e09a2e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:50:59.367869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.368530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:50:59.370690 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2788/5607] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:58 2022] DELETE /identity/v3/projects/856418ccb26345ca891f6f02e09a2e4c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:50:59.371593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:59.378615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.388661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:59.455358 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2820/5608] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:59.462344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886e22-23b6-45ac-888a-3579e976a66e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.462947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886e22-23b6-45ac-888a-3579e976a66e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.463628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886e22-23b6-45ac-888a-3579e976a66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.525576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f5886e22-23b6-45ac-888a-3579e976a66e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:59.527404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5886e22-23b6-45ac-888a-3579e976a66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.547919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff3c29-44ec-4540-acda-0a0fa4d65c44 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:59.548060 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2821/5609] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:59.550791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.551243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.551586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.584218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:59.584218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.584218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.584218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.586193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:50:59.586193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:59.586193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:59.586602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:50:59.586602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.602970 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2789/5610] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:50:59.603964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:59.606730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.619844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2822/5611] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:50:59.620979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:59.622563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:50:59.637468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd36327-5398-4120-929a-5a8708b36d45 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:59.643701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:59.645043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.645043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.645353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] PATH_INFO: `/v3/projects/c62bde6eb894462e94c607407632084e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.646826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62bde6eb894462e94c607407632084e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:59.649523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:59.806831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b7d8-fa3d-4d78-afd1-367d4da831d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:59.818971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:59.819628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.819911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.820311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.846628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:59.849182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:59.891344 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2790/5612] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:59.895273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:50:59.922511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61f91e-5929-4c9f-9695-1d5bc2e15667 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:50:59.936116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:50:59.936925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:50:59.937057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:50:59.937319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:50:59.958600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:50:59.960199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:50:59.985290 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2791/5613] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:50:59.986559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:00.011913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b71435-a52c-4b27-a614-5ce33fde3e56 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:00.021340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:00.022270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:00.022723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:00.023169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:00.025364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:00.030646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42a554-e99b-4d7e-9505-dbcb0af28fd7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:00.328565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62bde6eb894462e94c607407632084e', 'request_id': 'req-848f6372-9b29-4c30-9636-d5a6e8553052'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:00.339292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62bde6eb894462e94c607407632084e', 'request_id': 'req-848f6372-9b29-4c30-9636-d5a6e8553052'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:00.357616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62bde6eb894462e94c607407632084e', 'request_id': 'req-848f6372-9b29-4c30-9636-d5a6e8553052'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:00.387177 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2792/5614] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:50:59 2022] POST /identity/v3/projects => generated 375 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:00.388814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:00.389196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:00.389563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:00.450164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:00.452369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:00.541035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] The token cache is being invalidate because project c62bde6eb894462e94c607407632084e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:00.541332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:00.543318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:00.546932 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2823/5615] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:50:59 2022] DELETE /identity/v3/projects/c62bde6eb894462e94c607407632084e => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:00.553341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:00.560815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:00.664527 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2793/5616] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:00.664527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:00.665498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:00.737137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16432299-9b72-4703-ad9b-9bea8aeaf11a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:00.751408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:00.752814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:00.753318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:00.753878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] PATH_INFO: `/v3/projects/981eea58b84f4861954ae9ba98f4f3ef` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:00.757747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=981eea58b84f4861954ae9ba98f4f3ef)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:00.766257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:00.794984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f6372-9b29-4c30-9636-d5a6e8553052 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:00.814606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:00.816514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:00.818801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:00.819090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:00.819824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:00.826645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2315-5769-4961-a9aa-92db533bcf2a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:00.941200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:00.967636 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2824/5617] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:00 2022] POST /identity/v3/users => generated 288 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:00.974676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:00.974970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:00.975357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.012188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981eea58b84f4861954ae9ba98f4f3ef', 'request_id': 'req-94619c3c-93d4-48e0-8871-5f36ac2f4708'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.019105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:01.020546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.028391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981eea58b84f4861954ae9ba98f4f3ef', 'request_id': 'req-94619c3c-93d4-48e0-8871-5f36ac2f4708'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.101212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981eea58b84f4861954ae9ba98f4f3ef', 'request_id': 'req-94619c3c-93d4-48e0-8871-5f36ac2f4708'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.120910 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2825/5618] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:01.122323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.137109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] The token cache is being invalidate because project 981eea58b84f4861954ae9ba98f4f3ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:01.137608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.142605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.152382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2794/5619] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:00 2022] DELETE /identity/v3/projects/981eea58b84f4861954ae9ba98f4f3ef => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:01.154630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.157772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.190994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f8827-2c28-4808-b257-de71d43bdade None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.205744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94619c3c-93d4-48e0-8871-5f36ac2f4708 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.207470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.208195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.208552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.208835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.209547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:01.209849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.215099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0b7d9-c947-46da-9a44-272ccbb25a8b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.222786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.225452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.225452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.226465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.229021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.233227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113e9c9-819b-4dc1-816c-31d550b6cbc7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.258484 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2826/5620] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:01.261106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.262540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.263607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.268894 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2795/5621] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:01.272714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.274087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.274798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.303734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:01.305799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.317239 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2827/5622] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:01.318490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.321462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.339739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1022ce34-3875-4c85-9e08-a85a29d1d931 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.347629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.349279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.349668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.350036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.350843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.358174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.369195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:01.383347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.417910 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2796/5623] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:01.423894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.456287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f0e8f-6cab-4f2d-a48a-934dd7acb4b0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.467032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.468115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.468741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.469242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.470918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.475491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.482654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2828/5624] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:01 2022] POST /identity/v3/projects => generated 389 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:01.484383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.486972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.533114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2797/5625] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:01.538094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.560981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aa70b-096c-4345-be78-c8993279ed40 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.615694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffdd7-e0f6-4538-b280-6ad3e39f98b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.627007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.630621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.631530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.632302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] PATH_INFO: `/v3/projects/60997a8fc8964176b4f4b0560abc8240` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.637735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60997a8fc8964176b4f4b0560abc8240)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.643325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.700911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:01.700911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.702049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.702357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.703095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:01.703408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:01.706629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4df0d2-515d-43e3-8c53-f0077713d06d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:01.722901 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2798/5626] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:01.725100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e265-f615-494b-af8c-5912050a110d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:01.725567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e265-f615-494b-af8c-5912050a110d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:01.725748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463e265-f615-494b-af8c-5912050a110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:01.820397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f463e265-f615-494b-af8c-5912050a110d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:01.825439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f463e265-f615-494b-af8c-5912050a110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:01.845801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2799/5627] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:01.846900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e265-f615-494b-af8c-5912050a110d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:01.874726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463e265-f615-494b-af8c-5912050a110d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:01.875982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60997a8fc8964176b4f4b0560abc8240', 'request_id': 'req-a3a137ed-22ab-4924-9434-7870f3058213'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.886006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60997a8fc8964176b4f4b0560abc8240', 'request_id': 'req-a3a137ed-22ab-4924-9434-7870f3058213'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:01.896521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60997a8fc8964176b4f4b0560abc8240', 'request_id': 'req-a3a137ed-22ab-4924-9434-7870f3058213'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:02.028260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] The token cache is being invalidate because project 60997a8fc8964176b4f4b0560abc8240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:02.028709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:02.030494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:02.037554 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2829/5628] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:01 2022] DELETE /identity/v3/projects/60997a8fc8964176b4f4b0560abc8240 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:02.038488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.044429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:02.093822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.096106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.097759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.098154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.100832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.112428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.248528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2800/5629] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:01 2022] POST /identity/v3/users => generated 295 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:02.249451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.254157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:02.268368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a137ed-22ab-4924-9434-7870f3058213 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.300475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.302446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.303968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c317255-aac6-4c34-bc83-4dcf30db57c1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.304338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.306193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] PATH_INFO: `/v3/projects/9bf31e1333ca44a4bc1431869095a4f2/users/b1651d95be0548fda99fd1defc5efe5b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.347492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.349756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.350164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.354133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.357294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.362278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.392416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf31e1333ca44a4bc1431869095a4f2, user_id=b1651d95be0548fda99fd1defc5efe5b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.396401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.525800 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2801/5630] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:02 2022] POST /identity/v3/projects => generated 391 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:02.527415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.531864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:02.552937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2830/5631] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:02 2022] PUT /identity/v3/projects/9bf31e1333ca44a4bc1431869095a4f2/users/b1651d95be0548fda99fd1defc5efe5b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:02.556405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.562518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:02.702926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b592218-b1e8-4de8-87ea-a3f381df4258 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.746993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f3822-b908-4a10-9497-9293e839b36e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.785200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:02.793288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.794316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.794783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.795255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.803000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:02.804598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.815305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.852465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2802/5632] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:02.857295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.859690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:02.874936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.876202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.878489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.882945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] PATH_INFO: `/v3/users/8621705d94aa49b190f06a486a9a1187` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.882945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] RBAC: Authorizing `identity:delete_user(user_id=8621705d94aa49b190f06a486a9a1187)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.885245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1799fd-79b9-4ffc-9f66-b91f38522e40 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.887295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.898093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.899032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.899629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.900896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.902021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.905409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:02.929122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2803/5633] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:02.933209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:02.951711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c474d-0275-4747-aacb-ede26373b28c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:02.965146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:02.969244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:02.969244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:02.969244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:02.969244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:02.970882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522a4c3-09f6-4111-8540-f812e7624693 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:03.142826 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2804/5634] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:02 2022] POST /identity/v3/users => generated 296 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:03.148737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:03.148737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:03.148737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:03.224629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8621705d94aa49b190f06a486a9a1187'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:03.229038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] MFA Rules not processed for user `b1651d95be0548fda99fd1defc5efe5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:03.231563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:03.321196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8621705d94aa49b190f06a486a9a1187'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:03.365863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8621705d94aa49b190f06a486a9a1187'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:03.425150 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2805/5635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:03.425150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:03.432886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:03.436153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8621705d94aa49b190f06a486a9a1187'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:03.444196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8621705d94aa49b190f06a486a9a1187'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:03.451657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4139a3-97f6-4ea8-9a51-4193983a3e42 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:03.461055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:03.464235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:03.464235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:03.464235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:03.464847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:03.467285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:03.498586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2831/5636] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:02 2022] DELETE /identity/v3/users/8621705d94aa49b190f06a486a9a1187 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:03.499744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:03.502700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:03.632177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e01a27-5f14-421d-9ef3-72ea245218af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:03.638210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:03.638891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:03.639993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:03.640474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:03.651533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:03.652339 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2806/5637] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:03 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:03.652339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:03.652904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:03.659478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:03.669798 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2832/5638] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:03.669798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:03.672252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:03.855919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e98931-1b3c-4f1b-a1b7-e5cef903678e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:03.870443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:03.871273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:03.871727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:03.873568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:03.874336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:03.876045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:03.910378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2807/5639] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:03.910378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:03.926155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:03.959088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2fc5e6-ec70-4601-acef-499b7ef2a6db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:03.969297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:03.970038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:03.970431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:03.970707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:03.971372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:03.973503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d761f-c347-4cdb-aa19-8725d2ab2545 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:03.983454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.169738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2808/5640] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:03 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:04.171149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.185722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518253-9df3-43f6-9c20-1c849200ffa4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:04.191552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.192245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.192669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.192958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] PATH_INFO: `/v3/projects/de7913a0ade441f797ed5d91fc6b6257/users/c94845bcdb1140f4b4841b1bf916d059/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.219238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7913a0ade441f797ed5d91fc6b6257, user_id=c94845bcdb1140f4b4841b1bf916d059, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.223231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.269019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.269887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.270169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.273318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.276342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:04.322204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2809/5641] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:04 2022] PUT /identity/v3/projects/de7913a0ade441f797ed5d91fc6b6257/users/c94845bcdb1140f4b4841b1bf916d059/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:04.323612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.492609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:04.542131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.546276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.573920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2833/5642] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 906 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:04.576761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.599801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b185e-93ea-4780-a151-2b4de94e4190 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:04.614124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a671da0-38ac-4165-92a2-8f97b8971eaf service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:04.615836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.616472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.616827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.617099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.617798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.630783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146a975-afe2-4df9-ba3a-69923a631003 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.632110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.633617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.633859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.634124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.634801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.638518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.687184 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2810/5643] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:04.692572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.695548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.696370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.725005 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2834/5644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:04.727024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.760358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe25f8-3ae0-4686-b5b2-9f1025b36f65 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:04.777306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.777687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.777973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.778254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] PATH_INFO: `/v3/projects/cd1a4e5e7a5146d6b399ff29e576aa2f/users/a6a921c5f0ba4aa696c2171b2906a91b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.803189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:04.810118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:04.816134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd1a4e5e7a5146d6b399ff29e576aa2f, user_id=a6a921c5f0ba4aa696c2171b2906a91b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.825082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.856818 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2811/5645] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:04.856818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.859469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72630331-522e-4f34-a803-11f2e5c9caa4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:04.882360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:04.883322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.883322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.883766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:04.884450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:04.888160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3eb61e-d472-4bbe-9824-37c8f1db97ee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:04.929379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2835/5646] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:04 2022] PUT /identity/v3/projects/cd1a4e5e7a5146d6b399ff29e576aa2f/users/a6a921c5f0ba4aa696c2171b2906a91b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:04.930767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:04.943444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:04.956371 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2812/5647] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:04.968903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:04.969426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:04.969935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:05.103428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd801f-2c15-4310-8faf-d03b03f9a53a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:05.143132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:05.143132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] MFA Rules not processed for user `a6a921c5f0ba4aa696c2171b2906a91b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:05.143132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:05.155527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:05.155527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:05.155527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:05.155527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:05.208781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:05.295193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:05.298700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:05.334490 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2836/5648] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:05.334490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:05.363603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba85c-d370-4dd6-a60a-d66a43c01c08 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:05.375047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:05.375976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:05.376600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:05.376985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] PATH_INFO: `/v3/projects/7e8f0f160b634aeebb04fc7f66a15f23/users/17e27dd146f145d9a51697a0453f7664/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:05.418682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8f0f160b634aeebb04fc7f66a15f23, user_id=17e27dd146f145d9a51697a0453f7664, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:05.422698 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2813/5649] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:05.431243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:05.433205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:05.436659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:05.476564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ef155-8390-4385-b687-22b01c9f2f88 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:05.553137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:05.555554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:05.556120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:05.556672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] PATH_INFO: `/v3/users/b1651d95be0548fda99fd1defc5efe5b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:05.565046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1651d95be0548fda99fd1defc5efe5b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:05.582539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:05.606115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2837/5650] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:05 2022] PUT /identity/v3/projects/7e8f0f160b634aeebb04fc7f66a15f23/users/17e27dd146f145d9a51697a0453f7664/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:05.606115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:05.883437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627192f-6d18-41ed-858d-3b79f5ec5701 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:05.917170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:05.919038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:05.921539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1651d95be0548fda99fd1defc5efe5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:05.922098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:05.928934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:05.930131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:05.931516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3069976-b2a8-41a5-b8f1-f3798215a200 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:06.078355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1651d95be0548fda99fd1defc5efe5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.102596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1651d95be0548fda99fd1defc5efe5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.104771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1651d95be0548fda99fd1defc5efe5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.107016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-354171f6-0865-42c1-8714-7feb6efcdd8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1651d95be0548fda99fd1defc5efe5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.148973 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2814/5651] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:05 2022] DELETE /identity/v3/users/b1651d95be0548fda99fd1defc5efe5b => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:06.151423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.152065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.153590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.207390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] MFA Rules not processed for user `17e27dd146f145d9a51697a0453f7664`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:06.209596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.268194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2838/5652] 10.222.0.64 () {60 vars in 1314 bytes} [Wed Nov 2 12:51:05 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 786 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:06.288474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.288474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.288474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.314255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:06.318270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.333411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2815/5653] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:06.333751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:06.340927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.467938 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2839/5654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:06.473251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:06.475332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.513672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e41183c-be20-4d95-a107-1ba9360b9dc2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:06.526567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:06.527861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.528131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.528415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/b189aa5bbf184d5a9f979a15578033c5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.549814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:get_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=b189aa5bbf184d5a9f979a15578033c5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:06.551912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:06.555866 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2816/5655] 10.222.0.64 () {58 vars in 1392 bytes} [Wed Nov 2 12:51:06 2022] GET /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/b189aa5bbf184d5a9f979a15578033c5 => generated 686 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:06.560368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:06.562391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.593551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d797e4d-41b0-4144-a03c-668f9f79a5ef tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:06.606407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:06.613781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.613781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.613781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] PATH_INFO: `/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.617893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3b0db7bfbc47dd8e2b76bd52e8c8b3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:06.623082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:06.627905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041fe504-511f-4b3f-9306-ab520de4caff None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:06.637323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:06.638023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.638242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.638514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.658814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:06.661641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:06.663132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:06.684703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2840/5656] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:06.685581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:06.705631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d091f7-0981-4806-9060-48e4151d95c1 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:06.715741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:06.716719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.717213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.719240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.741724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:06.745922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca1874-3739-4a0f-8232-27e2abc124b8 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:06.772746 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2841/5657] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:06.774593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:06.779240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:06.779526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:06.799738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] MFA Rules not processed for user `a6a921c5f0ba4aa696c2171b2906a91b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:06.801324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:06.850681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'request_id': 'req-45370c24-67cc-4f12-83b8-4b73d509e138'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.866023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'request_id': 'req-45370c24-67cc-4f12-83b8-4b73d509e138'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:06.991957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3b0db7bfbc47dd8e2b76bd52e8c8b3', 'request_id': 'req-45370c24-67cc-4f12-83b8-4b73d509e138'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:07.005350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] The token cache is being invalidate because project db3b0db7bfbc47dd8e2b76bd52e8c8b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:07.005715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:07.006624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-45370c24-67cc-4f12-83b8-4b73d509e138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:07.010811 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2842/5658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:06 2022] POST /identity/v3/auth/tokens => generated 3422 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Nov 02 12:51:07.011522 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2817/5659] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:06 2022] DELETE /identity/v3/projects/db3b0db7bfbc47dd8e2b76bd52e8c8b3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:07.015305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.023276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87066-fb10-468e-aa65-4b222735a12d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.023626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87066-fb10-468e-aa65-4b222735a12d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.024726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f87066-fb10-468e-aa65-4b222735a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.058092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f4f87066-fb10-468e-aa65-4b222735a12d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:07.059508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4f87066-fb10-468e-aa65-4b222735a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:07.097153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cdc70-03f2-4842-887a-0b39867a32ed None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.103128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.103797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.104076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.104353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/b189aa5bbf184d5a9f979a15578033c5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.105631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=b189aa5bbf184d5a9f979a15578033c5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:07.108833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:07.134619 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2818/5660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:07.143481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.143735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.144080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.168443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:07.170105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:07.186898 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2819/5661] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:07.188224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.200977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a3c20-e15d-4143-ab92-c1f521811929 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.206797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.208000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.208000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.208220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.208889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:07.209199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:07.211794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:07.249996 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2820/5662] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:07.255074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.303752 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2843/5663] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:07 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/b189aa5bbf184d5a9f979a15578033c5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:07.304205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa4a6-d4bd-4f34-8a28-8f967cd59ca5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.312198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.313271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.315939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.317468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:07.317798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.320163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.322910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:07.343513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:07.357795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447eaac-c517-4aad-becc-6bd16cb7c2fa tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.370344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.371161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.371939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.373809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.377712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:07.389525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:07.573777 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2821/5664] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:07 2022] POST /identity/v3/projects => generated 373 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:07.577813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.711620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17e86d-94a8-4bf7-84c9-1fe83f732ea9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.719002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:07.725486 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2844/5665] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:51:07 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 921 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:07.731071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.742693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.743491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.744347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.744743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:07.747391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:07.757829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:07.766495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b3a2-80cc-4482-90eb-b8ac2c6ece3c tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:07.954675 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2822/5666] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:07 2022] POST /identity/v3/users => generated 287 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:07.961803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:07.964025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:07.964889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:07.966063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:07.966422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/57ee9acfacab44ae92275c67ba0bae9d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.004787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81d878-2a22-47ac-a6a1-e0cc0e4e71a1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.029079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.029913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.030179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.030591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.030787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=57ee9acfacab44ae92275c67ba0bae9d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.031254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.033130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.038847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.078264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2823/5667] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:08.083056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:08.101409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656e83-026b-4783-9f52-06c936d89aab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.121622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.122562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.122913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.123253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.124016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.129420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.199866 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2824/5668] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:08.201137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:08.215092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdbcb-1bc3-41cc-83ce-721bb5ef0d10 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.229141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.229841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.230386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.230915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] PATH_INFO: `/v3/projects/fe0ce10fc0554879bfdc2551cc865776/users/2f36caa4faec473a8d756983d5e6bb3f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.257902 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2845/5669] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:07 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/57ee9acfacab44ae92275c67ba0bae9d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:08.259005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:08.298138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0ce10fc0554879bfdc2551cc865776, user_id=2f36caa4faec473a8d756983d5e6bb3f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.301579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56c1b2-ebe8-4f26-8e6c-86fcff1af27a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.322197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c298a7-5ec3-4110-9077-6c44e90e61d5 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.333910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.334618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.334902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.335340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.336052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.337244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.439610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2825/5670] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:08 2022] PUT /identity/v3/projects/fe0ce10fc0554879bfdc2551cc865776/users/2f36caa4faec473a8d756983d5e6bb3f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:08.445620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.445901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.446178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.561554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] MFA Rules not processed for user `2f36caa4faec473a8d756983d5e6bb3f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:08.563128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:08.737437 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2846/5671] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Nov 2 12:51:08 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 813 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:08.742436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:08.749305 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2826/5672] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:08.768547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:08.770133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:08.778807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83004a-35e4-4aaf-81b5-c233a187eec4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.955873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.957034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.957565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.958383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/f5d0bd544c9f417aba374339dfff2af6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.977610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b49fe1-a9b9-410b-8ea5-0a3288e167af None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:08.981805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=f5d0bd544c9f417aba374339dfff2af6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:08.983385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:08.984292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:08.985643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:08.986805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:08.987322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:08.993849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:09.002147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:09.002895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:09.015300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2827/5673] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:09.048020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:09.050428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:09.095808 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2847/5674] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:08 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/f5d0bd544c9f417aba374339dfff2af6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:09.098464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:09.123219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e9ba1-932f-4d55-80ce-aaa50b5e0f84 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:09.160034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:09.162232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:09.166257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:09.166879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:09.168990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:09.170559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:09.236899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabaed4-40e6-4bad-beed-f21f78d362b6 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:09.247986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:09.249029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:09.249412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:09.249788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] PATH_INFO: `/v3/projects/9bf31e1333ca44a4bc1431869095a4f2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:09.251696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf31e1333ca44a4bc1431869095a4f2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:09.255033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:09.476824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2848/5675] 10.222.0.64 () {60 vars in 1314 bytes} [Wed Nov 2 12:51:09 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 788 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:09.504119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:09.512166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf31e1333ca44a4bc1431869095a4f2', 'request_id': 'req-b5607140-3678-46df-8dbe-83a0d9352389'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:09.537148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf31e1333ca44a4bc1431869095a4f2', 'request_id': 'req-b5607140-3678-46df-8dbe-83a0d9352389'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:09.555948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838311cf-ffc8-4ec5-8828-7a51ebaef884 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:09.664389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:09.665204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:09.665564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:09.665858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:09.666533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:09.667792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:09.794509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf31e1333ca44a4bc1431869095a4f2', 'request_id': 'req-b5607140-3678-46df-8dbe-83a0d9352389'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:09.837558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] The token cache is being invalidate because project 9bf31e1333ca44a4bc1431869095a4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:09.837860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:09.838788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b5607140-3678-46df-8dbe-83a0d9352389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:09.841840 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2828/5676] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:09 2022] DELETE /identity/v3/projects/9bf31e1333ca44a4bc1431869095a4f2 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:09.851008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53faa-89f6-4e90-9b50-90d4488d53ac None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:09.851875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53faa-89f6-4e90-9b50-90d4488d53ac None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:09.853841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a53faa-89f6-4e90-9b50-90d4488d53ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:09.874600 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2849/5677] 10.222.0.64 () {60 vars in 1314 bytes} [Wed Nov 2 12:51:09 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 788 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:09.881739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:09.885486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:09.918933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103ffb2-fb5b-499e-af0d-81ff43575489 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:09.932796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-07a53faa-89f6-4e90-9b50-90d4488d53ac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:09.934232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-07a53faa-89f6-4e90-9b50-90d4488d53ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:09.941447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:09.942139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:09.942422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:09.942699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:09.943330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:09.945427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:09.986352 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2850/5678] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:51:09 2022] GET /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 1500 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:09.987572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.004504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f886be3-9502-4fed-9220-d6ce71679d38 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.018771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.019617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.020031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.020432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/55a05421022c4460b4539099496aa397` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.033339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=55a05421022c4460b4539099496aa397)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.034990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.104027 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2829/5679] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:10.105868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.106158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.112632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.143669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:10.148331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:10.155363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2851/5680] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:09 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/55a05421022c4460b4539099496aa397 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:10.163672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.174644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2830/5681] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:10.176034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.192606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35694800-d180-4a68-9191-1c9f89d46a2d tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.194460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095ad33-c054-41c3-bd7b-89e96bb036e5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.210195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.211246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.212644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.213029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.219672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:10.219846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.219846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.219846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.220199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/6704f4de460a4fd4bf208ea429036e7f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.220901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.220901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.254273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=6704f4de460a4fd4bf208ea429036e7f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.260335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.265755 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2831/5682] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:10.271037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.283043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1facb-b0e8-4e9b-abcf-139273098a1c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.290052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.290744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.290948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.291311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.292040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.310797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.435082 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2852/5683] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:10 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/6704f4de460a4fd4bf208ea429036e7f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:10.441890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.457476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc907-ae92-4143-ab3c-5996e9c698c0 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.465812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.467310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.467827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.468389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.469592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.471907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.500028 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2832/5684] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:10 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:10.505164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.679837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c5ef-7a4e-4492-9245-4d93c0495ddc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.696298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.697007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.697288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.697561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.698208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.705937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.787503 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2853/5685] 10.222.0.64 () {60 vars in 1314 bytes} [Wed Nov 2 12:51:10 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 788 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:10.788400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.820599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8986d32-f09d-4588-8d18-2d959e1b6051 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.907423 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2833/5686] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:10 2022] POST /identity/v3/users => generated 296 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:10.913176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:10.934951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e62b7-275c-48b3-b127-8c82013595bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:10.941608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.944560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.945124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.945722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.946596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:create_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.948802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:10.949514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.949789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:10.952725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:10.956134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:10.958392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:10.968415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:10.986696 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2834/5687] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:51:10.992285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.020397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6c42-b90c-404f-9a66-639040192dfc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.040385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.045890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.047257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.051868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.077945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.085423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.128241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2835/5688] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:11.130507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.151140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027012b-4d02-4f0c-8f84-eca009014d70 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.162539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.163498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.163940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.164834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] PATH_INFO: `/v3/projects/ba873d10eb3d4d0d9cd9703d8b0e78b2/users/ad4e839c4cee4d128122ce364467c4a2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.189604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba873d10eb3d4d0d9cd9703d8b0e78b2, user_id=ad4e839c4cee4d128122ce364467c4a2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.193627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272adf6-0f0b-4661-916e-672d1c36bcb8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.271136 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2854/5689] 10.222.0.64 () {60 vars in 1314 bytes} [Wed Nov 2 12:51:10 2022] POST /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials => generated 789 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:11.275784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.295262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc6cd-51f9-4e9a-9299-b1444a10a7ae tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.318335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.319077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.319616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.320061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.320768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Adding query filter params (name=tempest-application_credential-1093278672) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:11.321298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:list_application_credentials(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.323287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.354304 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2855/5690] 10.222.0.64 () {58 vars in 1386 bytes} [Wed Nov 2 12:51:11 2022] GET /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials?name=tempest-application_credential-1093278672 => generated 887 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:11.367871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.375003 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2836/5691] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:11 2022] PUT /identity/v3/projects/ba873d10eb3d4d0d9cd9703d8b0e78b2/users/ad4e839c4cee4d128122ce364467c4a2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:11.396085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.396794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.397276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.397596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1e4cb-40f0-40e4-ac7d-024efb562a7f tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.495872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] MFA Rules not processed for user `ad4e839c4cee4d128122ce364467c4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:11.497351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:11.590049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.590769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.591058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.591346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/9cb1541add5d4adc98f42891f6b639ef` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.603023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=9cb1541add5d4adc98f42891f6b639ef)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.606990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.632475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:11.712632 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2856/5692] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:11 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/9cb1541add5d4adc98f42891f6b639ef => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:11.715630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.742029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2837/5693] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:11.744885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.771718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fcd29-0f0d-4abc-aa65-550fd7ee8761 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.788889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6a921c5f0ba4aa696c2171b2906a91b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.792874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.793339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.793635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/d53ce89661174aa8aacdc33a5005e0e8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.839232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorizing `identity:delete_application_credential(user_id=a6a921c5f0ba4aa696c2171b2906a91b, application_credential_id=d53ce89661174aa8aacdc33a5005e0e8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.841613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.951845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b0fba-573f-4d1a-b8eb-59491b0bfa23 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:11.963031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:11.973210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:11.973210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:11.973210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:11.973210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:11.973644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2857/5694] 10.222.0.64 () {58 vars in 1395 bytes} [Wed Nov 2 12:51:11 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b/application_credentials/d53ce89661174aa8aacdc33a5005e0e8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:11.973644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:11.974159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:11.979332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:12.024879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d481a-f9f4-4511-ae40-95b2804777d4 tempest-ApplicationCredentialsV3Test-229627839 tempest-ApplicationCredentialsV3Test-229627839-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:12.039648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:12.042084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:12.044800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:12.045101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] PATH_INFO: `/v3/users/2f36caa4faec473a8d756983d5e6bb3f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:12.046991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f36caa4faec473a8d756983d5e6bb3f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:12.054539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:12.081482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:12.141046 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2838/5695] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:11 2022] POST /identity/v3/projects => generated 389 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:12.143316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:12.147834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:12.307985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955c38-ebc9-416d-96c8-e3e9a1fbbde5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:12.328681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:12.330448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:12.331038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:12.331630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] PATH_INFO: `/v3/users/a6a921c5f0ba4aa696c2171b2906a91b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:12.333588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a921c5f0ba4aa696c2171b2906a91b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:12.337512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:12.388828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f36caa4faec473a8d756983d5e6bb3f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.535530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f36caa4faec473a8d756983d5e6bb3f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.562252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f36caa4faec473a8d756983d5e6bb3f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.599343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f36caa4faec473a8d756983d5e6bb3f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.600661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f36caa4faec473a8d756983d5e6bb3f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.620818 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2858/5696] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:11 2022] DELETE /identity/v3/users/2f36caa4faec473a8d756983d5e6bb3f => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:12.620818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:12.622013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:12.703778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a921c5f0ba4aa696c2171b2906a91b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.803658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a921c5f0ba4aa696c2171b2906a91b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.828913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5404cfa-fc2c-4cb8-9197-b766c63f6d3d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:12.844571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:12.850002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:12.850350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:12.850636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:12.858238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:12.889707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b20257-3c4a-48ed-ada2-9acbbec2fa24 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:12.941245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a921c5f0ba4aa696c2171b2906a91b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.942826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a921c5f0ba4aa696c2171b2906a91b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:12.944755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dabcdd17-4b43-4e23-aa4d-56a7c4e2e7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a921c5f0ba4aa696c2171b2906a91b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:13.000798 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2839/5697] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:12 2022] DELETE /identity/v3/users/a6a921c5f0ba4aa696c2171b2906a91b => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:13.004805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.009988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.010710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.054143 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2859/5698] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:12 2022] POST /identity/v3/users => generated 301 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:13.056800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.057260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.058803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.078578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:13.080731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:13.110421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:13.112585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:13.255095 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2840/5699] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:13.257779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.261087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:13.262179 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2860/5700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:13.296642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee91091-aa64-4095-9ac4-e53f30ae5abc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.311860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.313251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.316790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.317363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.320910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:13.323938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:13.331340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.332876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:13.370957 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2841/5701] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:13.372117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.409331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e8bf6-f759-4dd7-94e8-2d7ec48997c0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.426144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6570e-0f29-4e95-bd46-3a11e14f8108 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.428317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.429487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.429885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.430269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] PATH_INFO: `/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17/users/0747c4999adb4fb6b8738220e6a02803/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.434907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.435949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.436430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.436932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.453522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:13.469877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:13.472032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:13.488419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c440bb69b347ae8b3c2b68ee88ee17, user_id=0747c4999adb4fb6b8738220e6a02803, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:13.494161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:13.500789 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2861/5702] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:13.502494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.509604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:13.540375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0a1b7-b753-48ad-9024-0bef425f8b63 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.552955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.553585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.553860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.554131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.582195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:13.583917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:13.615292 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2862/5703] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:13.621396 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2842/5704] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:13 2022] PUT /identity/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17/users/0747c4999adb4fb6b8738220e6a02803/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:13.625865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.627794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:13.640948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a8c33-ca9b-44b4-b4c3-abea4b734dd7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.854911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.856236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.856236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.856236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.859104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:13.860820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30602dce-accc-4aee-bd7e-3799975cfe1a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:13.908864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:13.923627 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2863/5705] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:13.926160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1379ac0-261e-4907-a270-c51af2350b39 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:13.950586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:13.955628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:13.960167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:13.964231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] PATH_INFO: `/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17/users/0747c4999adb4fb6b8738220e6a02803/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:13.978088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c440bb69b347ae8b3c2b68ee88ee17, user_id=0747c4999adb4fb6b8738220e6a02803, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:14.001073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:14.052516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2843/5706] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:13 2022] PUT /identity/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17/users/0747c4999adb4fb6b8738220e6a02803/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:14.070625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:14.071884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:14.072328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:14.165790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] MFA Rules not processed for user `0747c4999adb4fb6b8738220e6a02803`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:14.168386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:14.244161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:14.371970 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2864/5707] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:14.374514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:14.399596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d3900-6b0c-46eb-a76f-0c37091c5027 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:14.412337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:14.413744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:14.414303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:14.414828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:14.416536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:14.418525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:14.619110 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2844/5708] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:14 2022] POST /identity/v3/domains => generated 276 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:14.623155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:14.638142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69898c-3d6b-4be8-8062-4fdaa8b04506 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:14.730137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:14.730905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:14.732005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:14.732293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:14.733092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:14.735028 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:14.735028 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:51:14.735028 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:51:14.736766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:14.872033 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2865/5709] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:51:14 2022] PUT /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config => generated 138 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:14.872172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:14.890222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f062-a365-444e-aa04-f6f62d3a3c49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:14.909566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:14.911283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:14.911674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:14.912061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:14.913537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26, group=identity)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:14.914790 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:14.914790 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:51:14.914790 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:51:14.916076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:14.943058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:14.943186 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2845/5710] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:51:14 2022] GET /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/identity => generated 45 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:14.953283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd253f8-370c-469a-aa68-d85de9af2482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:14.961563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:14.962260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:14.962540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:14.962886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/identity/driver` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:14.964433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26, group=identity, option=driver)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:14.965208 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:14.965208 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:51:14.965208 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:51:14.966826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:14.978564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2866/5711] 10.222.0.64 () {58 vars in 1296 bytes} [Wed Nov 2 12:51:14 2022] GET /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/identity/driver => generated 31 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:14.979204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:14.998823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a707bf-ee20-4368-aa51-f8fa8059950f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.007796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.010204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.010776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.011333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.015106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26, group=ldap)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.018795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.031705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2846/5712] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:51:14 2022] GET /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap => generated 106 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:15.034256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.059704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa1448-11c9-4e17-95ec-8fc752f0249b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.069259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.070320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.071415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.073927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap/url` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.078397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26, group=ldap, option=url)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.078681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.091942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.102017 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2867/5713] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:51:15 2022] GET /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap/url => generated 46 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:15.107932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9c716-8d41-4b5d-bffc-405391a173d0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.117085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.117997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.118399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.118747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap/user_tree_dn` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.121165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26, group=ldap, option=user_tree_dn)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.123489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.138316 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2847/5714] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Nov 2 12:51:15 2022] GET /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config/ldap/user_tree_dn => generated 63 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:15.140361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.156111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7bde-73b0-47db-a508-67b5103b8cf0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.163529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.164798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=668355ebdf0846d6a45d3286fe7cfd26)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:51:15.168459 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:51:15.169027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.314438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.314760 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2868/5715] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:15 2022] DELETE /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26/config => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:15.333308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7206e-c5cc-4f2d-870f-7694e7b4c68b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.345982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.346884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.347395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.347875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.356525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=668355ebdf0846d6a45d3286fe7cfd26)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.358487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.403848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:15.405466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:15.576740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:15.599976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:15.603040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:15.610336 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2848/5716] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:15 2022] PATCH /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26 => generated 277 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:15.617296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.621598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:15.652306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:15.654588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:15.684168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9672d27-6fda-4cd0-af88-3564ccd9ac4a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.924338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.925056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.925324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.925651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.955622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=668355ebdf0846d6a45d3286fe7cfd26)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.957483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:15.959143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:15.964214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ea939-a802-4fe3-9312-57b6e5d5bbb1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:15.974607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:15.975383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:15.975805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:15.976194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] PATH_INFO: `/v3/projects/cd1a4e5e7a5146d6b399ff29e576aa2f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:15.977751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd1a4e5e7a5146d6b399ff29e576aa2f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:15.980261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:16.048029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.065044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.190629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'request_id': 'req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.202192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'request_id': 'req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.276372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.289052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd1a4e5e7a5146d6b399ff29e576aa2f', 'request_id': 'req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.303263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.305824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] The token cache is being invalidate because project cd1a4e5e7a5146d6b399ff29e576aa2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:16.306249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.309757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9fcb13db-0858-4bb1-a43a-4386a3dcd9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.311811 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2849/5717] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:15 2022] DELETE /identity/v3/projects/cd1a4e5e7a5146d6b399ff29e576aa2f => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:16.319611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:16.320403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:16.320928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:16.321692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.376657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:16.380685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:16.513018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2850/5718] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:16.514427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:16.515958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:16.547378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db892c0d-f3a9-48ef-9abd-d08b3db4be97 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:16.557049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:16.557861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:16.558147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:16.559476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] PATH_INFO: `/v3/projects/fe0ce10fc0554879bfdc2551cc865776` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:16.561956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0ce10fc0554879bfdc2551cc865776)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:16.566627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:16.617885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] The token cache is being invalidate because project 668355ebdf0846d6a45d3286fe7cfd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:16.618989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.619786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.640092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.645307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.646958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b71a4392-77d5-4907-8f72-d249bd9e5883 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '668355ebdf0846d6a45d3286fe7cfd26', 'request_id': 'req-b71a4392-77d5-4907-8f72-d249bd9e5883'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.655958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2869/5719] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:15 2022] DELETE /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:16.657618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:16.661492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:16.663061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:16.703924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:16.706138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:16.724656 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2870/5720] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:16.725939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:16.728834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:16.750696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0ce10fc0554879bfdc2551cc865776', 'request_id': 'req-65c460d6-4705-4cc4-9637-a0b75be8fe62'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.771329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0ce10fc0554879bfdc2551cc865776', 'request_id': 'req-65c460d6-4705-4cc4-9637-a0b75be8fe62'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.842536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588809ed-9a04-423e-ace9-a6d3f55976a3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:16.907383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0ce10fc0554879bfdc2551cc865776', 'request_id': 'req-65c460d6-4705-4cc4-9637-a0b75be8fe62'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.925604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] The token cache is being invalidate because project fe0ce10fc0554879bfdc2551cc865776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:16.927668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.930613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:16.933313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2851/5721] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:16 2022] DELETE /identity/v3/projects/fe0ce10fc0554879bfdc2551cc865776 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:16.934973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:16.939692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:16.949254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:16.950144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:16.953203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:16.953203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:16.953203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:16.956261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7731fb4-a4f7-4d18-ae5f-5e551fb511a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:17.078220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c460d6-4705-4cc4-9637-a0b75be8fe62 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:17.089697 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2871/5722] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:16 2022] POST /identity/v3/domains => generated 277 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:17.097111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.097399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.097741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.098817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:17.099451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.099740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.100015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.100798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:17.101105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:17.103511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:17.121118 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2852/5723] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:17.122211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:17.126501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:17.153827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:17.155016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:17.160627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe671b6-7a34-49a8-91fe-e8b5ea86f581 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:17.292012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:17.292847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.295041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.296109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.300978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:17.302244 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:17.302244 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:51:17.302244 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:51:17.303593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965114e8-6b25-4a10-b417-de0025aae1d8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:17.319256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2872/5724] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:17.321346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:17.348632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c45f1d-8fea-4586-aed4-f7ab51a4983f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:17.363895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:17.364582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.364853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.365118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.365768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:17.368138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:17.519526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2853/5725] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:51:17 2022] PUT /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 138 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:17.521089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.521384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.521862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.605702 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2873/5726] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:17 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:17.611457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:17.649493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:17.651304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:17.859064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f260af-89f1-403d-9617-bf9bc929ee0e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:17.865482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:17.866352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.867101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.867494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.869167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:17.870644 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:17.870644 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:51:17.870644 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:51:17.874266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2854/5727] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:17.874369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:17.874459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:17.905075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c50f93-677e-4bc8-8b04-71ca4e2150e2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:17.914836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:17.915476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:17.915758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:17.916031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:17.916696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:17.918657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.069159 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2874/5728] 10.222.0.64 () {60 vars in 1271 bytes} [Wed Nov 2 12:51:17 2022] PATCH /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 142 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:18.073456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.099076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a36dec-f4c4-4d69-ba7d-e490e9f3a434 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.108466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.112637 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2855/5729] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:17 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:18.112637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.114799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.115614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.121322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.121322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:18.121322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.124144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.133860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96acc92-9bc7-4bb7-bf68-7213fe424df5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.149253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.149970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.150255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.150524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.154751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.157385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.158828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2875/5730] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:18.163460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.168647 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2856/5731] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:18 2022] GET /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 142 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:18.169629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.197795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1344c-109d-4180-92b0-dec7eb047167 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.200611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635962c-548f-41f8-81ab-f5f06cb4dc20 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.208650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.209236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.209563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.209732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.212443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.216858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.221282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.221613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.221807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.223699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.225970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.229398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.267441 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2876/5732] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:18.267441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.285498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5c6fc-f57e-4a64-ab85-6629b57bd9b9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.290180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.290967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.291455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.291914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.292782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.294455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.415181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2877/5733] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:18 2022] DELETE /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:18.416686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.419821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2857/5734] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:18 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:18.421033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.435939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317bc3-c649-4ab2-8f02-e905e1c3378b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.518306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fd849-9cbf-4214-be03-5fc0da606993 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.534050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.535802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.536733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.538138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.539757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.541309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.542090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.542460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.542830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] PATH_INFO: `/v3/projects/4eb742124f6b4987aab95d9b0d1247ee/users/56796e1dfe824579aec17291b492b360/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.543155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find any options in domain configuration for domain 414a226dadf247d391d54507945f0494.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 414a226dadf247d391d54507945f0494. Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Nov 02 12:51:18.558074 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 414a226dadf247d391d54507945f0494. Nov 02 12:51:18.559451 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:18.562493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb742124f6b4987aab95d9b0d1247ee, user_id=56796e1dfe824579aec17291b492b360, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.565923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.568276 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2858/5735] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:18 2022] GET /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 151 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:18.571737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.603299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42313e-1e50-4349-91c6-423dcedfa01c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.613508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.614203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.614526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.614997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.616015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.619492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.685130 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2878/5736] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:18 2022] PUT /identity/v3/projects/4eb742124f6b4987aab95d9b0d1247ee/users/56796e1dfe824579aec17291b492b360/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:18.686193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.790954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d12a5-ef06-46b9-99de-204617833586 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.799595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.800451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.800659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.800982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.801680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.804051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.816915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2879/5737] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:18 2022] DELETE /identity/v3/domains/414a226dadf247d391d54507945f0494/config => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:18.816915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.834186 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2859/5738] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:18 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:18.834186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:18.863241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bc8ce-4882-4a48-894c-73b5df107ff1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:18.874303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:18.874303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:18.874303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:18.874672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:18.876035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:18.880425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:18.918704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:18.921200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:18.966521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f03e-008a-4876-b49b-b34aa82140d2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.066053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.068203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.068203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.068203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.069617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.073474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.090436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.091619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.092218 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2880/5739] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:19.093457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.099083 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2860/5740] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:18 2022] PATCH /identity/v3/domains/414a226dadf247d391d54507945f0494 => generated 278 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:19.102351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.102351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:19.104176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:19.123234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c289f-7972-4b29-b319-6e9db49dfb5c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.130270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.131280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.131787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.132261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] PATH_INFO: `/v3/projects/4eb742124f6b4987aab95d9b0d1247ee/users/56796e1dfe824579aec17291b492b360/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.134621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb742124f6b4987aab95d9b0d1247ee, user_id=56796e1dfe824579aec17291b492b360, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.137643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48f72a-120f-4a48-a191-aba5b45f1c78 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.138621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.150264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.152797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.154012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.154472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.156863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.162495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7446ec-72e0-4c4e-86a5-bc2d079ae4ef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.162756 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2861/5741] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:19 2022] PUT /identity/v3/projects/4eb742124f6b4987aab95d9b0d1247ee/users/56796e1dfe824579aec17291b492b360/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:19.164166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.167145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:19.206388 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2881/5742] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:19.209642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.211996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.212361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.261493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] MFA Rules not processed for user `56796e1dfe824579aec17291b492b360`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:19.263457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:19.292518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b088191-e92e-431a-a2c8-366f4ffe6b81 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.315041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.315707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.316166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.316450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.340783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=414a226dadf247d391d54507945f0494)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.342318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.375204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.389831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '414a226dadf247d391d54507945f0494'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.396615 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2882/5743] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:19.398100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.455334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:19.494542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f4ea4-266a-4ff9-9263-950baa0c5e43 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.501327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.504286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.504286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.504871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.505819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.507808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.525780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2883/5744] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:19.528382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.550701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8164e96-10b7-46d5-9fcd-6493e4850376 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.567918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.569223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.569647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.572186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.573126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.580585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.608257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.621210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.706800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.731527 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2884/5745] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:19 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:19.731527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.731804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] The token cache is being invalidate because project 414a226dadf247d391d54507945f0494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:19.731804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.731804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.748832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.760331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.762541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '414a226dadf247d391d54507945f0494', 'request_id': 'req-eed996fa-aa64-46d4-a6ab-45c7040da8b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:19.776925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2862/5746] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:19 2022] DELETE /identity/v3/domains/414a226dadf247d391d54507945f0494 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:19.778152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:19.780132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:19.856222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b72dd-77ca-4858-a809-3a84539b8897 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.865376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.866446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.866822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.867191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] PATH_INFO: `/v3/projects/732af39b97fb45348fa7a4a934e442d8/users/54b1b32697f2498cad4c7319b6570f1e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.893654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732af39b97fb45348fa7a4a934e442d8, user_id=54b1b32697f2498cad4c7319b6570f1e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.896120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:19.904976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed996fa-aa64-46d4-a6ab-45c7040da8b6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:19.912973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:19.913727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:19.913989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:19.914393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:19.915268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:19.918056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a141acd-8648-4002-91e7-47ba9890e3db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.006870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2885/5747] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:19 2022] PUT /identity/v3/projects/732af39b97fb45348fa7a4a934e442d8/users/54b1b32697f2498cad4c7319b6570f1e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:20.007769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.009643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:20.080159 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2863/5748] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:19 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:20.082171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.082935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.084250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.127652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa286f-f82b-47f7-ac45-92729b04ab92 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.136392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.136981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.137471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.137884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.138711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.141281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.149633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:20.174561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] MFA Rules not processed for user `54b1b32697f2498cad4c7319b6570f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:20.174561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:20.289532 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2864/5749] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:20.290513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.318400 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2886/5750] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:20 2022] POST /identity/v3/domains => generated 275 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:20.319071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.321053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:20.427287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217730c2-50ec-43ce-a20b-420f8068d50b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.437616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.439687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.440898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.441734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.444335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.447155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053dba3-2832-44ec-9756-2000e567ea20 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.450086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.466226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.466554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2865/5751] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:20.467298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.467549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.467949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.468614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.476997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.476997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.589328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd03ea-888e-46d2-9717-a55e7fa39390 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.596525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.597206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.597491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.597826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.598901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e46e98f243764983974833cf5b9da539)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.600660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.643744 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2887/5752] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:20 2022] POST /identity/v3/projects => generated 367 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:20.643744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.770581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2866/5753] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:51:20 2022] PUT /identity/v3/domains/e46e98f243764983974833cf5b9da539/config => generated 138 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:20.771554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.792681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8fc6c-94ff-4de9-9f42-10614158cffb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.806204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.806742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.807019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.807403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.808607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.810141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.813241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6182df-e153-4f03-9289-5c1bed49383e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.828000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.831508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.832084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.832588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.834581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.846652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:20.855591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2888/5754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:20.857493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.965599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513afebd-6448-4071-a4f6-bad1292d9c2a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:20.978637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:20.993782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2867/5755] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:20 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:20.994840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:20.996901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:20.996901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:20.996901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:20.997238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:20.998800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.024589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cb7e5-72fb-4abb-a671-1a4a00d5e9ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:21.040354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:21.040795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.041076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.041510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] PATH_INFO: `/v3/projects/4b78417910494e6c9b4fd9bb33c9fa5d/users/576ebc3836354579b018accd0eb958ca/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.072251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b78417910494e6c9b4fd9bb33c9fa5d, user_id=576ebc3836354579b018accd0eb958ca, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:21.075947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.152774 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2889/5756] 10.222.0.64 () {60 vars in 1297 bytes} [Wed Nov 2 12:51:20 2022] PATCH /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity => generated 176 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:21.157797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.183460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aec5b4-1aac-4e1d-a2b5-0417d6653829 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:21.194786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:21.195502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.195928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.196306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.197303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:21.199459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4f006-dc21-4748-87f2-07db1d3528c7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.217318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2868/5757] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:20 2022] PUT /identity/v3/projects/4b78417910494e6c9b4fd9bb33c9fa5d/users/576ebc3836354579b018accd0eb958ca/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:21.218459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.243590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2890/5758] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:21.245293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.246160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.246160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.248777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:21.318754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] MFA Rules not processed for user `576ebc3836354579b018accd0eb958ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:21.320557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:21.388074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e493b89b-9821-4b91-ad70-67ac34233e30 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:21.400033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:21.403121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.403414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.403642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.404352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity, option=driver)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:21.405436 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:21.405436 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:51:21.405436 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:51:21.406365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.498311 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2891/5759] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:21.498311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.597183 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2869/5760] 10.222.0.64 () {60 vars in 1318 bytes} [Wed Nov 2 12:51:21 2022] PATCH /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver => generated 177 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:21.598099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.613006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:21.709913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555132a-1f1f-4a50-8d8e-19060da36781 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:21.724042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:21.725054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.726933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.731026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] PATH_INFO: `/v3/projects/2f025e3fb9fe43eb914b31ef859ade90/users/649104e21f51459b99239013d8ebe515/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.769662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f025e3fb9fe43eb914b31ef859ade90, user_id=649104e21f51459b99239013d8ebe515, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:21.775856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa996-ef5b-4738-b12b-d3446dd6d8d7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:21.779242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.780826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:21.781370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:21.781649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:21.781928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:21.784062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:21.878936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2892/5761] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:21 2022] PUT /identity/v3/projects/2f025e3fb9fe43eb914b31ef859ade90/users/649104e21f51459b99239013d8ebe515/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:21.880663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.929961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:21.931748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:21.949202 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2870/5762] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:21.950275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:21.974115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b60cd-3ecf-4250-8f29-0e093cdd4598 service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.022022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a3ee2-e05d-4ae6-9d19-f7f8f29f792f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.031461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.032260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.032587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.032866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.037649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity, option=driver)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.041065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.104683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.104978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.105381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.105682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.106678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.108331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.134245 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2871/5763] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:22.135061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.135671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:22.146319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86ab69-12b5-4986-b610-e36e365ca5db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.153132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.153823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.154096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.154399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] PATH_INFO: `/v3/projects/2f025e3fb9fe43eb914b31ef859ade90/users/649104e21f51459b99239013d8ebe515/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.156600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f025e3fb9fe43eb914b31ef859ade90, user_id=649104e21f51459b99239013d8ebe515, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.159543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb305d2-494b-4146-99cd-8813deebcc5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.164254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2893/5764] 10.222.0.64 () {58 vars in 1299 bytes} [Wed Nov 2 12:51:21 2022] DELETE /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:22.168474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.184359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823e19b-fb19-48c5-b1cd-8878a84a2553 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.187809 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2872/5765] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:22 2022] PUT /identity/v3/projects/2f025e3fb9fe43eb914b31ef859ade90/users/649104e21f51459b99239013d8ebe515/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:22.190326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.190608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.190877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.242053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] MFA Rules not processed for user `649104e21f51459b99239013d8ebe515`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:22.244835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:22.297446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.299178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.299460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.299732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.301085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity, option=driver)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.302710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find option driver in group identity in domain configuration for domain e46e98f243764983974833cf5b9da539.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e46e98f243764983974833cf5b9da539. Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:22.321850 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain e46e98f243764983974833cf5b9da539. Nov 02 12:51:22.323113 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:22.323764 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2894/5766] 10.222.0.64 () {58 vars in 1296 bytes} [Wed Nov 2 12:51:22 2022] GET /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity/driver => generated 171 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:51:22.330413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.367864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a7dbd2-ba3d-488b-9f0a-53a9645f9400 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.412774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.413475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.413722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.413997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.414606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.440837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.480643 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2873/5767] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:22.538302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.548064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:22.573386 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2895/5768] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 12:51:22 2022] DELETE /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:22.574544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.618646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63684d-c13f-485f-85d3-3ff1769f2724 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.643806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.644886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.645355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.645788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.676885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e46e98f243764983974833cf5b9da539, group=identity)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.676885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find group identity in domain configuration for domain e46e98f243764983974833cf5b9da539.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e46e98f243764983974833cf5b9da539. Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:22.684071 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain e46e98f243764983974833cf5b9da539. Nov 02 12:51:22.685266 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:22.690043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2896/5769] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:51:22 2022] GET /identity/v3/domains/e46e98f243764983974833cf5b9da539/config/identity => generated 154 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:51:22.694255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.754792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c4102-86ba-4c15-b4fd-1ca545900907 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.773276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.774335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.774825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.775310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539/config` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.776101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e46e98f243764983974833cf5b9da539)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.777975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.788682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015c8e7-9e18-4815-8225-08ff8f4591a6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:22.793686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:22.794722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:22.802229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:22.802229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:22.822919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:22.825453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:22.838196 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2874/5770] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:22.920591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:22.975895 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2897/5771] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:22 2022] DELETE /identity/v3/domains/e46e98f243764983974833cf5b9da539/config => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:22.980692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:23.004352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42587b-d8f1-467d-a19b-3d70e13dfef8 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:23.033218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:23.042254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:23.042609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:23.042813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:23.046372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e46e98f243764983974833cf5b9da539)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:23.065034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:23.090971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58a778-9564-445c-9e8e-94c5b2fff016 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:23.102454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:23.103590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:23.104604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:23.105460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] PATH_INFO: `/v3/users/56796e1dfe824579aec17291b492b360` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:23.109364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] RBAC: Authorizing `identity:delete_user(user_id=56796e1dfe824579aec17291b492b360)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:23.115337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:23.115712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.117780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.198209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:23.476961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.476961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.476961 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2898/5772] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:22 2022] PATCH /identity/v3/domains/e46e98f243764983974833cf5b9da539 => generated 276 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:51:23.481277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:23.483180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:23.611523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebaa3f-a770-4bf3-bb74-7ecfe0cd9cb6 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:23.617066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:23.619633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:23.620108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:23.620551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:23.637093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56796e1dfe824579aec17291b492b360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.656279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e46e98f243764983974833cf5b9da539)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:23.661091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:23.702060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.709748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e46e98f243764983974833cf5b9da539'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.860083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56796e1dfe824579aec17291b492b360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.882683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56796e1dfe824579aec17291b492b360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.883456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56796e1dfe824579aec17291b492b360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.889083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8634b230-f57f-48c3-9cdb-db6bc1ce387b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56796e1dfe824579aec17291b492b360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.918746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2875/5773] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:22 2022] DELETE /identity/v3/users/56796e1dfe824579aec17291b492b360 => generated 0 bytes in 996 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:23.920168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:23.920455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:23.920831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:23.944476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.957524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:23.958160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:23.959494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:23.982756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.074769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] The token cache is being invalidate because project e46e98f243764983974833cf5b9da539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:24.075443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.080385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.101141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.111668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.116991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e46e98f243764983974833cf5b9da539', 'request_id': 'req-01cc866d-618f-48b4-babe-3424e77888c4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:24.117585 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2876/5774] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:24.127934 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2899/5775] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:23 2022] DELETE /identity/v3/domains/e46e98f243764983974833cf5b9da539 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:24.134419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.136235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:24.228721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.230259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:24.348566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa62960-3c31-46d6-86f1-9d8f73b697df None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.357729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.358796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.359313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.359696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.369585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.369585 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:24.369585 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:51:24.369585 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:51:24.369585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.374119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2877/5776] 10.222.0.64 () {58 vars in 1173 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:24.375206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.378168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:24.397739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e4999-614b-4244-a9c0-c951524ba3c0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.400148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc866d-618f-48b4-babe-3424e77888c4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.412808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.413696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.414052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.414552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.415231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.419366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.430424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2878/5777] 10.222.0.64 () {58 vars in 1200 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.432599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.457885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2f20e-73a4-4283-84d1-382c68415afb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.472517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.473457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.474203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.474203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.474903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.480776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.488264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2879/5778] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.489367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.519467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f0092-a66b-4bd4-8664-68523bd717b2 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.523145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.523787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.524213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.524586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.528769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:24.535610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.537061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.537574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.538080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.538860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.541373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.543385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2880/5779] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.556837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.557100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.567385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.580455 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2900/5780] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:24.589166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbb911-9d2e-46a7-86e6-f98f4470dfad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.601653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.601653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.601653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.602151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.602151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.602798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.604910 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2881/5781] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:24.609204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.628914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8948d9-7186-4dcf-adfb-688d85243f5d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.644876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.645561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.645841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.646114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.646716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.647791 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:51:24.647791 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:51:24.647791 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:51:24.648728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.653354 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2901/5782] 10.222.0.64 () {58 vars in 1200 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.655052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.666710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5934e25-3b1a-4ace-9113-f9534cb45099 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.675678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.676366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.676676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.676954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.677556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.679164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.680311 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2882/5783] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:24.685360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.698066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f9798-87be-49b9-9370-fff8cf825e22 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.716377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.717251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.717623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.718037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.718735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.722439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.727003 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2902/5784] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.730408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.751339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f45ea7-d084-44f6-8013-b1f450a9e7c3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.765908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.767892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.768187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.768479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.769091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.771114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.774906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2883/5785] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.777852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.795438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774b6ac-bc18-4290-8b5e-6974b6d23b51 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.804270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.805489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.806722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.807405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.808946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.811298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.818319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.818516 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2903/5786] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.846411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066207-26b9-400b-b083-a464d1436bad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.861877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.862802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.863515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.863955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.864709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.867677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.875446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2884/5787] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.875829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.894688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2472b-7759-4ef5-811a-54757cdbef9f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.919676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:24.924039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.932309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.932309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.932309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.932309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.934449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.943481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2904/5788] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.947460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:24.966430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60cf5b-b04b-4bb4-8666-77f3af13b3cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:24.978613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:24.979590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:24.980068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:24.980504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:24.981341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:24.983255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:24.988544 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2885/5789] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:24.992642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.007195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259eee6-9511-4600-b1c9-7998fb00ac59 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.014644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.015643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.016090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.016461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.017222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.019297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.025354 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2905/5790] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:24 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.026856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.045822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dbb70-ac94-45bf-9772-f6d70491c488 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.052156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.053112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.053453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.053797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.055559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.057793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.062165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2886/5791] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.066267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.089543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc645c67-14a8-4f7a-8746-a4a80c120c9e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.107151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.114801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.114801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.114801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.114801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.143595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.151072 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2906/5792] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.151887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.167265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b885fe6-18ef-4341-8208-95c43201b2b3 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.189460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.190178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.190456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.190735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.191342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.193099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.198206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2887/5793] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.198816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.218104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edea165-fed2-43e7-bb71-517a21c3764d tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.241786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.242945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.244935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.246984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.249539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.253977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.258980 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2907/5794] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.262957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.294567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d37c2cf-7e54-471b-b0f5-e78b2564d7e4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.305876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.306660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.310344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.310708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.311414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.313223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.327100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2888/5795] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.334351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.348767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aa6d3-36d9-4b19-8094-0c5c98ba58f9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.363347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.366762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.367850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.369783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.372211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.431246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.431246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2908/5796] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:25.431451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.431451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d6555-b222-49df-b75a-0e03354fb498 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.431451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.431760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.431760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.431760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.431760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.432170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.432405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.450356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2889/5797] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.457333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a00-663c-4eab-9d26-d4381eb4422e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.484454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.485254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.486209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.487214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.487914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.489899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.492874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2909/5798] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:25.495710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.521696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff949a-e27a-4897-a716-fcfc21b3726b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.550168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.551942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.552470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.552872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.555361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.563122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.564886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2890/5799] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.568959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.585996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9e63e-8f2b-4cae-ab40-51f3b9ab2b13 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.603612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.604568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.605038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.605325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.605929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.607758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.612522 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2910/5800] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:25.615173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.631373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af673e-b9d7-4954-8436-f5fc64f4e1d5 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.644453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.671038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.671038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.671038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.671038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.671620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.671620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2891/5801] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.674693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.689613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350e22-789c-4d70-9d7d-401b6f5eea81 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.705591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.706565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.707021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.707650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.708436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.710491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.715109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2911/5802] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.719025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.735287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275c85-a5b9-42bd-bcad-aa523cb38abb tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.742786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.744522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.745613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.746135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.747885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.750421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.754091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2892/5803] 10.222.0.64 () {58 vars in 1290 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.758043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.773221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3e456-03d6-4c22-960b-2f14ce7baa6b tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.793130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.795889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.796379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.798048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.799225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.803994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.808973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2912/5804] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.811004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.832919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5651464-7a05-417d-b459-d80fa71cb6ad tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.850695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.851638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.852594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.852594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.855805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.858903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b1d68b-5ac7-4215-8075-c803fef86319 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.865658 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2893/5805] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.868737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.893642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7a67e-39c3-4f93-a226-05796f295df0 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.908034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.908701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.909162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.919579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.920240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.920603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.920929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.921500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.923158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.924584 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2913/5806] 10.222.0.64 () {58 vars in 1308 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.930084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.947956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea86e709-0f1b-4e70-9d2b-8a1e591e5598 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:25.960939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:25.961857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:25.961857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:25.962138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:25.962730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:25.964424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:25.975513 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2914/5807] 10.222.0.64 () {58 vars in 1290 bytes} [Wed Nov 2 12:51:25 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:25.975513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:25.979101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:25.982719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] MFA Rules not processed for user `c94845bcdb1140f4b4841b1bf916d059`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:25.983958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:26.021632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5949f59-1c9a-4117-bdf4-58c40434d1e1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.030620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.031677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.032124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.033424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] PATH_INFO: `/v3/projects/4eb742124f6b4987aab95d9b0d1247ee` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.036058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb742124f6b4987aab95d9b0d1247ee)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.039807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.161525 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2894/5808] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:26.165850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.210907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6eaef-d9b8-4b0d-a716-a0fcc84775d3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.238116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb742124f6b4987aab95d9b0d1247ee', 'request_id': 'req-518b8fcb-15a6-41ea-9a5b-b6b5db550579'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:26.253705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb742124f6b4987aab95d9b0d1247ee', 'request_id': 'req-518b8fcb-15a6-41ea-9a5b-b6b5db550579'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:26.267971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb742124f6b4987aab95d9b0d1247ee', 'request_id': 'req-518b8fcb-15a6-41ea-9a5b-b6b5db550579'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:26.323757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.323757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.323757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.324212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.324212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.325143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.328573 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2895/5809] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.331346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.335232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:26.353993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:26.432192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] The token cache is being invalidate because project 4eb742124f6b4987aab95d9b0d1247ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:26.432592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:26.436992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:26.438695 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2915/5810] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:25 2022] DELETE /identity/v3/projects/4eb742124f6b4987aab95d9b0d1247ee => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:26.439800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.445601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:26.473429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8fcb-15a6-41ea-9a5b-b6b5db550579 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.487782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.488771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.494854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.494854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.494854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.494854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.494854 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2916/5811] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.495390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.506241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:26.513427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1a00d-b517-4d13-a6d1-0259f00b3387 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.526770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.529014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.529836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.530251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.534095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:26.637241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a804-c22f-459e-8773-6ab5c33584e7 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.650746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.651403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.651879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.652325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] PATH_INFO: `/v3/users/576ebc3836354579b018accd0eb958ca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.654997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576ebc3836354579b018accd0eb958ca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.657888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.695761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.695933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.713970 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2896/5812] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:26.714914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.728877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e942a-4d8f-470f-a37d-d513bfb77d04 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.735583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.736314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.736636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.736985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.737582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.739317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.743795 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2897/5813] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.744840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.757816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1bc32-26f2-4bca-8a32-9c61454551a1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.763438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.764162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.764446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.764767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.765469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.767790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.772304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2898/5814] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.773398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.789872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f31ee-1787-4e95-a6d5-6c32293acea9 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.803423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.804099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.804395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.804743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.805338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.808766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.815932 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2899/5815] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.816807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.827504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab013770-45d8-43a4-8fbc-a4287d0aa7cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.838622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.839643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.839786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.842443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.842443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.843047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.848189 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2900/5816] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.849467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.861231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4571e9-3b20-4f27-8bd9-707d2af34081 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.866912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.867612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.870009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.870009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.870009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.870781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.874112 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2901/5817] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.877944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.894983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2b590-7e88-46f1-b014-297ddec7fb29 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.900300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.901100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.901378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.901656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.902342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.904172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.907052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2902/5818] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:26.915228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.936580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212c6c-c732-4f98-a203-eb3ca4958a6a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.944582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.945654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.946371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.950349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.950349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:26.950349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:26.957955 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2903/5819] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:26.959979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:26.974793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bb6cd-b547-404c-aef1-bed477df8524 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:26.983197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:26.983798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:26.984082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:26.985561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:26.996810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.012442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576ebc3836354579b018accd0eb958ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:27.018489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.018489 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2904/5820] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:51:26 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.021400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.043304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb650b1d-cdb7-447f-b646-685a5783d807 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.053506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.054259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.054538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.054808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.055410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.057082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.070220 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2905/5821] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.074858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.093545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc4d105-636a-4cd7-8602-b1aff3c003dc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.109241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.109950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.110224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.110603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.111236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.112927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.114427 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2906/5822] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.118583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.141435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341407e9-3e3e-4fa9-a0ec-58ce0773da83 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.153430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.154106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.154381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.154647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.155533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.156903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.157320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576ebc3836354579b018accd0eb958ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:27.158436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2907/5823] 10.222.0.64 () {58 vars in 1212 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:27.165646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.196236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db56dcd-bd18-4de3-9fa5-ff76cdcc47c1 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.197203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576ebc3836354579b018accd0eb958ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:27.197328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.197328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.197328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.197611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.197611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.198465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.209493 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2908/5824] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:27.212014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.213645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576ebc3836354579b018accd0eb958ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:27.215848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576ebc3836354579b018accd0eb958ca'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:27.231447 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2917/5825] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:26 2022] DELETE /identity/v3/users/576ebc3836354579b018accd0eb958ca => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:27.232888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d69d0-a8fd-49cc-b28a-0fdc5932b4cc tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.332104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.332870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.333078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.333351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.334261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.342372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.343854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2909/5826] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.348594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.350331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:27.378501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354399b-d03f-4ad2-b609-8f3b0fb853d8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.401313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.402025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.402308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.402584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.403188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.404867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.406130 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2918/5827] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.411146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.436315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567f372-d615-4d2e-b90c-0c51fe9c419f tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.468328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.468948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.469702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.470014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.470623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.472774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.488713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.488846 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2910/5828] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.497920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183320-c2fc-4e26-851b-ac3c9de3f743 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.508233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.509407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.510621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.511215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.512321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.534526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.535848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2919/5829] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.540059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.552477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa23d7-7580-442c-a752-f8761eb6fc49 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.560132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.562360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.563383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.565020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.573138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.575585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.580577 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2911/5830] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.581749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.598651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03778300-1fb5-42c8-94a6-489f8b7fd739 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.606826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.608150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.608911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.609426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.610313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.613424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.619592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.632942 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2920/5831] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Nov 02 12:51:27.639273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363055-7c3d-4a05-adb6-da6eaeda8b25 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.646410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.647653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.648504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.649008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.650244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.652719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.659675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.660970 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2912/5832] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.679551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe49a22-9820-4ab5-8fd5-6fa7a3aa113a tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.688944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.698472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.698472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.698472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.698472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.699563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.700049 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2921/5833] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.706301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.725939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35714b-9a79-45da-a723-80e6d409533e tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.741036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.741811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.742103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.742382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.743128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:27.744702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:27.751619 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2913/5834] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 12:51:27 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Nov 02 12:51:27.755405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.769779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04d35b-3bb6-4e3f-ac2b-53e0c080a541 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.778742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.779457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.779742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.780020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/e46e98f243764983974833cf5b9da539` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.789340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find domain: e46e98f243764983974833cf5b9da539.: keystone.exception.DomainNotFound: Could not find domain: e46e98f243764983974833cf5b9da539. Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e46e98f243764983974833cf5b9da539. Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:27.794923 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:27.796566 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:27.797895 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e46e98f243764983974833cf5b9da539. Nov 02 12:51:27.801920 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.802088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.806344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2922/5835] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:27 2022] PATCH /identity/v3/domains/e46e98f243764983974833cf5b9da539 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:27.812282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b2cb7-4bef-4c8d-9f45-f26b148df482 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.817672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.821720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.821720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.821720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/414a226dadf247d391d54507945f0494` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.830923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find domain: 414a226dadf247d391d54507945f0494.: keystone.exception.DomainNotFound: Could not find domain: 414a226dadf247d391d54507945f0494. Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 414a226dadf247d391d54507945f0494. Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:27.840110 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:27.841507 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:27.842700 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 414a226dadf247d391d54507945f0494. Nov 02 12:51:27.845688 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:27.848598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.857227 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2914/5836] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:27 2022] PATCH /identity/v3/domains/414a226dadf247d391d54507945f0494 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:51:27.862207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6be9-20bd-48ef-9a76-5d3787fadb71 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:27.869243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0747c4999adb4fb6b8738220e6a02803', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:27.870216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:27.870734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:27.871183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] PATH_INFO: `/v3/domains/668355ebdf0846d6a45d3286fe7cfd26` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:27.880547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Could not find domain: 668355ebdf0846d6a45d3286fe7cfd26.: keystone.exception.DomainNotFound: Could not find domain: 668355ebdf0846d6a45d3286fe7cfd26. Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 668355ebdf0846d6a45d3286fe7cfd26. Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:27.886775 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:27.888086 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:27.889335 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 668355ebdf0846d6a45d3286fe7cfd26. Nov 02 12:51:27.891509 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:27.898705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:27.899663 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2923/5837] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:27 2022] PATCH /identity/v3/domains/668355ebdf0846d6a45d3286fe7cfd26 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:27.900877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:27.965265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:28.028110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad4a6-262b-4218-8719-0010121733f4 tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:28.037392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:28.038383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:28.038675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:28.040080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] PATH_INFO: `/v3/users/ad4e839c4cee4d128122ce364467c4a2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:28.040673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4e839c4cee4d128122ce364467c4a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:28.043125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:28.506936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4e839c4cee4d128122ce364467c4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.644087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:28.645748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4e839c4cee4d128122ce364467c4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.664013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:28.664904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:28.687811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4e839c4cee4d128122ce364467c4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.690153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4e839c4cee4d128122ce364467c4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.691305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e889a8b9-175b-438f-b32c-e2a717a6ba6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4e839c4cee4d128122ce364467c4a2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.697598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773f2f9-9ee2-4fae-97ae-d74ea5e6d88c tempest-DomainConfigurationTestJSON-827891613 tempest-DomainConfigurationTestJSON-827891613-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:28.711035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:28.712303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:28.713845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:28.715142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] PATH_INFO: `/v3/projects/4b78417910494e6c9b4fd9bb33c9fa5d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:28.717732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b78417910494e6c9b4fd9bb33c9fa5d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:28.721826 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2915/5838] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:27 2022] DELETE /identity/v3/users/ad4e839c4cee4d128122ce364467c4a2 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:28.724420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:28.730092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:28.730774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:28.731251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:28.779372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:28.781049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:28.870829 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2916/5839] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:28.939464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:28.940176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b78417910494e6c9b4fd9bb33c9fa5d', 'request_id': 'req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.941291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:28.954973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b78417910494e6c9b4fd9bb33c9fa5d', 'request_id': 'req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:28.983030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b78417910494e6c9b4fd9bb33c9fa5d', 'request_id': 'req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:29.060312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044edda-d282-4e73-b957-93fa821b3a39 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:29.160209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] The token cache is being invalidate because project 4b78417910494e6c9b4fd9bb33c9fa5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:29.161062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:29.163159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-57cd7227-0ead-4cf5-be07-2ba2e7502ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:29.166820 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2924/5840] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:28 2022] DELETE /identity/v3/projects/4b78417910494e6c9b4fd9bb33c9fa5d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:29.171975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d40-e511-4fcf-9542-076b9ca609d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:29.172776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d40-e511-4fcf-9542-076b9ca609d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:29.175079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d40-e511-4fcf-9542-076b9ca609d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:29.175477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:29.179494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:29.180240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:29.180749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:29.183747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:29.222481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c3124d40-e511-4fcf-9542-076b9ca609d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:29.226387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3124d40-e511-4fcf-9542-076b9ca609d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:29.389351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:29.393249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:29.431701 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2925/5841] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:29.434934 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2917/5842] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:29.439904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:29.440626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:29.441149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:29.479082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:29.480431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:29.499618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2926/5843] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:29.499800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:29.527713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90c64d-c527-4394-b987-580bde5e6f79 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:29.547066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:29.548316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:29.553493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:29.554004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:29.556001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:29.556450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:29.558364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:29.591481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2918/5844] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:29.595277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:29.620651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d05180-87e2-43c3-a2ac-4d3aba17e31e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:29.637692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:29.639411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:29.640505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:29.641569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:29.643746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:29.648961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:29.840555 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2927/5845] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:29 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:29.842843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:29.859350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9250c2d-01f7-404c-8cdd-a8c5485031d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:29.911166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:29.913908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:30.128413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549ff6-970d-411b-b2b3-b97248022d04 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:30.136246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:30.137653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.138276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.138775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] PATH_INFO: `/v3/users/54b1b32697f2498cad4c7319b6570f1e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.140567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b1b32697f2498cad4c7319b6570f1e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:30.144815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:30.146163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:30.146890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.147175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.147441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.148094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:30.150745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:30.302659 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2919/5846] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:29 2022] POST /identity/v3/users => generated 293 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:30.309575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:30.329925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89e3a1-abac-4bce-81bc-8e3122fa5313 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:30.352366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:30.354952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.355610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.356518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.357670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:30.362460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:30.381188 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2920/5847] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:30.385087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:30.403709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55dee2-ded7-4c13-b3c4-bfcd8c0efb83 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:30.411311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:30.412460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.413611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.414054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.414902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:30.417202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:30.434487 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2921/5848] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:51:30.439995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:30.458903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698322b4-4b7d-483c-82c5-3845dadf3fd2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:30.482436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:30.484611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.485921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.486406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] PATH_INFO: `/v3/projects/084d0535f9c44eadbb5a5df0926ab59e/users/9f19b3d0b79145ab891d0040cd66baf6/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.508753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b1b32697f2498cad4c7319b6570f1e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:30.535609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084d0535f9c44eadbb5a5df0926ab59e, user_id=9f19b3d0b79145ab891d0040cd66baf6, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:30.544581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866cb30-7bb0-4198-9b55-a4bb9df37418 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:30.657127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b1b32697f2498cad4c7319b6570f1e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:30.692777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b1b32697f2498cad4c7319b6570f1e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:30.715758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b1b32697f2498cad4c7319b6570f1e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:30.719804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-015272e1-ffad-411b-b4ee-0f21feb8cf67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b1b32697f2498cad4c7319b6570f1e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:30.730256 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2928/5849] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:29 2022] DELETE /identity/v3/users/54b1b32697f2498cad4c7319b6570f1e => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:30.739384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.740021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.740542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.762411 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2922/5850] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:30 2022] PUT /identity/v3/projects/084d0535f9c44eadbb5a5df0926ab59e/users/9f19b3d0b79145ab891d0040cd66baf6/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:30.777056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:30.777695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:30.778504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:30.788683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:30.793070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:30.828067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] MFA Rules not processed for user `9f19b3d0b79145ab891d0040cd66baf6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:30.831600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:30.991168 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2929/5851] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:31.035323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:31.039320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:31.064078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2923/5852] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:31.065394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:31.067851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:31.094771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a698-e434-4993-9955-10c0798e2d0e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:31.104313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:31.105267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:31.108738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:31.108738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] PATH_INFO: `/v3/projects/ba873d10eb3d4d0d9cd9703d8b0e78b2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:31.108738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba873d10eb3d4d0d9cd9703d8b0e78b2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:31.111556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:31.177124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f0db6-38b9-4194-803a-2c27acf2f418 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:31.182037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:31.182672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:31.182950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:31.183516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:31.203665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:31.216219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:31.216219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:31.225313 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2930/5853] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:31.226435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:31.228078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:31.282924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba873d10eb3d4d0d9cd9703d8b0e78b2', 'request_id': 'req-0593dd17-e5aa-454a-b564-00201242495c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:31.299714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba873d10eb3d4d0d9cd9703d8b0e78b2', 'request_id': 'req-0593dd17-e5aa-454a-b564-00201242495c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:31.382761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74044f85-444d-4cac-aa50-f599b746ed27 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:31.431826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba873d10eb3d4d0d9cd9703d8b0e78b2', 'request_id': 'req-0593dd17-e5aa-454a-b564-00201242495c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:31.457299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] The token cache is being invalidate because project ba873d10eb3d4d0d9cd9703d8b0e78b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:31.457613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:31.471660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:31.481516 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2924/5854] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:31 2022] DELETE /identity/v3/projects/ba873d10eb3d4d0d9cd9703d8b0e78b2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:31.483497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:31.485712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:31.560940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:31.561938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:31.562391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:31.562883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:31.571832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:31.649640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0593dd17-e5aa-454a-b564-00201242495c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:31.659437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:31.671755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:31.721752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:31.721752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] PATH_INFO: `/v3/users/0747c4999adb4fb6b8738220e6a02803` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:31.721752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0747c4999adb4fb6b8738220e6a02803)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:31.721752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:31.770101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:31.772808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d6b8d-6285-41e6-8af5-a5ed68b4463a service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:31.836880 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2931/5855] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:32.067057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:32.069675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0747c4999adb4fb6b8738220e6a02803'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:32.353381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0747c4999adb4fb6b8738220e6a02803'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:32.399545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:32.400035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:32.400610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:32.422406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0747c4999adb4fb6b8738220e6a02803'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:32.427972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0747c4999adb4fb6b8738220e6a02803'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:32.429055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0747c4999adb4fb6b8738220e6a02803'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:32.467634 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2925/5856] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:31 2022] DELETE /identity/v3/users/0747c4999adb4fb6b8738220e6a02803 => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:32.485598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:32.486904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:32.660707 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2932/5857] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:32.702847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:32.705482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:32.849368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:32.851113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:32.855884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc2f7d-aaa1-4114-b461-e8e31dd28bcc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:32.875511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:32.876730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:32.877011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:32.877536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] PATH_INFO: `/v3/projects/732af39b97fb45348fa7a4a934e442d8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:32.878778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] RBAC: Authorizing `identity:delete_project(project_id=732af39b97fb45348fa7a4a934e442d8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:32.880798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:33.086010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732af39b97fb45348fa7a4a934e442d8', 'request_id': 'req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.086896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daca2a-25ad-406c-a37a-66169926e000 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:33.098824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732af39b97fb45348fa7a4a934e442d8', 'request_id': 'req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.231146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732af39b97fb45348fa7a4a934e442d8', 'request_id': 'req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.253127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] The token cache is being invalidate because project 732af39b97fb45348fa7a4a934e442d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:33.253698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.256332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.261567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2926/5858] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:32 2022] DELETE /identity/v3/projects/732af39b97fb45348fa7a4a934e442d8 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:33.262712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:33.263037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:33.263367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:33.263645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:33.263918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:33.265307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:33.273696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:33.374669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:33.376715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223c51f-215c-4f7f-b23a-c81d66ea6898 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:33.410617 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2933/5859] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:33.417059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3241d-4a8f-41d8-b3ee-ecddfd9de04c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:33.433053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:33.433321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:33.433562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:33.433680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] PATH_INFO: `/v3/users/649104e21f51459b99239013d8ebe515` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:33.437372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=649104e21f51459b99239013d8ebe515)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:33.439535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:33.541314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:33.844839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649104e21f51459b99239013d8ebe515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:33.981311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649104e21f51459b99239013d8ebe515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:34.005427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649104e21f51459b99239013d8ebe515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:34.027099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649104e21f51459b99239013d8ebe515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:34.027099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649104e21f51459b99239013d8ebe515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:34.069409 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2927/5860] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:33 2022] DELETE /identity/v3/users/649104e21f51459b99239013d8ebe515 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:34.891994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:34.892978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:34.893515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:34.942206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:34.947866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:35.100215 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2934/5861] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:35.114111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:35.116269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:35.164814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:35.292355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8cbe-225a-4cd4-a14c-4d4d86f89f9f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:35.311247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:35.311978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:35.312263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:35.312608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:35.325512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:35.330413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297965e2-4190-4de8-bc77-f3325fb99b9e service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:35.350604 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2928/5862] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:35.617066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:35.617066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:35.617066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae494-57bd-4c5c-9b77-f87e14dd47c3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:35.618921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:35.618921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:35.618921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:35.618921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] PATH_INFO: `/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:35.623044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c440bb69b347ae8b3c2b68ee88ee17)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:35.625806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:35.851630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'request_id': 'req-238e4676-c3de-4af7-a517-6b457f04f0fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:35.865817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'request_id': 'req-238e4676-c3de-4af7-a517-6b457f04f0fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:35.878078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c440bb69b347ae8b3c2b68ee88ee17', 'request_id': 'req-238e4676-c3de-4af7-a517-6b457f04f0fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.202017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] The token cache is being invalidate because project a7c440bb69b347ae8b3c2b68ee88ee17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:36.202017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.202017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-238e4676-c3de-4af7-a517-6b457f04f0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.202017 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2935/5863] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:35 2022] DELETE /identity/v3/projects/a7c440bb69b347ae8b3c2b68ee88ee17 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:36.203153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:36.203153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:36.203153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:36.203153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:36.203153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:36.378923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2929/5864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:36.387611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06048-3638-4568-af2b-5607c2658425 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:36.387886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06048-3638-4568-af2b-5607c2658425 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:36.388348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d06048-3638-4568-af2b-5607c2658425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:36.435272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-66d06048-3638-4568-af2b-5607c2658425 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:36.438211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66d06048-3638-4568-af2b-5607c2658425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:36.456023 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2936/5865] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:36.465903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:36.500780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fca8a0-a01d-4596-a593-33e84f45ae97 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:36.519734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:36.521622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:36.527540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d06048-3638-4568-af2b-5607c2658425 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:36.529941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66d06048-3638-4568-af2b-5607c2658425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:36.533500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:36.534371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:36.535930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:36.537570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:36.541236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:36.584787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2930/5866] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:36.586544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d06048-3638-4568-af2b-5607c2658425 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:36.587726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:36.621119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:36.622949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:36.623386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:36.625196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] PATH_INFO: `/v3/projects/2f025e3fb9fe43eb914b31ef859ade90` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:36.630784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f025e3fb9fe43eb914b31ef859ade90)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:36.638461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700c8b0-b642-4508-8bcb-07dd585dd28f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:36.645456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:36.676404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:36.676404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:36.676404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:36.680521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:36.687484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:36.697839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:36.923136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f025e3fb9fe43eb914b31ef859ade90', 'request_id': 'req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.937550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:36.939255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f025e3fb9fe43eb914b31ef859ade90', 'request_id': 'req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.948061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f025e3fb9fe43eb914b31ef859ade90', 'request_id': 'req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:36.956876 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2931/5867] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:36 2022] POST /identity/v3/projects => generated 365 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:36.975966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.119727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66240a59-1e68-4fc6-8e78-b905bb3d6d09 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.139912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.140246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.140538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.140824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.142219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.153229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.203881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] The token cache is being invalidate because project 2f025e3fb9fe43eb914b31ef859ade90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:37.205338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:37.206250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fe6c0d9-7e50-43cc-b170-2ec9bf73301a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:37.208028 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2937/5868] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:36 2022] DELETE /identity/v3/projects/2f025e3fb9fe43eb914b31ef859ade90 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:37.214994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0d4-6cdd-40a0-94b1-e4299a98eb59 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.215481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0d4-6cdd-40a0-94b1-e4299a98eb59 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.216160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab0d4-6cdd-40a0-94b1-e4299a98eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.245459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b10ab0d4-6cdd-40a0-94b1-e4299a98eb59 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:37.247205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b10ab0d4-6cdd-40a0-94b1-e4299a98eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:37.259289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2938/5869] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:37.273138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ffd2f-ab3c-460c-a0be-9b215fb53880 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.273963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ffd2f-ab3c-460c-a0be-9b215fb53880 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.274658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ffd2f-ab3c-460c-a0be-9b215fb53880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.330653 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2932/5870] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:36 2022] POST /identity/v3/users => generated 283 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:37.330653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.330653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:37.342310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-260ffd2f-ab3c-460c-a0be-9b215fb53880 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:37.346521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-260ffd2f-ab3c-460c-a0be-9b215fb53880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:37.360401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d7fe8-b7de-492b-b8c1-9466892348ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.367995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2939/5871] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:37.370385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.371148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.371809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.380162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.380951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.390063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.390063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.390063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.390063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.417579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:37.420314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:37.422110 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2933/5872] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:51:37.426144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.448204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39c49c-5297-44f6-a45b-45ef8cc05ea0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.462321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.462981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.463329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.464310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.465078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:37.465473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.470244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.502467 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2934/5873] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:37.509982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.540866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77036259-0ee7-4b53-a452-ceb49e589c39 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.553273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.553904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.554302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.554472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.555223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.556087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:37.558281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.584005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2935/5874] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:37.585480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.610363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c459bc-2378-4417-89ec-218035aa7043 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.624943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.626358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.627435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.628268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.630917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.635563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.670660 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2940/5875] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:37.674659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.736963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2b110-febb-4c66-b4b0-150454d3f8a5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:37.749551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:37.751987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:37.753123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:37.754143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] PATH_INFO: `/v3/projects/38c1b2933a3449938af453c0c287feb9/users/34c4573c3a504046a51421db983a2eb4/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:37.792481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c1b2933a3449938af453c0c287feb9, user_id=34c4573c3a504046a51421db983a2eb4, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:37.799349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:37.964147 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2936/5876] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:37 2022] POST /identity/v3/projects => generated 363 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:37.965997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:37.973634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:38.014736 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2941/5877] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:37 2022] PUT /identity/v3/projects/38c1b2933a3449938af453c0c287feb9/users/34c4573c3a504046a51421db983a2eb4/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:38.018647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:38.177654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bcf40-36b3-4341-84da-c96f809b3cb0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:38.300280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6516a3-f0d0-4450-96fa-a7a1b8215c59 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:38.339835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:38.340512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:38.342586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:38.342874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:38.351654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:38.355742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a48af-9c1a-4ef7-98b8-448c864cb29e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:38.423486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:38.424861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:38.424861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:38.425259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:38.542313 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2942/5878] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:38 2022] POST /identity/v3/users => generated 282 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:38.551181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:38.551181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:38.551181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:38.626737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] MFA Rules not processed for user `34c4573c3a504046a51421db983a2eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:38.630674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:38.646220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:38.648010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd824b-f660-43db-873c-345b429a6c6b service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:38.683278 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2937/5879] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:38.683278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:38.683278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:38.683278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:38.739385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] MFA Rules not processed for user `c94845bcdb1140f4b4841b1bf916d059`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:38.741678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:38.891221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2938/5880] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:38.892403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:38.920376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf70adb-c70a-4606-a9da-dbe4afb87400 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:38.929321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:38.931950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:38.931950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:38.931950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:38.931950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:38.934256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:38.967770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2939/5881] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:38.972253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:38.978123 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2943/5882] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:38.983625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:38.997984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223961f-f479-4ab8-b4d8-8dd59a818b97 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:39.022809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e08f2b-aa25-4dac-a6a6-247e8255d9eb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:39.023478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:39.024524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.026005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.027031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.029494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:39.035777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:39.043837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:39.044477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.044970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.045432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.046931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:39.051428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:39.060140 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2940/5883] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:39.064145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:39.089832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94cec-4dc4-4729-8ec1-c39874dee579 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:39.104015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:39.107817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.108251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.108603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] PATH_INFO: `/v3/projects/a933d31c685447899b2c9c8c1f1bf424/users/ccc8b7131f8c4b08997746b1a49b996a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.153536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a933d31c685447899b2c9c8c1f1bf424, user_id=ccc8b7131f8c4b08997746b1a49b996a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:39.162120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d780e-eff0-4aa3-b280-08f41f4d1484 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:39.222495 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2944/5884] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:38 2022] POST /identity/v3/projects => generated 367 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:39.226862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:39.373412 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2941/5885] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:39 2022] PUT /identity/v3/projects/a933d31c685447899b2c9c8c1f1bf424/users/ccc8b7131f8c4b08997746b1a49b996a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:39.385338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546495b-1f99-4ed9-b757-dac3acc40bf5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.386699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546495b-1f99-4ed9-b757-dac3acc40bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.387151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546495b-1f99-4ed9-b757-dac3acc40bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.397822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd313b8-0d77-418d-9813-deca1434a3df admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:39.424191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:39.476252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f546495b-1f99-4ed9-b757-dac3acc40bf5 None None] MFA Rules not processed for user `ccc8b7131f8c4b08997746b1a49b996a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:39.476252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f546495b-1f99-4ed9-b757-dac3acc40bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:39.922790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:39.922790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.922790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.922790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.931091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:39.931091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2942/5886] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:39.935522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:39.937268 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2943/5887] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:39.937268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:39.937593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2945/5888] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:39 2022] POST /identity/v3/users => generated 290 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:39.937593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:39.937936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95a5a8-95a4-43d4-9af1-179f1ff29177 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:39.937936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:39.937936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:39.937936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:39.938590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:39.938590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:39.938590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.068381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea0d81-c800-4fa0-982d-60628ee76e25 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.075487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.076616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.076895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.077166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.096430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.105697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.119385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2946/5889] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:40.120347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.145796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218a22a-b34c-4293-a3ce-b9d921b27806 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.161226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.162782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.167636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.171071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.177149 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2944/5890] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:39 2022] POST /identity/v3/projects => generated 363 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:40.177287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.177287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.178222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.211043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2947/5891] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:40.224018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.262233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd60226-dbcc-4f6e-b70c-50cf3a189812 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.430126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971afead-a8c6-48b1-bb17-8c6707bb584a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.449172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:40.452705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.455029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.455304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.455577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.456235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.458257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.501558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.502502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.502772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.503040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] PATH_INFO: `/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6/users/2acbe1740e1f4202be3c7809ac95bcdb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.557385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae14a2b44734a4eab3d2259fa9b33c6, user_id=2acbe1740e1f4202be3c7809ac95bcdb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.560180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.634842 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2945/5892] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:40 2022] POST /identity/v3/users => generated 288 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:40.643266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.664354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a1eb-7df0-4a81-a869-c4da153253cb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.675174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.676057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.676521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.677781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.681995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.695794 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2948/5893] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:40 2022] PUT /identity/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6/users/2acbe1740e1f4202be3c7809ac95bcdb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:40.695876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.696796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.729998 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2946/5894] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:40.748197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.770591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfb7c8-2301-4697-965d-109593778833 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.871948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358fbbb-d1cd-41d2-8699-d1bcccef8cbf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.886338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.887155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.887435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.887782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.888655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.890456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:40.916998 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2949/5895] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:40.920105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:40.925138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.928643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.928849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.929099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] PATH_INFO: `/v3/projects/933672265df34465864f2b62b9247c6c/users/3f2d0c6d63c645c993b0d036743ac221/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.946532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af506fc2-5929-481e-b5ed-6f7a4ca0d3bb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:40.964748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:40.966022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:40.966305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:40.966626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] PATH_INFO: `/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6/users/2acbe1740e1f4202be3c7809ac95bcdb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:40.969436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae14a2b44734a4eab3d2259fa9b33c6, user_id=2acbe1740e1f4202be3c7809ac95bcdb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:40.973673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccef23-da02-4f8d-ad11-135df39c53e9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.000368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933672265df34465864f2b62b9247c6c, user_id=3f2d0c6d63c645c993b0d036743ac221, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:41.004131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.016850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2950/5896] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:40 2022] PUT /identity/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6/users/2acbe1740e1f4202be3c7809ac95bcdb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:41.020881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914977-1882-456c-b74d-3c5bddb43bec None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.021348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914977-1882-456c-b74d-3c5bddb43bec None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.022833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b914977-1882-456c-b74d-3c5bddb43bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9b914977-1882-456c-b74d-3c5bddb43bec None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:41.038651 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:51:41.039562 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:41.040337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2951/5897] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:51:41.055285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.055285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.055285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.119021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] MFA Rules not processed for user `2acbe1740e1f4202be3c7809ac95bcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:41.121212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:41.205933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2952/5898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:41.216268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:41.228407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866501f9-ba76-42ec-a468-d45ae9290f89 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:41.238877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:41.239880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.239994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.240393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.241199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:41.245420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.245598 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2947/5899] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:40 2022] PUT /identity/v3/projects/933672265df34465864f2b62b9247c6c/users/3f2d0c6d63c645c993b0d036743ac221/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:41.248982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:41.347068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa298-334a-47bf-82ae-47930668f382 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:41.361516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:41.362419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.363847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.364143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.364860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:41.368976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.404841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2948/5900] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:41.422033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:41.453517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2953/5901] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/domains => generated 276 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:41.457050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:41.476751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39744f12-3980-4962-8b4a-32e1b3eded40 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:41.622349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677da1f9-5c0a-466a-a6db-6a83cfd67bbe tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:41.631247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:41.632885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.633351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.634045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.635221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:41.638580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49eb646-d98e-4cbd-8fda-fbbc412a5c8d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.653525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:41.654349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.655528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.655806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] PATH_INFO: `/v3/projects/933672265df34465864f2b62b9247c6c/users/3f2d0c6d63c645c993b0d036743ac221/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.661684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=933672265df34465864f2b62b9247c6c, user_id=3f2d0c6d63c645c993b0d036743ac221, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:41.669360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1cb734-1e24-4ab3-8ad2-e4e89622e284 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:41.694315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2949/5902] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:41 2022] PUT /identity/v3/projects/933672265df34465864f2b62b9247c6c/users/3f2d0c6d63c645c993b0d036743ac221/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:41.695969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.696257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.696548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.725758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:41.727552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:41.794215 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2954/5903] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/domains => generated 276 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:41.794215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:41.794215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:41.794215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:41.820005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2950/5904] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:41.820933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:41.864771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] MFA Rules not processed for user `3f2d0c6d63c645c993b0d036743ac221`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:41.866390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:41.959981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c81a7f-76c2-4a3e-b62e-6cacfaa676aa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:41.988862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2955/5905] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:41.988862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:42.097082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:42.097713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:42.097998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:42.098326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:42.098999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:42.101015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:42.136254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f001c-b0b4-4a3c-aacd-1c15bfc2029f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:42.146452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:42.148329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:42.148965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:42.149407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:42.244845 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2951/5906] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:51:41 2022] POST /identity/v3/domains => generated 275 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:42.245986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:42.248466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:42.249906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:42.250662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:42.268395 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2956/5907] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:42.279953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:42.300520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097442a-d0c2-4e68-8f0d-4a467f8c48ac service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:42.396345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2c85-51b5-4444-a897-01298b982c27 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:42.409611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:42.410343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:42.410621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:42.410984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:42.413619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:42.414312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:42.414765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:42.426889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:42.428787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:42.431500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:42.550206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:42.553087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae8eb9-314e-4380-8869-4ead9365b117 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:42.576566 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2957/5908] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:51:42 2022] POST /identity/v3/domains => generated 279 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:42.581654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:42.589253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2952/5909] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:42.669392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f25f0-36b5-4cd4-ba13-953a9fb2c436 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:42.677001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:42.678029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:42.678406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:42.678721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/fb8d531007b34a45b383b7d4fdff166f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:42.695602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fb8d531007b34a45b383b7d4fdff166f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:42.697766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:42.735993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:42.740331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:42.925595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:43.016977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.039877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.045110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:43.053711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:43.054257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:43.054544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:43.074506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.092139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:43.094245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:43.194294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project fb8d531007b34a45b383b7d4fdff166f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:43.194914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.196289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.247008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.262004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.263882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fb8d531007b34a45b383b7d4fdff166f', 'request_id': 'req-65bb914c-f16d-4033-b657-a8c7018f60a9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.280559 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2958/5910] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:42 2022] DELETE /identity/v3/domains/fb8d531007b34a45b383b7d4fdff166f => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:43.284752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2953/5911] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:43.288999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:43.291792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:43.301740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:43.304164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:43.444352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25329ec3-719c-487e-8828-91b4b088f7f2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:43.445920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb914c-f16d-4033-b657-a8c7018f60a9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:43.450590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:43.451385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:43.451754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:43.452295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:43.453390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:43.455133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:43.455458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:43.455772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:43.456460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:43.458239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:43.473672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:43.476404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:43.493404 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2954/5912] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:43.576127 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2959/5913] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:43 2022] POST /identity/v3/domains => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:43.577646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:43.598350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3cdb0-20c0-4c2a-a32f-e01324cd3640 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:43.769140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:43.770789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:43.772554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:43.772941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/64c3f206d9254ef79e995e079ea0ca6a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:43.804280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=64c3f206d9254ef79e995e079ea0ca6a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:43.806325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:43.840820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.842809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.972205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.973367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:43.979354 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2955/5914] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:43 2022] PATCH /identity/v3/domains/64c3f206d9254ef79e995e079ea0ca6a => generated 249 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:43.980991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:43.983026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:44.017417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ac2b0-9722-4a3a-b596-b842bd394627 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:44.118622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:44.119479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:44.121789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:44.121789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/64c3f206d9254ef79e995e079ea0ca6a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:44.143298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=64c3f206d9254ef79e995e079ea0ca6a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:44.145967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:44.158345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:44.160246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:44.230713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.238900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.336818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599cfbe-76fe-4e63-8cf4-17d05df36198 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:44.342682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:44.343346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:44.343626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:44.344828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] PATH_INFO: `/v3/users/9f19b3d0b79145ab891d0040cd66baf6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:44.346578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f19b3d0b79145ab891d0040cd66baf6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:44.351208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:44.463298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.487262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.504282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.691951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project 64c3f206d9254ef79e995e079ea0ca6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:44.701219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.704880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.712678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f19b3d0b79145ab891d0040cd66baf6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.746134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.753164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.758259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '64c3f206d9254ef79e995e079ea0ca6a', 'request_id': 'req-7834e005-b724-46be-8969-812db8373f68'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.774595 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2960/5915] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:43 2022] DELETE /identity/v3/domains/64c3f206d9254ef79e995e079ea0ca6a => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:44.776886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:44.779181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:44.889727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f19b3d0b79145ab891d0040cd66baf6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.913960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f19b3d0b79145ab891d0040cd66baf6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.914722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f19b3d0b79145ab891d0040cd66baf6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.915513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc92b0e9-8725-4ec9-9495-00f63be68083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f19b3d0b79145ab891d0040cd66baf6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:44.949944 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2956/5916] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:44 2022] DELETE /identity/v3/users/9f19b3d0b79145ab891d0040cd66baf6 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:44.952466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:44.953877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:44.954163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:44.967966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e005-b724-46be-8969-812db8373f68 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:44.978292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:44.979461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:45.096528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2957/5917] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:45.144867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:45.145528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:45.145839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:45.146112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:45.146748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:45.148600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:45.152885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:45.162559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:45.191642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:45.311474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4d89-9c02-47ac-a6d1-171424676f72 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:45.333755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:45.334398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:45.334682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:45.334956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:45.358782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:45.360402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:45.363496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:45.389026 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2958/5918] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:45.409227 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2961/5919] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:44 2022] POST /identity/v3/domains => generated 278 bytes in 634 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:45.416553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:45.418621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:45.444804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c925fb-06f8-4223-9831-e6082908ebc2 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:45.615794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:45.616725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:45.617450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:45.617873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/a791894d300642a181994d48b60d06cf` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:45.638890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a791894d300642a181994d48b60d06cf)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:45.641856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:45.695072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:45.696209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:45.862589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:45.864479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:45.870848 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2959/5920] 10.222.0.64 () {60 vars in 1250 bytes} [Wed Nov 2 12:51:45 2022] PATCH /identity/v3/domains/a791894d300642a181994d48b60d06cf => generated 279 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:51:45.875480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:45.878254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:45.914189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561aad6-1b66-4aa8-95d8-54b0e95f571b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:46.134834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:46.135511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:46.135797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:46.136073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/a791894d300642a181994d48b60d06cf` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:46.178320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a791894d300642a181994d48b60d06cf)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:46.181282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:46.184552 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2962/5921] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:45 2022] GET /identity/v3/domains/a791894d300642a181994d48b60d06cf => generated 279 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:46.187672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:46.207440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece02a13-707a-4f26-978a-c5c573292550 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:46.222649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:46.224196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:46.225072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:46.225906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/a791894d300642a181994d48b60d06cf` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:46.227874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a791894d300642a181994d48b60d06cf)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:46.230644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:46.263015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.312378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a791894d300642a181994d48b60d06cf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.544101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.566853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.721792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.748757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project a791894d300642a181994d48b60d06cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:46.749069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.750881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.782508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.796199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.799101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a791894d300642a181994d48b60d06cf', 'request_id': 'req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:46.814274 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2960/5922] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:46 2022] DELETE /identity/v3/domains/a791894d300642a181994d48b60d06cf => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:46.818723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:46.820537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:46.847444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a755eb5-7b08-4360-8476-a1325fac6e43 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:46.965474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:46.966069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:46.966357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:46.967505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:46.968158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:46.970460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.021468 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2963/5923] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:51:46 2022] GET /identity/v3/domains => generated 1345 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:47.025535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.040542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc7bf6-5f01-4127-bb5a-64ca5ba0b5b9 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.057967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.059426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.062037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.062314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/a791894d300642a181994d48b60d06cf` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.077157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find domain: a791894d300642a181994d48b60d06cf.: keystone.exception.DomainNotFound: Could not find domain: a791894d300642a181994d48b60d06cf. Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a791894d300642a181994d48b60d06cf. Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:47.088336 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:47.089510 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a791894d300642a181994d48b60d06cf. Nov 02 12:51:47.090446 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:51:47.091666 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2961/5924] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:47 2022] PATCH /identity/v3/domains/a791894d300642a181994d48b60d06cf => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:47.098551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.114545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6dec4a-8724-4f7f-b3f6-1f14a4adbfe1 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.127220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.127860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.128406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.128847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.129876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:47.131627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.288044 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2964/5925] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:51:47 2022] POST /identity/v3/domains => generated 277 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:47.288674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.305824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407a4f-3f96-444e-947a-297deebee986 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.311693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:47.428895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.429797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.430228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.430645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.431497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:47.434144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.527895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.534700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:47.638197 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2962/5926] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:47 2022] POST /identity/v3/users => generated 346 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:47.643155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.666427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d252f7-40f5-4f0f-93b6-4b90873122d4 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.671390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d58ba1-9f6f-4d7e-9415-d97f967839ec tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.679905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.681138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.681428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.703006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/groups` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.709923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.710417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:47.711767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.713540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.714504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] PATH_INFO: `/v3/projects/084d0535f9c44eadbb5a5df0926ab59e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.717014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.721325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084d0535f9c44eadbb5a5df0926ab59e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:47.728052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.864280 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2963/5927] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:51:47 2022] POST /identity/v3/groups => generated 324 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:47.865523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:47.878739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df2fa7-a011-49ec-8592-0ac26db29228 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:47.901110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:47.902024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:47.904392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:47.904964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:47.907630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=bc1f5d21feae4fc79b17156c8c790bbc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:47.910504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:47.918140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084d0535f9c44eadbb5a5df0926ab59e', 'request_id': 'req-a2e1dd82-3760-4f63-a042-ab4a2a362e95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:47.931859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084d0535f9c44eadbb5a5df0926ab59e', 'request_id': 'req-a2e1dd82-3760-4f63-a042-ab4a2a362e95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:47.944574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084d0535f9c44eadbb5a5df0926ab59e', 'request_id': 'req-a2e1dd82-3760-4f63-a042-ab4a2a362e95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:47.960398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:47.961686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:47.985486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:48.072075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] The token cache is being invalidate because project 084d0535f9c44eadbb5a5df0926ab59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:48.072075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:48.081298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a2e1dd82-3760-4f63-a042-ab4a2a362e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:48.083630 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2965/5928] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:47 2022] DELETE /identity/v3/projects/084d0535f9c44eadbb5a5df0926ab59e => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:48.089194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501f81-ab50-4923-99bf-b2fe028f527b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.089518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501f81-ab50-4923-99bf-b2fe028f527b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.089743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9501f81-ab50-4923-99bf-b2fe028f527b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.123271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e9501f81-ab50-4923-99bf-b2fe028f527b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:48.124652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e9501f81-ab50-4923-99bf-b2fe028f527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:48.151460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:48.154484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:48.171372 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2964/5929] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:47 2022] PATCH /identity/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc => generated 278 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:48.174916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:48.180139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:48.293224 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2966/5930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:48.302910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.303232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.303858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.328096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e1313-40bb-4d75-b986-71876476b968 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:48.342346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:48.343280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:48.344244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.349633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.349633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.349828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:48.370942 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2967/5931] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:48.375104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:48.381381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=bc1f5d21feae4fc79b17156c8c790bbc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:48.383999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:48.397578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466dc02-44c0-4fe2-88ab-de4e463469ee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:48.417458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:48.418325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.418613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.418886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.419553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:48.419856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:48.421498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:48.430922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:48.452883 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2968/5932] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:51:48.457335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:48.479029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a557a2-94ed-4043-8521-02bbe52e5bca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:48.503320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:48.504041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.505497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.505789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.512574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:48.526591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:48.741321 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2969/5933] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:48 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:48.745837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:48.908033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bdd80-3024-4e13-8f39-41ab67ecfc20 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:48.934187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:48.935098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:48.936439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:48.936812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:48.937615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:48.950940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:49.002630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efc764173424b758b3d113ea8862c3c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.140411 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2970/5934] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:48 2022] POST /identity/v3/users => generated 287 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:49.144873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:49.164473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95087146-e613-4bfe-bf3b-a9d333eb0e94 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:49.170428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:49.171057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:49.171335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:49.171651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:49.172536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:49.174612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:49.185719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efc764173424b758b3d113ea8862c3c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.199373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2971/5935] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:51:49.207401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:49.227547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efc764173424b758b3d113ea8862c3c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.228328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efc764173424b758b3d113ea8862c3c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.229093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efc764173424b758b3d113ea8862c3c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.249467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870d9f-2333-4085-a422-8f60ca8e33ea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:49.256157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.258361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:49.261525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:49.261839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:49.262116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:49.263720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:49.274310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:49.311594 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2972/5936] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:49.316365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:49.319307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:49.355292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987d254-cdb9-4332-94a3-993e95eb2066 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:49.452995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.466661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.514457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:49.514754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:49.515088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:49.515327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] PATH_INFO: `/v3/projects/ee6e286daa4043ba9a0eb4a9374a7dd1/users/9744df9329894558b09b647df656c49f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:49.555473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6e286daa4043ba9a0eb4a9374a7dd1, user_id=9744df9329894558b09b647df656c49f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:49.558864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:49.591589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.611978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project bc1f5d21feae4fc79b17156c8c790bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:49.612560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.614000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.631353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.635771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.637873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bc1f5d21feae4fc79b17156c8c790bbc', 'request_id': 'req-68590a3e-ae1f-47c0-8305-c4b1a5d5bfe6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:49.679276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2973/5937] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:49 2022] PUT /identity/v3/projects/ee6e286daa4043ba9a0eb4a9374a7dd1/users/9744df9329894558b09b647df656c49f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:49.680034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:49.685675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:49.701261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:49.703308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2965/5938] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:48 2022] DELETE /identity/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc => generated 0 bytes in 1526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:49.720966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:49.721692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:49.724224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:49.801985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] MFA Rules not processed for user `9744df9329894558b09b647df656c49f`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:49.803244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:49.854617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc87ee8-b3c5-47f1-86ad-c2708b87897e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:49.870792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:49.872737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:49.873261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:49.873661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:49.877266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:49.896999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:49.899642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:49.936844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2974/5939] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:49.938612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:49.950301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:49.999016 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2966/5940] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:50.011854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.018635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:50.127836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fff4ec-10a4-4892-9abb-0524b2044dde service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.135623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.137177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.138532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.139185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.157568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=bc1f5d21feae4fc79b17156c8c790bbc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.160061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffaecf-ab67-4532-9cb1-d9e37abf120a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.162827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.167233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.168882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.169231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.169579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.170286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.173521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc.: keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.182040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.182914 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.183726 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.193329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2975/5941] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:49 2022] GET /identity/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:50.196912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.211124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7476e9-e3a4-4afd-8333-a0ca54f8418b tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.216864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.218489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.219516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.219857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/users/8efc764173424b758b3d113ea8862c3c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.239226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:get_user(user_id=8efc764173424b758b3d113ea8862c3c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.242085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.269238 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2967/5942] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:50 2022] POST /identity/v3/projects => generated 371 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find user: 8efc764173424b758b3d113ea8862c3c.: keystone.exception.UserNotFound: Could not find user: 8efc764173424b758b3d113ea8862c3c. Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_user(user_id) Nov 02 12:51:50.270868 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.271853 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8efc764173424b758b3d113ea8862c3c. Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.272745 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2976/5943] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/users/8efc764173424b758b3d113ea8862c3c => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:50.275166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.277800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.290863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7882d-beef-4493-af7e-94fe592418ce tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.405210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.407611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.407976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.408260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/groups/222117bbec18416db8e9e84898b08c23` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.416408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:get_group(group_id=222117bbec18416db8e9e84898b08c23)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.424649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.448412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276f45-8ddd-4ef0-bbcd-c6fe104eb702 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find group: 222117bbec18416db8e9e84898b08c23.: keystone.exception.GroupNotFound: Could not find group: 222117bbec18416db8e9e84898b08c23. Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_group(group_id) Nov 02 12:51:50.459664 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.460646 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 222117bbec18416db8e9e84898b08c23. Nov 02 12:51:50.461468 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.462039 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2977/5944] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/groups/222117bbec18416db8e9e84898b08c23 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:50.463903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.464563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.465128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.465415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.466056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.467791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.471396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.486741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5765-af6b-44a8-bf1d-f08228b51c64 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.500563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.501571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.501852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.502122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/groups/222117bbec18416db8e9e84898b08c23` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.514374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find group: 222117bbec18416db8e9e84898b08c23.: keystone.exception.GroupNotFound: Could not find group: 222117bbec18416db8e9e84898b08c23. Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Nov 02 12:51:50.533654 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.534434 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 222117bbec18416db8e9e84898b08c23. Nov 02 12:51:50.535233 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.540631 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2978/5945] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:51:50 2022] DELETE /identity/v3/groups/222117bbec18416db8e9e84898b08c23 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:50.545749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.567188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3490e-5bdc-45f1-942b-28d67c9b3a05 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.573217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.575115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.575586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.576064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/users/8efc764173424b758b3d113ea8862c3c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.603429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8efc764173424b758b3d113ea8862c3c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.606285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.635917 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2968/5946] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:50 2022] POST /identity/v3/users => generated 292 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:50.640470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find user: 8efc764173424b758b3d113ea8862c3c.: keystone.exception.UserNotFound: Could not find user: 8efc764173424b758b3d113ea8862c3c. Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Nov 02 12:51:50.641367 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.642076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 8efc764173424b758b3d113ea8862c3c. Nov 02 12:51:50.642999 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.643872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2979/5947] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:50 2022] DELETE /identity/v3/users/8efc764173424b758b3d113ea8862c3c => generated 110 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:50.653378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.667710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23356-cc5d-43f5-a9d1-dc67c5863c7d tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.673788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e02b76-5e94-4776-89ec-0fc2d1ddab50 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.691728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.691728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.691728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.692123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.704529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:50.704899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.705724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.707305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.707798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc.: keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:50.710328 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:50.715074 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:50.716478 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:50.718010 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2980/5948] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:50 2022] PATCH /identity/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc => generated 112 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Nov 02 12:51:50.721702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.721996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.726740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.741852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180239b-f630-4d85-9196-63f4e8782e2f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.754744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.755372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.755649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.755923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.756638 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2969/5949] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:50.757011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.758707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.761200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.784971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addb2ce-66ea-4c57-81b3-5f7fdce86ef1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.794459 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2981/5950] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/domains => generated 1345 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:50.799740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.801319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.802604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.802883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.803154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] PATH_INFO: `/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8/users/ebd37cd2cc254709a64a6e7565ac8f14/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.823214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f7111-5313-41c9-9b15-af5c488f431e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.831204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004f916c7aa64f36a7c33d2b6a3babd8, user_id=ebd37cd2cc254709a64a6e7565ac8f14, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.833891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.834193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.834624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.834905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.835280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.835941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:50.836244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.838933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.872179 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2982/5951] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/domains?enabled=True => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:50.873905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.884109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6d9c0-6e79-4a17-9db6-4fbd25506a61 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.892040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:50.896784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:50.896784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:50.896784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:50.896784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-790612033) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:50.896784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:50.897220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:50.897295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:50.911384 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2983/5952] 10.222.0.64 () {58 vars in 1197 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/domains?name=tempest-test_domain-790612033 => generated 407 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:50.917752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:50.941283 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2970/5953] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:50 2022] PUT /identity/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8/users/ebd37cd2cc254709a64a6e7565ac8f14/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:50.942012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7635d-3a5f-44df-8016-a6410e75308e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:50.942692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.032725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.033693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.034301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.034818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.054576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-29ddbb01-7c4f-4ace-aa1b-9250a57a80df tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc.: keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:51.072894 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:51:51.073875 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: bc1f5d21feae4fc79b17156c8c790bbc. Nov 02 12:51:51.074819 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:51.084273 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2984/5954] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:50 2022] PATCH /identity/v3/domains/bc1f5d21feae4fc79b17156c8c790bbc => generated 112 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:51:51.087540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.088737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc5308-dced-4ad6-adf6-3d57542952c2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.089077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.089508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.096400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.098243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.098677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.099072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.099867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.102119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.119541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] MFA Rules not processed for user `c94845bcdb1140f4b4841b1bf916d059`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:51.120904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:51.135486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2971/5955] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:51.141328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.178301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f1470-b4ff-4251-89de-3f144c1d8dc8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.195808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.196556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.196850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.197132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/394b164064024a129da0e858b118823d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.210825 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2985/5956] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:51.211479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.216764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=394b164064024a129da0e858b118823d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.220037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b232f9-3626-4a35-a456-cae898cd8471 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.239874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293486d6-dffa-4046-90a6-0190dfe68fe0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.261305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.261990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.262273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.262549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] PATH_INFO: `/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8/users/ebd37cd2cc254709a64a6e7565ac8f14/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.270571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004f916c7aa64f36a7c33d2b6a3babd8, user_id=ebd37cd2cc254709a64a6e7565ac8f14, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.273351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.294911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2986/5957] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:51 2022] PUT /identity/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8/users/ebd37cd2cc254709a64a6e7565ac8f14/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:51.295899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.298907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:51.317562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2972/5958] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:51 2022] PATCH /identity/v3/domains/394b164064024a129da0e858b118823d => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:51.320018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.320470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.320887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.390839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] MFA Rules not processed for user `ebd37cd2cc254709a64a6e7565ac8f14`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:51.393250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:51.414801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57f37b-5abf-4fe2-96ce-17b7e5f9aa98 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.418927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.419565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.426406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.426406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.426406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:51.517471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.519499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.520265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2973/5959] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:51.521348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.537870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2987/5960] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:51.538915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.552958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db96fe5-3e9f-48b7-8310-fa06e623f696 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.559256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd37cd2cc254709a64a6e7565ac8f14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '004f916c7aa64f36a7c33d2b6a3babd8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.560417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.560837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.561713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.562183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:51.562635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.565469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.584198 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2988/5961] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:51.589920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.601496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59b58-67b7-4251-82a4-bc50dedb263d tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.606412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd37cd2cc254709a64a6e7565ac8f14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '004f916c7aa64f36a7c33d2b6a3babd8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.607034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.607308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.607579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.608223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.611104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.617309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8a520-af24-498d-a7c9-d1a0fdc76cd7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.626711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.627670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.627951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.628226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/394b164064024a129da0e858b118823d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.645295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=394b164064024a129da0e858b118823d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.645743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.675410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '394b164064024a129da0e858b118823d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.686724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '394b164064024a129da0e858b118823d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.705905 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2989/5962] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:51 2022] POST /identity/v3/projects => generated 350 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:51.707212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.711676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:51.794069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db4a9-691e-4aea-ba7a-6d249b461886 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.801420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd37cd2cc254709a64a6e7565ac8f14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '004f916c7aa64f36a7c33d2b6a3babd8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:51.802899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:51.802899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:51.802899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:51.803575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:51.803940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:51.805682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:51.823704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2990/5963] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:51.850290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:51.853958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:51.856852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.870822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.931686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443f279-b72e-4ba7-b00e-8521089bae29 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:51.950587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.965524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project 394b164064024a129da0e858b118823d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:51.966011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.966794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.977233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.982328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.982529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '394b164064024a129da0e858b118823d', 'request_id': 'req-96ec6ff4-28df-4aee-b8f4-19568329aad3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:51.992153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:51.995887 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2974/5964] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:51 2022] DELETE /identity/v3/domains/394b164064024a129da0e858b118823d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:52.002964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:52.005540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:52.041844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:52.042822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:52.045213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:52.045213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:52.045830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:52.110319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec6ff4-28df-4aee-b8f4-19568329aad3 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:52.118037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:52.118346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:52.118609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:52.119025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/ce18d2bd84494b8ba405755cfd46444f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:52.139679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce18d2bd84494b8ba405755cfd46444f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:52.141959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:52.192604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.193700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.212661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:52.214416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c020c0-b02a-44f8-ad05-52282e622c3e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:52.229142 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2991/5965] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:52.231196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:52.231685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:52.232229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:51:52.241179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:51:52.242095 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:51:52.243925 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2992/5966] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:51:52 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:51:52.365443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.366788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.372178 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2975/5967] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:52 2022] PATCH /identity/v3/domains/ce18d2bd84494b8ba405755cfd46444f => generated 277 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:52.375612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:52.377915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:52.481197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:52.494375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:52.495487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:52.495766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:52.496067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/ce18d2bd84494b8ba405755cfd46444f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:52.519631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce18d2bd84494b8ba405755cfd46444f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:52.521467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:52.558780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.568086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.710925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.719847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.729539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.811567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project ce18d2bd84494b8ba405755cfd46444f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:52.812914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.816250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.832724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.838452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.839568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce18d2bd84494b8ba405755cfd46444f', 'request_id': 'req-1c1fefba-8f61-4ee4-a315-bf9283b33760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:52.851329 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2993/5968] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:52 2022] DELETE /identity/v3/domains/ce18d2bd84494b8ba405755cfd46444f => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:52.855093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:52.869730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82c759-9ed8-448f-9c46-d5d5bb5fc73f tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:52.975350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:52.975350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:52.975350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:52.975884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/693c09230c3c44188be561b815f36027` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:52.990577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=693c09230c3c44188be561b815f36027)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:52.992451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:53.021938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.022873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.180042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:53.202134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.204922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.212783 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2976/5969] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:51:52 2022] PATCH /identity/v3/domains/693c09230c3c44188be561b815f36027 => generated 277 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:51:53.219845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:53.221825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:53.245256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fefba-8f61-4ee4-a315-bf9283b33760 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:53.384860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2acbe1740e1f4202be3c7809ac95bcdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eae14a2b44734a4eab3d2259fa9b33c6', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:53.385772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:53.386623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:53.387163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] PATH_INFO: `/v3/domains/693c09230c3c44188be561b815f36027` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:53.395984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:53.397662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:53.405115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=693c09230c3c44188be561b815f36027)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:53.410434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:53.452719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.460378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '693c09230c3c44188be561b815f36027'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.550118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f7e3-c7c2-4e43-9779-cc156038627e tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:53.571075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:53.572106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:53.573205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:53.573888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] PATH_INFO: `/v3/users/ea9c0f07fdde4b56be39fca015883797` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:53.575931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9c0f07fdde4b56be39fca015883797)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:53.579881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:53.641937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.653569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.664056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.694604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:53.785452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] The token cache is being invalidate because project 693c09230c3c44188be561b815f36027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:53.785898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.786560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.801935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.805825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.806564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '693c09230c3c44188be561b815f36027', 'request_id': 'req-515d0775-d925-45e7-9148-5282b2e99019'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.814594 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2994/5970] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:51:53 2022] DELETE /identity/v3/domains/693c09230c3c44188be561b815f36027 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:53.818799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:53.820030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:53.933707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9c0f07fdde4b56be39fca015883797'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:53.966846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0775-d925-45e7-9148-5282b2e99019 tempest-DomainsTestJSON-1553259932 tempest-DomainsTestJSON-1553259932-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:53.973797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:53.974635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:53.975042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:53.975424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] PATH_INFO: `/v3/users/34c4573c3a504046a51421db983a2eb4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:53.976987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c4573c3a504046a51421db983a2eb4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:53.980164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:54.071631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9c0f07fdde4b56be39fca015883797'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.137862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9c0f07fdde4b56be39fca015883797'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.148923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9c0f07fdde4b56be39fca015883797'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.153716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee44b63a-3f37-48d7-a27b-c107f1193b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9c0f07fdde4b56be39fca015883797'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.179006 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2977/5971] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:53 2022] DELETE /identity/v3/users/ea9c0f07fdde4b56be39fca015883797 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:54.181123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:54.181464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:54.181869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:54.213094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:54.220154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.308974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c4573c3a504046a51421db983a2eb4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.342197 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2978/5972] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:54.362601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:54.364531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.458789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c4573c3a504046a51421db983a2eb4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.491907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c4573c3a504046a51421db983a2eb4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.501972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b8e26-14cb-4542-ab48-c43bed38b724 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:54.508391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c4573c3a504046a51421db983a2eb4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.510400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c4573c3a504046a51421db983a2eb4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:54.511737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:54.521027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:54.521027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:54.521027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:54.521027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.525936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2995/5973] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:53 2022] DELETE /identity/v3/users/34c4573c3a504046a51421db983a2eb4 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:51:54.526820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:54.533834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.551482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:54.555259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558df5c9-6fd9-455f-abad-341acd715b08 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:54.581513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2979/5974] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:54.583066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:54.583348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:54.583772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:54.613986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:54.615447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.656244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7986c7c-71c6-49a3-b36d-c2c3d9d9623a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:54.662360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:54.663464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:54.663967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:54.665051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] PATH_INFO: `/v3/users/ccc8b7131f8c4b08997746b1a49b996a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:54.666679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc8b7131f8c4b08997746b1a49b996a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:54.669411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:54.771266 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2980/5975] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:54.809065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:54.809793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:54.913511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e805209-d6b0-4d92-9f90-ea89c7558097 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:54.927173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:54.928004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:54.928414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:54.928823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:54.945643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:54.947532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a28a7b-db34-4d9b-b194-37e5456da0f0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:54.959779 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2981/5976] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:51:55.040228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc8b7131f8c4b08997746b1a49b996a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:55.128331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc8b7131f8c4b08997746b1a49b996a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:55.146183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc8b7131f8c4b08997746b1a49b996a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:55.165661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc8b7131f8c4b08997746b1a49b996a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:55.167034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc8b7131f8c4b08997746b1a49b996a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:55.192188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2996/5977] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:54 2022] DELETE /identity/v3/users/ccc8b7131f8c4b08997746b1a49b996a => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:55.197617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:55.197913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:55.198975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:55.229564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:55.231370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:55.355533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2982/5978] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:55.386822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:55.391235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:55.463746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a7fda-eb50-46ee-8ee5-25963ce7896a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:55.468891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:55.469830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:55.470291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:55.470741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:55.482189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:55.483986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444985d-24cf-439c-9fbf-cbbfcbd9d805 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:55.497590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2997/5979] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:51:55.790943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:55.794405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:55.812204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1373a7a-a601-442d-888d-8c6b722525a1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:55.831372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:55.832123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:55.832414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:55.832718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] PATH_INFO: `/v3/projects/e50490f448cd46158427d5122f3528b8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:55.834501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50490f448cd46158427d5122f3528b8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:55.836444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:56.085376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50490f448cd46158427d5122f3528b8', 'request_id': 'req-5941c770-d42f-4641-bd2e-c99168d46f7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:56.105343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50490f448cd46158427d5122f3528b8', 'request_id': 'req-5941c770-d42f-4641-bd2e-c99168d46f7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:56.208605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:56.299156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50490f448cd46158427d5122f3528b8', 'request_id': 'req-5941c770-d42f-4641-bd2e-c99168d46f7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:56.313931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] The token cache is being invalidate because project e50490f448cd46158427d5122f3528b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:56.314288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:56.321122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5941c770-d42f-4641-bd2e-c99168d46f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:56.326074 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2983/5980] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:55 2022] DELETE /identity/v3/projects/e50490f448cd46158427d5122f3528b8 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:56.331399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:56.331830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:56.331911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:56.374402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:56.376072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:56.509676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2998/5981] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:56.510805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:56.511251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:56.521319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:56.580758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:56.582267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:56.602352 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2984/5982] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:51:56.606472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:56.631609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a05f-62ce-46f8-9141-92c21dcb30f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:56.643039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:56.643977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:56.644470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:56.645493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:56.646981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:51:56.647869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:56.654103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:56.685334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 2999/5983] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:51:56.692138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:56.710819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ae1c0-d993-4d33-b774-7ae6cbfa81b1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:56.719173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:56.719989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:56.720740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:56.720740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:56.721928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:56.733577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:56.900810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:56.945589 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2985/5984] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:56 2022] POST /identity/v3/projects => generated 405 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:56.952446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:56.976335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3917387-1877-403c-ac4c-4af739cfe53b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:56.994892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:57.003611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:57.209705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:57.213005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:57.213531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:57.214128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:57.216234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:57.221136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:57.225586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf335d7-899b-4b71-b2a7-60f9bb0bb8ff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:57.245857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:57.250999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:57.250999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:57.250999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] PATH_INFO: `/v3/projects/38c1b2933a3449938af453c0c287feb9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:57.250999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c1b2933a3449938af453c0c287feb9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:57.253696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:57.388517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3000/5985] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:56 2022] POST /identity/v3/users => generated 303 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:57.399654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:57.420260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c1b2933a3449938af453c0c287feb9', 'request_id': 'req-dacc4414-42bc-4441-a8ba-6a273beb4eb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:57.433760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954aa4f9-916d-437c-8ff5-69f146e1ee1d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:57.455249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c1b2933a3449938af453c0c287feb9', 'request_id': 'req-dacc4414-42bc-4441-a8ba-6a273beb4eb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:57.579097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c1b2933a3449938af453c0c287feb9', 'request_id': 'req-dacc4414-42bc-4441-a8ba-6a273beb4eb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:57.597755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:57.598406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:57.598687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:57.599076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:57.599672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:57.600445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] The token cache is being invalidate because project 38c1b2933a3449938af453c0c287feb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:57.601328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:57.602313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:57.614712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:57.619412 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2986/5986] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:56 2022] DELETE /identity/v3/projects/38c1b2933a3449938af453c0c287feb9 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:57.620071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:57.626529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3001/5987] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:57.627241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:57.630839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:57.633268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:57.671249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b679b-8d7e-47a6-a82d-d5b4a4d3b2ac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:57.672171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc4414-42bc-4441-a8ba-6a273beb4eb5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:57.672318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:57.672517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:57.672692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:57.673006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] PATH_INFO: `/v3/users/2acbe1740e1f4202be3c7809ac95bcdb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:57.673813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:57.674484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:57.674766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:57.675044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] PATH_INFO: `/v3/projects/a933d31c685447899b2c9c8c1f1bf424` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:57.676238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a933d31c685447899b2c9c8c1f1bf424)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:57.685941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2acbe1740e1f4202be3c7809ac95bcdb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:57.685941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:57.689242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:58.061549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a933d31c685447899b2c9c8c1f1bf424', 'request_id': 'req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.072204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a933d31c685447899b2c9c8c1f1bf424', 'request_id': 'req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.098343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2acbe1740e1f4202be3c7809ac95bcdb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.168973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:58.207358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a933d31c685447899b2c9c8c1f1bf424', 'request_id': 'req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.237227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] The token cache is being invalidate because project a933d31c685447899b2c9c8c1f1bf424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:51:58.237543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.238179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.242767 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2987/5988] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:57 2022] DELETE /identity/v3/projects/a933d31c685447899b2c9c8c1f1bf424 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:58.242767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:58.243012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:58.351881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad059f34-3cfb-4975-bfdc-3d53cf519b1d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:58.360884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:58.361938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:58.362364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:58.363816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:58.364732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:58.368077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:58.384304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2988/5989] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:58.385837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:58.388126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:58.395466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2acbe1740e1f4202be3c7809ac95bcdb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.409365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7f36e-f167-4ac3-85ae-515da6ce9f56 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:58.416254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:58.418208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:58.418208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:58.418669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] PATH_INFO: `/v3/users/3f2d0c6d63c645c993b0d036743ac221` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:58.420669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2d0c6d63c645c993b0d036743ac221)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:58.420798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2acbe1740e1f4202be3c7809ac95bcdb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.423803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:58.443574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2acbe1740e1f4202be3c7809ac95bcdb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.445324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2acbe1740e1f4202be3c7809ac95bcdb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.460972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3002/5990] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:57 2022] DELETE /identity/v3/users/2acbe1740e1f4202be3c7809ac95bcdb => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:58.462361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:58.469767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:58.564207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd0b940-d6f8-4677-aef3-b7adc70bca6c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:58.571109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:58.572979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:58.573471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:58.574442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] PATH_INFO: `/v3/projects/e2cb8eabd39f4f7b982e98e88e0fb925/users/51418bce2c1c4137bf6c3cd1eb9c7bda/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:58.596731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2cb8eabd39f4f7b982e98e88e0fb925, user_id=51418bce2c1c4137bf6c3cd1eb9c7bda, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:58.601343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2432d-63be-4887-9864-fadb65e6b1f7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:58.632242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:58.760255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2d0c6d63c645c993b0d036743ac221'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.792603 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3003/5991] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:58 2022] PUT /identity/v3/projects/e2cb8eabd39f4f7b982e98e88e0fb925/users/51418bce2c1c4137bf6c3cd1eb9c7bda/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:58.794964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:58.795249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:58.795700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:58.838478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] MFA Rules not processed for user `51418bce2c1c4137bf6c3cd1eb9c7bda`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:51:58.841605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:58.922501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2d0c6d63c645c993b0d036743ac221'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.946307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2d0c6d63c645c993b0d036743ac221'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.947538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2d0c6d63c645c993b0d036743ac221'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.948453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2d0c6d63c645c993b0d036743ac221'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:51:58.958551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3004/5992] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:51:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:51:58.967125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:58.972560 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2989/5993] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:51:58 2022] DELETE /identity/v3/users/3f2d0c6d63c645c993b0d036743ac221 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:59.120013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa47e-9c61-43c7-94d7-aa6a37e47d42 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:59.258003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:59.259070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:59.259360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:59.259634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:59.261123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:59.263307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:59.436090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:59.438980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:59.445615 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3005/5994] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:51:58 2022] POST /identity/v3/projects => generated 403 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:51:59.460891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa58e5-a8be-418b-892b-8d389e6e079e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:59.547613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:59.548338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:59.549206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:59.549560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:59.550292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:59.553277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:59.660041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:59.661769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:51:59.662902 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2990/5995] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:51:59 2022] POST /identity/v3/users => generated 308 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:51:59.668520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:59.717110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db462ece-8c78-44f8-8ef9-efecf9ecea65 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:59.729236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:59.737573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:59.738422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:59.738879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:59.741050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:59.749867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:59.767401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2991/5996] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:51:59.767588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e088d-ee88-4735-b76a-f12d3317d3cc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:59.768756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:59.778103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebd37cd2cc254709a64a6e7565ac8f14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '004f916c7aa64f36a7c33d2b6a3babd8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:59.779007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:59.781095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:59.781095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] PATH_INFO: `/v3/projects/f218c0e40d424186af38024f3ec91eb3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:59.782583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f218c0e40d424186af38024f3ec91eb3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:59.788472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:59.800606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789b422-653e-4fff-a14f-3180db3ad3dd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:51:59.820864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:51:59.821741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:51:59.822025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:51:59.822568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] PATH_INFO: `/v3/projects/3a15a336a72c4feba37270cea19ccde9/users/0a009c160cde41ca9a0d92018de50daa/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:51:59.865538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a15a336a72c4feba37270cea19ccde9, user_id=0a009c160cde41ca9a0d92018de50daa, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:51:59.868540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:51:59.980933 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2992/5997] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:51:59 2022] PUT /identity/v3/projects/3a15a336a72c4feba37270cea19ccde9/users/0a009c160cde41ca9a0d92018de50daa/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:51:59.987748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:51:59.990340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:00.006046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:00.008854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f218c0e40d424186af38024f3ec91eb3', 'request_id': 'req-fcf8b04a-7e34-4d8b-9f65-03a76b409456'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.025968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f218c0e40d424186af38024f3ec91eb3', 'request_id': 'req-fcf8b04a-7e34-4d8b-9f65-03a76b409456'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.043357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f218c0e40d424186af38024f3ec91eb3', 'request_id': 'req-fcf8b04a-7e34-4d8b-9f65-03a76b409456'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.125224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19399f-432c-4c4e-aab2-444181af86b1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:00.161291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] The token cache is being invalidate because project f218c0e40d424186af38024f3ec91eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:00.161677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.163307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.171904 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3006/5998] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:59 2022] DELETE /identity/v3/projects/f218c0e40d424186af38024f3ec91eb3 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:00.171904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:00.173113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:00.264554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:00.282464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:00.283124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.283396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.284250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] PATH_INFO: `/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:00.292669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae14a2b44734a4eab3d2259fa9b33c6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:00.296735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:00.329780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8b04a-7e34-4d8b-9f65-03a76b409456 tempest-QuotasNegativeTest-287456400 tempest-QuotasNegativeTest-287456400-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:00.332231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:00.332889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.333362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.333639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:00.334294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:00.336341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:00.355964 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3007/5999] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:00.355964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:00.357934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:00.380190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b496f1d-5740-459e-a9ec-11df85767e7a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:00.387331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:00.389144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.389494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.390999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] PATH_INFO: `/v3/users/9744df9329894558b09b647df656c49f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:00.393279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9744df9329894558b09b647df656c49f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:00.397050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:00.464224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae14a2b44734a4eab3d2259fa9b33c6', 'request_id': 'req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.473492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae14a2b44734a4eab3d2259fa9b33c6', 'request_id': 'req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.597167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae14a2b44734a4eab3d2259fa9b33c6', 'request_id': 'req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.626386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] The token cache is being invalidate because project eae14a2b44734a4eab3d2259fa9b33c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:00.627065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.631794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.642427 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2993/6000] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:51:59 2022] DELETE /identity/v3/projects/eae14a2b44734a4eab3d2259fa9b33c6 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:00.645761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:00.647863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:00.752148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9744df9329894558b09b647df656c49f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.842371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060e7c-1915-42a4-ae51-ef26bd3c5b57 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:00.848158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:00.849167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.849457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.849730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] PATH_INFO: `/v3/projects/3a15a336a72c4feba37270cea19ccde9/users/0a009c160cde41ca9a0d92018de50daa/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:00.852179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a15a336a72c4feba37270cea19ccde9, user_id=0a009c160cde41ca9a0d92018de50daa, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:00.856454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bd886-2305-45de-8ed5-1fab6acb091f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:00.869883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2994/6001] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:00 2022] PUT /identity/v3/projects/3a15a336a72c4feba37270cea19ccde9/users/0a009c160cde41ca9a0d92018de50daa/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:00.872104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.872104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.872584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:00.915811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9744df9329894558b09b647df656c49f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.918400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:00.922396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:00.942855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9744df9329894558b09b647df656c49f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.954507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9744df9329894558b09b647df656c49f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.955700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d508efd5-d6df-4a87-a584-1186729814cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9744df9329894558b09b647df656c49f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:00.967859 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3008/6002] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:00 2022] DELETE /identity/v3/users/9744df9329894558b09b647df656c49f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:00.968821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b81f2-721c-4689-aa80-e5f8395a3795 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:00.969108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b81f2-721c-4689-aa80-e5f8395a3795 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:00.969378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b81f2-721c-4689-aa80-e5f8395a3795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.072898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ac1b81f2-721c-4689-aa80-e5f8395a3795 None None] MFA Rules not processed for user `0a009c160cde41ca9a0d92018de50daa`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:01.085365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac1b81f2-721c-4689-aa80-e5f8395a3795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.085571 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2995/6003] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:01.085571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:01.087598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.115827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64fdf5-2725-48b4-8b0c-8ce8ab78c962 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:01.180137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3009/6004] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:01.182789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c6c-4585-4a6a-ab88-52c51670e282 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:01.183174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c6c-4585-4a6a-ab88-52c51670e282 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:01.183459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61c6c-4585-4a6a-ab88-52c51670e282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.246636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1da61c6c-4585-4a6a-ab88-52c51670e282 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:01.249504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1da61c6c-4585-4a6a-ab88-52c51670e282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.266440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:01.266635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:01.266900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:01.267341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] PATH_INFO: `/v3/projects/933672265df34465864f2b62b9247c6c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.269243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933672265df34465864f2b62b9247c6c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:01.271899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:01.279354 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3010/6005] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:01.303622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:01.303622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:01.303622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.336654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:01.339135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.364186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3011/6006] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:01.365381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:01.368715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.527687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933672265df34465864f2b62b9247c6c', 'request_id': 'req-10eb070d-14d9-4d90-8672-380b3979cb21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:01.546817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933672265df34465864f2b62b9247c6c', 'request_id': 'req-10eb070d-14d9-4d90-8672-380b3979cb21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:01.559327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756438a2-62ec-42e8-a4b2-c2cf0ce5fa4a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:01.642273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933672265df34465864f2b62b9247c6c', 'request_id': 'req-10eb070d-14d9-4d90-8672-380b3979cb21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:01.660412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] The token cache is being invalidate because project 933672265df34465864f2b62b9247c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:01.660633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:01.663914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:01.670204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2996/6007] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:01 2022] DELETE /identity/v3/projects/933672265df34465864f2b62b9247c6c => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:01.670994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:01.672993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.703102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:01.703740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:01.703996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:01.704278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.711113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.804588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb070d-14d9-4d90-8672-380b3979cb21 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:01.807866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:01.817276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:01.817938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:01.818219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:01.818507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:01.822397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.881531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:01.883010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:01.899043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3012/6008] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:01.899675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:01.903499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:01.983005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:01.985563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8689ba-f6cc-4355-a928-d8f2af2ec1bc service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.011628 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2997/6009] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:02.016245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734dd36-3de0-427f-83fd-2ba52153bc05 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.016911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734dd36-3de0-427f-83fd-2ba52153bc05 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.017400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734dd36-3de0-427f-83fd-2ba52153bc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.060689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aebd22-c276-4dab-97df-c3a9f2cd32fd service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.064916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4734dd36-3de0-427f-83fd-2ba52153bc05 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:02.066167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4734dd36-3de0-427f-83fd-2ba52153bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:02.070979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.072302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.073496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.074419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.075282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:02.075880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.078308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.096695 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2998/6010] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:02.098483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.098778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.099258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.105125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3013/6011] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:02.110607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:02.161591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e9260-6290-4560-81ea-55bfdbc7fd9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.168353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:02.177211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:02.177571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.178400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.178684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.178957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.179605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.182019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.216749 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 2999/6012] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:02.216749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:02.216749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:02.226898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:02.244606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862c726-332f-4215-b4e4-916c9e0000c8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.263565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.264618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.274398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.274398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] PATH_INFO: `/v3/users/51418bce2c1c4137bf6c3cd1eb9c7bda` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.274398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51418bce2c1c4137bf6c3cd1eb9c7bda)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.274398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.463533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3014/6013] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:02 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:02.464436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:02.585136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69650d-4e3a-41bf-a435-a688eeb97ff1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.590968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.591506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.591787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.592063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.593389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:02.593947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.597787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.617662 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3015/6014] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:02.618624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:02.648403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556435d3-5754-41f5-961b-bb46d7f6f658 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.654342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.655026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.656199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.656503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.657355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.659853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:02.787643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51418bce2c1c4137bf6c3cd1eb9c7bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:02.799710 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3016/6015] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:02 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:02.799710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:02.825117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da16976-7bcb-425d-8907-3287d6b28503 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:02.852873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:02.854672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:02.855717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:02.857246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:02.858028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:02.864307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.002034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51418bce2c1c4137bf6c3cd1eb9c7bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:03.024953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51418bce2c1c4137bf6c3cd1eb9c7bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:03.025977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51418bce2c1c4137bf6c3cd1eb9c7bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:03.026967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51418bce2c1c4137bf6c3cd1eb9c7bda'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:03.041932 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3017/6016] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:02 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:03.042905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.046356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.062523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3000/6017] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:02 2022] DELETE /identity/v3/users/51418bce2c1c4137bf6c3cd1eb9c7bda => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:03.063310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.066006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.199878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccacc4c-e986-4020-ab04-468826981009 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.216774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2367557a-0cea-4480-b197-dc9218c502a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.217707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.218698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.224274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.224274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.224274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.224274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b827a4b-b47a-40ef-8480-077377c6a20f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.232851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.234064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.234319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.234587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.235974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.237334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.248139 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3018/6018] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:03.251033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.254614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.254905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.280477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:03.281871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.291689 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3019/6019] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:03.292651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.306504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694315fe-3334-40ec-9001-d8db44a7704f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.313538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.314121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.314403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.314679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.315350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.317944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.332733 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3020/6020] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:03.337477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.354173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ea8e3-ecef-47d0-a3cd-4655fa549309 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.362982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.364305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.365021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.365636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] PATH_INFO: `/v3/projects/bd0198c698494a98a7b06756263cf241/users/f0c76b881ae74cd28915512391bdf262/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.390883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3001/6021] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:03 2022] POST /identity/v3/users => generated 290 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:03.416328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.416328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.424443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0198c698494a98a7b06756263cf241, user_id=f0c76b881ae74cd28915512391bdf262, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.432614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e41816-e6d9-40a3-930d-4b7c8bf7903c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.508284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be9bef-072a-4ce2-885e-af6b0db18df9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.519765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.520938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.521368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.521789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.543245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.543245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.556406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3002/6022] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:03.558053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.588281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249360-1860-44a4-a695-7b9cc8d83a63 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.596900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.597641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.598991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.599324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.600374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.605245 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3021/6023] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:03 2022] PUT /identity/v3/projects/bd0198c698494a98a7b06756263cf241/users/f0c76b881ae74cd28915512391bdf262/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:03.618470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.625542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.625828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.626123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.685288 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3003/6024] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:03.687014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.699176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] MFA Rules not processed for user `f0c76b881ae74cd28915512391bdf262`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:03.701310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9c1f6-ae4a-4bff-9a45-f8ea730ba046 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.701495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.814306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:03.840862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.841557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.841838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.842118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.842834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.845710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.857571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3022/6025] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:03.858817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.864993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:03.878599 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3004/6026] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:03.882338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:03.905699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dc418-3684-4cc5-a9b9-07520b6abdd5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.906759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f20a47-ea96-45a2-aa15-413e025860e9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:03.919580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.920567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.921359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.921981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] PATH_INFO: `/v3/projects/ee6e286daa4043ba9a0eb4a9374a7dd1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.923486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6e286daa4043ba9a0eb4a9374a7dd1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.925638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:03.926287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:03.926570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:03.931902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:03.931902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:03.932260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:03.932354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:04.070300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3005/6027] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:03 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:04.071336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:04.139012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6e286daa4043ba9a0eb4a9374a7dd1', 'request_id': 'req-e88b5402-6c5e-4457-a957-54f4e86c16eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:04.161017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6e286daa4043ba9a0eb4a9374a7dd1', 'request_id': 'req-e88b5402-6c5e-4457-a957-54f4e86c16eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:04.189580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6e286daa4043ba9a0eb4a9374a7dd1', 'request_id': 'req-e88b5402-6c5e-4457-a957-54f4e86c16eb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:04.240803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452560c-4370-42e2-9ca6-65f757947917 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:04.299103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] The token cache is being invalidate because project ee6e286daa4043ba9a0eb4a9374a7dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:04.308849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:04.308849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:04.308849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3023/6028] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:03 2022] DELETE /identity/v3/projects/ee6e286daa4043ba9a0eb4a9374a7dd1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:04.308849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:04.308849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:04.343777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:04.344746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:04.346334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:04.346651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] PATH_INFO: `/v3/projects/10a6938d401e44a3933549dbb7943abd/users/100f54b207074f79a3600c380b5d13bc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:04.374930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] RBAC: Authorizing `identity:create_grant(project_id=10a6938d401e44a3933549dbb7943abd, user_id=100f54b207074f79a3600c380b5d13bc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:04.379476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:04.443305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b5402-6c5e-4457-a957-54f4e86c16eb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:04.448680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:04.449312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:04.449591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:04.450634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:04.452017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:04.461025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210eb8d1-df4b-45f9-a497-c59fab4e86f4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:04.581553 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3006/6029] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:04 2022] PUT /identity/v3/projects/10a6938d401e44a3933549dbb7943abd/users/100f54b207074f79a3600c380b5d13bc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:04.582652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:04.584462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:04.686397 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3024/6030] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:04 2022] POST /identity/v3/users => generated 295 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:04.690892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:04.691278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:04.691557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:04.771820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c9fd-2b18-4ad0-b478-b9f3c99f44af admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:04.797057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:04.798101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:04.798596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:04.799099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] PATH_INFO: `/v3/users/ebd37cd2cc254709a64a6e7565ac8f14` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:04.805692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd37cd2cc254709a64a6e7565ac8f14)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:04.810479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:04.858244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] MFA Rules not processed for user `100f54b207074f79a3600c380b5d13bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:04.860049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:05.082451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:05.089134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd37cd2cc254709a64a6e7565ac8f14'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:05.120816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3025/6031] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:05.130512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.142450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0dd41-6d33-4ec3-86c0-8a17bfc5939a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:05.162893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:05.163536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.163813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.164082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.169642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:05.172222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:05.200128 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3026/6032] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:05.204406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.218157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a4a3-8c33-440a-939e-9022475584d6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:05.241365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:05.242909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.244340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.244964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] PATH_INFO: `/v3/projects/63ecf6583ba1457792647c6ed165d609/users/379e29b5833f4eae893d4c10a773c6cb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.280534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ecf6583ba1457792647c6ed165d609, user_id=379e29b5833f4eae893d4c10a773c6cb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:05.286863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd37cd2cc254709a64a6e7565ac8f14'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:05.292789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:05.313832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd37cd2cc254709a64a6e7565ac8f14'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:05.314455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd37cd2cc254709a64a6e7565ac8f14'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:05.319498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd37cd2cc254709a64a6e7565ac8f14'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:05.347894 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3007/6033] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:04 2022] DELETE /identity/v3/users/ebd37cd2cc254709a64a6e7565ac8f14 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:05.348799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.353482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:05.454232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4747fa-3399-4b7d-8de4-4605c3029220 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:05.457793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3027/6034] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:05 2022] PUT /identity/v3/projects/63ecf6583ba1457792647c6ed165d609/users/379e29b5833f4eae893d4c10a773c6cb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:05.461942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.467929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:05.573252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:05.574081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.574455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.574821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.577373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:05.607494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b5e5-7ad1-4086-8bbd-a78377637eac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:05.615055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:05.616000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.616580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.617099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.618081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:05.621044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:05.644680 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3028/6035] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:05.645972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.665961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a025d-3452-4881-8909-4b047f561f97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:05.673295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:05.674127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.674525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.674886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] PATH_INFO: `/v3/projects/63ecf6583ba1457792647c6ed165d609/users/379e29b5833f4eae893d4c10a773c6cb/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.680787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ecf6583ba1457792647c6ed165d609, user_id=379e29b5833f4eae893d4c10a773c6cb, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:05.683481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83930c76-8be4-4a4f-9ad4-90eb76fbfc9d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:05.698116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3029/6036] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:05 2022] PUT /identity/v3/projects/63ecf6583ba1457792647c6ed165d609/users/379e29b5833f4eae893d4c10a773c6cb/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:05.709976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:05.710914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:05.711370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:05.732236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:05.734256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:05.759706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3008/6037] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:05.761261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] MFA Rules not processed for user `379e29b5833f4eae893d4c10a773c6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:05.776633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:05.866386 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3030/6038] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:05.867167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.979397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:05.982170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:06.070285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f437b0-3b0d-4693-97eb-896148e9867d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:06.087638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:06.088539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:06.089028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:06.089479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:06.090718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:06.096479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:06.111058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e1361-25bc-4629-85b6-96f5ffde3f07 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:06.123941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:06.124795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:06.125377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:06.125658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] PATH_INFO: `/v3/users/c94845bcdb1140f4b4841b1bf916d059` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:06.134286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94845bcdb1140f4b4841b1bf916d059)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:06.136537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:06.257252 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3009/6039] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:05 2022] POST /identity/v3/projects => generated 333 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:06.258551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:06.274850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:06.417738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20037-9a23-42ac-bffc-2d535dee8f60 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:06.425628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:06.426277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:06.426608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:06.427008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] PATH_INFO: `/v3/projects/e2cb8eabd39f4f7b982e98e88e0fb925` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:06.429160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2cb8eabd39f4f7b982e98e88e0fb925)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:06.440130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:06.583645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94845bcdb1140f4b4841b1bf916d059'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.685698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2cb8eabd39f4f7b982e98e88e0fb925', 'request_id': 'req-9cac3553-6c67-45e3-951a-11a4158b92aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.694305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2cb8eabd39f4f7b982e98e88e0fb925', 'request_id': 'req-9cac3553-6c67-45e3-951a-11a4158b92aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.744393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94845bcdb1140f4b4841b1bf916d059'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.744904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:06.765159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94845bcdb1140f4b4841b1bf916d059'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.777693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94845bcdb1140f4b4841b1bf916d059'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.779001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94845bcdb1140f4b4841b1bf916d059'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.794529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3031/6040] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:05 2022] DELETE /identity/v3/users/c94845bcdb1140f4b4841b1bf916d059 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:06.801793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:06.824507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:06.895040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedd00-7cb8-466e-a40a-84c61e39b58d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:06.901023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:06.901660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:06.901941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:06.902218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:06.902853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:06.905309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:06.972390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2cb8eabd39f4f7b982e98e88e0fb925', 'request_id': 'req-9cac3553-6c67-45e3-951a-11a4158b92aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.986325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] The token cache is being invalidate because project e2cb8eabd39f4f7b982e98e88e0fb925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:06.987094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.988173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:06.993519 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3010/6041] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:06 2022] DELETE /identity/v3/projects/e2cb8eabd39f4f7b982e98e88e0fb925 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:06.996364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:06.999015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:07.101600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3553-6c67-45e3-951a-11a4158b92aa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:07.109829 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3032/6042] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:52:06 2022] POST /identity/v3/projects => generated 333 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:07.111135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:07.117722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:07.282573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:07.284425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:07.295526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:07.297597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] PATH_INFO: `/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:07.301678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004f916c7aa64f36a7c33d2b6a3babd8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:07.319746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:07.388698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754d472-d96a-4bda-a1ff-ebb3782fc7ac tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:07.396414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:07.397723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:07.398150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:07.398659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] PATH_INFO: `/v3/users/0a009c160cde41ca9a0d92018de50daa` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:07.428127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a009c160cde41ca9a0d92018de50daa)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:07.435831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:07.541888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004f916c7aa64f36a7c33d2b6a3babd8', 'request_id': 'req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.549348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004f916c7aa64f36a7c33d2b6a3babd8', 'request_id': 'req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.681451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004f916c7aa64f36a7c33d2b6a3babd8', 'request_id': 'req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.695775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] The token cache is being invalidate because project 004f916c7aa64f36a7c33d2b6a3babd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:07.696178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.697064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.703857 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3011/6043] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:06 2022] DELETE /identity/v3/projects/004f916c7aa64f36a7c33d2b6a3babd8 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:07.705088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:07.706712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:07.798253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a009c160cde41ca9a0d92018de50daa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.829064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8532c3f-f09c-48c3-92dd-205bfdcb20f8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:07.834174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:07.834802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:07.835082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:07.835355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:07.836139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:07.838889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d68ae-2f25-450e-9c02-3571d4c84015 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:07.898108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a009c160cde41ca9a0d92018de50daa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.917329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a009c160cde41ca9a0d92018de50daa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.932460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a009c160cde41ca9a0d92018de50daa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.933731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a009c160cde41ca9a0d92018de50daa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:07.958759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3033/6044] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:07 2022] DELETE /identity/v3/users/0a009c160cde41ca9a0d92018de50daa => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:07.961288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:07.968260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:08.015747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3012/6045] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:07 2022] POST /identity/v3/projects => generated 358 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:08.018375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.027710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.028652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.041962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:08.062976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:08.067365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:08.149997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d1799-c225-45b0-9aa1-68be7e47f6ec admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.201714 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3013/6046] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:08.204266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.206876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:08.275168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.276003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.276445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.276765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] PATH_INFO: `/v3/projects/de7913a0ade441f797ed5d91fc6b6257` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.278052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7913a0ade441f797ed5d91fc6b6257)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.280196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.326993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdf211-c941-4d51-aa79-c3acf3d2f5e4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.337433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.338625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.339050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.339432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.340300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.343169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b56c9aa-1bca-4784-bcea-a477c174cb32 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.371755 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3014/6047] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:52:08 2022] GET /identity/v3/projects => generated 6475 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:08.374293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.374986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.375368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.400200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:08.400795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:08.413609 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3015/6048] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:08.413609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.428865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f710ffe-8556-4488-9d29-3cdbdbc0bf1e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.434802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.435514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.436045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.436376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.437247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:08.437632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.440533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.466901 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3016/6049] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:52:08 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:08.468691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.480730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd052b75-94e5-4ecd-b2c4-4679a68c46b5 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.495818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.497411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.498142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.498790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.500930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:08.501245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.503926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.526482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7913a0ade441f797ed5d91fc6b6257', 'request_id': 'req-446e0946-986c-478b-a382-db6069eba0a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.526482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7913a0ade441f797ed5d91fc6b6257', 'request_id': 'req-446e0946-986c-478b-a382-db6069eba0a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.532738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3017/6050] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:08.533596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.542557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7913a0ade441f797ed5d91fc6b6257', 'request_id': 'req-446e0946-986c-478b-a382-db6069eba0a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.551783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a075fd-0860-420c-86d5-5841b83cdff2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.629080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.629080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.629080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.629445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.629445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Adding query filter params (parent_id=58a9fd616e874e4bb84f6e2615e8effa) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:08.629445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.629445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.656623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3018/6051] 10.222.0.64 () {58 vars in 1216 bytes} [Wed Nov 2 12:52:08 2022] GET /identity/v3/projects?parent_id=58a9fd616e874e4bb84f6e2615e8effa => generated 498 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:08.657697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.716355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] The token cache is being invalidate because project de7913a0ade441f797ed5d91fc6b6257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:08.716685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.718331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.721474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3034/6052] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:07 2022] DELETE /identity/v3/projects/de7913a0ade441f797ed5d91fc6b6257 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:08.722332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:08.728770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:08.750966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b38b7c-53b3-4a6e-baa8-46dae41c28d9 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.757873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.758229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.758564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.758957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.759820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.762657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d204af-840e-4427-95ac-27c9a304db98 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.765853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e0946-986c-478b-a382-db6069eba0a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:08.784678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:08.785594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.785955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.786300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects/471d48fbe3ef4f249e3f998bfb5a100b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.787768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=471d48fbe3ef4f249e3f998bfb5a100b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:08.789797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:08.903082 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3019/6053] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:08 2022] POST /identity/v3/projects => generated 391 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:08.903082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:08.903082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:08.917129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:08.993167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:08.997252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471d48fbe3ef4f249e3f998bfb5a100b', 'request_id': 'req-246570e7-bf1e-4e79-9aa0-429af868c807'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:08.997736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.014757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471d48fbe3ef4f249e3f998bfb5a100b', 'request_id': 'req-246570e7-bf1e-4e79-9aa0-429af868c807'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.037516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471d48fbe3ef4f249e3f998bfb5a100b', 'request_id': 'req-246570e7-bf1e-4e79-9aa0-429af868c807'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.130057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] The token cache is being invalidate because project 471d48fbe3ef4f249e3f998bfb5a100b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:09.130435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.131307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.137080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3035/6054] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:08 2022] DELETE /identity/v3/projects/471d48fbe3ef4f249e3f998bfb5a100b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:09.137248 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3020/6055] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:09.140275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.145662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.148121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.188716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246570e7-bf1e-4e79-9aa0-429af868c807 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.196032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.196837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.197350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.197626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.198275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.200279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a2e8e-b731-4160-92f9-19542586512d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.219227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:09.251764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d4317-4a1c-44d7-8929-9d2e7a277617 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.258015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.259477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.259757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.260032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects/58a9fd616e874e4bb84f6e2615e8effa` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.262801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=58a9fd616e874e4bb84f6e2615e8effa)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.265378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.336586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3036/6056] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:09 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:09.338078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.338387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.338660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.363007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:09.364320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.396673 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3037/6057] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:09.400993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.428991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fd76a-dade-46c1-bd66-3727d4db2f53 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.451878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a9fd616e874e4bb84f6e2615e8effa', 'request_id': 'req-c6ee2c39-4f64-489e-8cfa-97d3487901e3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.473372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a9fd616e874e4bb84f6e2615e8effa', 'request_id': 'req-c6ee2c39-4f64-489e-8cfa-97d3487901e3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.541065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.541898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.542285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.542769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.543840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.545890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.567310 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3038/6058] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:09.568358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.587248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a884a-3284-411d-a148-35ccd8123c37 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.594890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.595118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a9fd616e874e4bb84f6e2615e8effa', 'request_id': 'req-c6ee2c39-4f64-489e-8cfa-97d3487901e3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.595813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.596193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.596743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.597626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:09.599463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.602880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.609880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] The token cache is being invalidate because project 58a9fd616e874e4bb84f6e2615e8effa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:09.610180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.614069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:09.621341 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3021/6059] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:09 2022] DELETE /identity/v3/projects/58a9fd616e874e4bb84f6e2615e8effa => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:09.621341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.626277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.628220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3039/6060] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:09.629885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.642243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.670301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee2c39-4f64-489e-8cfa-97d3487901e3 tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.717845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.720227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.720801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.721183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.723950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.730028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.770201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3022/6061] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:09.771366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:09.775153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:09.804271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6c341-1cfa-4e80-85d4-5a498222dd54 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.817487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.818448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.818892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.823166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.823166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.823166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.867155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aef558-0851-4708-8b74-e48b401d78ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:09.876065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '379e29b5833f4eae893d4c10a773c6cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ecf6583ba1457792647c6ed165d609', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:09.877106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:09.877537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:09.878053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] PATH_INFO: `/v3/projects/b9d5c74c19954ea7abb7a4c7295e5465` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:09.879463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9d5c74c19954ea7abb7a4c7295e5465)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:09.884808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:09.990949 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3023/6062] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:09 2022] POST /identity/v3/projects => generated 371 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:09.992000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:10.180270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e58ef4-403d-47d4-a013-a0d3d98944be admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:10.188940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:10.194902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:10.194902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:10.194902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] PATH_INFO: `/v3/projects/291ebd492ff74318b46cdb0714b682d9/users/c0835149fb8b4566a10aca57fb016392/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:10.237806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:10.239000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=291ebd492ff74318b46cdb0714b682d9, user_id=c0835149fb8b4566a10aca57fb016392, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:10.242939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d5c74c19954ea7abb7a4c7295e5465', 'request_id': 'req-bdddb202-9161-4cca-8874-a443c4a33bea'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.258630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:10.272594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d5c74c19954ea7abb7a4c7295e5465', 'request_id': 'req-bdddb202-9161-4cca-8874-a443c4a33bea'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.294542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d5c74c19954ea7abb7a4c7295e5465', 'request_id': 'req-bdddb202-9161-4cca-8874-a443c4a33bea'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.434633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3024/6063] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:09 2022] PUT /identity/v3/projects/291ebd492ff74318b46cdb0714b682d9/users/c0835149fb8b4566a10aca57fb016392/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:10.436789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:10.447606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:10.470297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] The token cache is being invalidate because project b9d5c74c19954ea7abb7a4c7295e5465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:10.470656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.472027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.478297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3040/6064] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:09 2022] DELETE /identity/v3/projects/b9d5c74c19954ea7abb7a4c7295e5465 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:10.478297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:10.478767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:10.598790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532837e-6d25-44fd-af6f-a74699d07ea1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:10.605356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:10.606320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:10.606821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:10.608473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] PATH_INFO: `/v3/projects/3a15a336a72c4feba37270cea19ccde9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:10.610153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a15a336a72c4feba37270cea19ccde9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:10.613122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:10.654787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddb202-9161-4cca-8874-a443c4a33bea tempest-ListProjectsTestJSON-1589508830 tempest-ListProjectsTestJSON-1589508830-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:10.689863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:10.692048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:10.692743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:10.693302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:10.696824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:10.699570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daced26-5cc9-40a4-bb16-8f70661cb03f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:10.800742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a15a336a72c4feba37270cea19ccde9', 'request_id': 'req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.808781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a15a336a72c4feba37270cea19ccde9', 'request_id': 'req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.849398 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3041/6065] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:10 2022] POST /identity/v3/users => generated 286 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:10.850949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:10.851223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:10.851521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:10.887067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] MFA Rules not processed for user `c0835149fb8b4566a10aca57fb016392`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:10.888334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:10.948665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a15a336a72c4feba37270cea19ccde9', 'request_id': 'req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.961824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] The token cache is being invalidate because project 3a15a336a72c4feba37270cea19ccde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:10.962132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.962747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:10.964520 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3025/6066] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:10 2022] DELETE /identity/v3/projects/3a15a336a72c4feba37270cea19ccde9 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:10.965309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:10.967262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:10.971551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3042/6067] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:10.976059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.067998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdfdfb-74a5-4181-8ef1-5b7ea174056c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.071144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9615e7-60bb-4bca-ba14-6c69936acc5a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.075397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.077695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.078174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.079259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] PATH_INFO: `/v3/users/f0c76b881ae74cd28915512391bdf262` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.080149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c76b881ae74cd28915512391bdf262)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.084284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.085183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.085636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.086073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.087000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.088832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.090508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e0b9-d200-4cb7-b89c-3f768886d83f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.114835 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3043/6068] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:11.116227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.116441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.116746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.170119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:11.175866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.212396 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3044/6069] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:11.213409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.215325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.269990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:11.322716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aeb3c3-5a1b-4045-96c9-0eaea93cfeb4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.328922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.329584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.330692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.330825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.333107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.367953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.369487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.384150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c76b881ae74cd28915512391bdf262'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.397530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3045/6070] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:11.402351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.405272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.433092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f2581-ab0a-4e83-80a9-1de1eec5afef service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.439377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.440001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.440609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.440888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.441543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.443160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bf542-7bea-4cc3-b4b1-1578cff5b891 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.461180 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3046/6071] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:11.461180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.461180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.461180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.484636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:11.486989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.500919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3047/6072] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:11.500919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.502949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.523262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f722cc-0ba3-4891-a0d9-e26cb8361d10 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.532031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.532880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.533156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.533520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] PATH_INFO: `/v3/users/c0835149fb8b4566a10aca57fb016392` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.535066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0835149fb8b4566a10aca57fb016392)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.537653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.726410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c76b881ae74cd28915512391bdf262'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.727393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:11.742942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c76b881ae74cd28915512391bdf262'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.743683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c76b881ae74cd28915512391bdf262'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.744316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c76b881ae74cd28915512391bdf262'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.760197 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3026/6073] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:10 2022] DELETE /identity/v3/users/f0c76b881ae74cd28915512391bdf262 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:11.761071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.762855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:11.815261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0835149fb8b4566a10aca57fb016392'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.853747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf439f2a-8b0a-4c59-b402-2e387fda8aee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:11.860520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:11.860735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:11.861010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:11.861314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] PATH_INFO: `/v3/projects/9b68dd5ddfaf4981a5262d3ff99d4595/users/4b64891cd6d44679b8a22b4303a97700/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:11.887657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b68dd5ddfaf4981a5262d3ff99d4595, user_id=4b64891cd6d44679b8a22b4303a97700, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:11.891676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:11.895855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0835149fb8b4566a10aca57fb016392'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.930972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0835149fb8b4566a10aca57fb016392'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.930972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0835149fb8b4566a10aca57fb016392'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.930972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0835149fb8b4566a10aca57fb016392'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:11.935229 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3048/6074] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:11 2022] DELETE /identity/v3/users/c0835149fb8b4566a10aca57fb016392 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:11.936591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:11.938277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.035621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9df74-ec1f-47a4-8d4a-b1d94f092949 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.041017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.041751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.042107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.042582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.044101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:12.044425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.053143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbdfbd-5a0f-463e-97f1-d9d4a85e2305 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.065822 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3049/6075] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:12.065822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6026cb-4a89-466f-a415-79a0defb4226 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.065822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6026cb-4a89-466f-a415-79a0defb4226 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.065822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6026cb-4a89-466f-a415-79a0defb4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.099619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0b6026cb-4a89-466f-a415-79a0defb4226 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:12.099619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b6026cb-4a89-466f-a415-79a0defb4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.110790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3050/6076] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:12.112734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.112734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.112957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.134747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3027/6077] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:11 2022] PUT /identity/v3/projects/9b68dd5ddfaf4981a5262d3ff99d4595/users/4b64891cd6d44679b8a22b4303a97700/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:12.136193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.154953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:12.157060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.284053 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3051/6078] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:12.285682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.287693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.306627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ac3ca-e816-433a-88c5-9cceea7510b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.319032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.319518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.319798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.320066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.321347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.323393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.400965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94318ed-3e12-4097-8af0-f2f99c88430f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.405333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.406121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.406403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.407079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.416975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.418433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53999a8b-76c7-4e11-b3cc-9d38dec2029f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.431850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3052/6079] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:12.434185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace08-3758-46ce-bac4-173076737476 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.434318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace08-3758-46ce-bac4-173076737476 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.435291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ace08-3758-46ce-bac4-173076737476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.470193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-be4ace08-3758-46ce-bac4-173076737476 None None] MFA Rules not processed for user `4b64891cd6d44679b8a22b4303a97700`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:12.471802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-be4ace08-3758-46ce-bac4-173076737476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.553743 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3028/6080] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:12 2022] POST /identity/v3/projects => generated 383 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:12.555311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.557510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.588391 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3053/6081] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:12.589476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ace08-3758-46ce-bac4-173076737476 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.616035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ace08-3758-46ce-bac4-173076737476 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.655948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f108-4b60-4d48-a926-b418a27cde1b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.660314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.661071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.661360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.661777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.709377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.711193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.711193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.712094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.713509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.717412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.736791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.738987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.759946 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3029/6082] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:12.761146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.763006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:12.852561 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3054/6083] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:12 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:12.857822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.882428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186581f9-33b1-44d0-89ba-135a40f8871a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.889871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.890684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.890975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.891254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.891924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.893914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.908565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132d7d0-a8cf-4100-af22-80351340c800 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.915851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.916606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.916763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3055/6084] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:12.921459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.921894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:12.922036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.959840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235bbd3-9e18-454a-8b45-06a995762e39 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:12.974077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:12.975862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:12.977108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:12.977588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:12.978286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:12.985789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:12.989977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:13.021893 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3056/6085] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:52:13.025616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:13.042893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:13.045749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497f788-e9c6-4b34-944e-b6d30348c68c service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:13.048577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec404da-94bb-4b5e-add6-ea6917f331dc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:13.059821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3030/6086] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:13.075545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:13.078887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:13.085524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:13.085524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] PATH_INFO: `/v3/projects/d07448f47fb941c2bb152c22ae2fe7c1/users/9cf542cf5b224a04aa1580bf52e0192c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:13.122510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07448f47fb941c2bb152c22ae2fe7c1, user_id=9cf542cf5b224a04aa1580bf52e0192c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:13.126184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:13.263618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3057/6087] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:13 2022] PUT /identity/v3/projects/d07448f47fb941c2bb152c22ae2fe7c1/users/9cf542cf5b224a04aa1580bf52e0192c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:13.275339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:13.275723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:13.275990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:13.325504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] MFA Rules not processed for user `9cf542cf5b224a04aa1580bf52e0192c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:13.327581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:13.416165 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3031/6088] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:13.422474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:13.626627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b0c6b-a37d-4739-bdca-c8dda15c5890 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:13.646905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:13.647555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:13.647838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:13.648113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:13.648816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:13.662275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:13.828812 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3058/6089] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:13 2022] POST /identity/v3/projects => generated 383 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:13.833146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:13.845758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c0f5d-12a2-41ec-9389-dce780c18825 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:13.950949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:13.952365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:13.952996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:13.953435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:13.955616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:13.958879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.144622 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3032/6090] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:13 2022] POST /identity/v3/users => generated 298 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:14.145776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.159592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70591040-28ca-4798-aa7f-eb55d26d64a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.177288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.177927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.178599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.178724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.179577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.181523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.212718 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3059/6091] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:14.214931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.239784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8b165-60aa-4a7b-80e7-abb73fb97e40 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.249015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.249988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.250272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.250544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] PATH_INFO: `/v3/projects/d494ddf087f24e208945f4357dfbf2c1/users/d94d0a36d381464c94e913afc03bb2d1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.292996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d494ddf087f24e208945f4357dfbf2c1, user_id=d94d0a36d381464c94e913afc03bb2d1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.296520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.322473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.324594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:14.347049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95982685-611e-4bec-b32c-e8a138ec65c4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.361261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.362242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.362745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.363201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] PATH_INFO: `/v3/projects/bd0198c698494a98a7b06756263cf241` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.364736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0198c698494a98a7b06756263cf241)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.366922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.442376 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3033/6092] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:14 2022] PUT /identity/v3/projects/d494ddf087f24e208945f4357dfbf2c1/users/d94d0a36d381464c94e913afc03bb2d1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:14.448396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.593386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dbc5e-c33b-43cf-b3da-75822cf25fb2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.599335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.606212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.606212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.606212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.606212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.606212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.644666 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3034/6093] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:14.646160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.665435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb268478-572a-45e5-8812-2193372eea98 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.690049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.690896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.691281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.691672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] PATH_INFO: `/v3/projects/d494ddf087f24e208945f4357dfbf2c1/users/d94d0a36d381464c94e913afc03bb2d1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.696644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d494ddf087f24e208945f4357dfbf2c1, user_id=d94d0a36d381464c94e913afc03bb2d1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.699399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.705726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0198c698494a98a7b06756263cf241', 'request_id': 'req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:14.719670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0198c698494a98a7b06756263cf241', 'request_id': 'req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:14.737688 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3035/6094] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:14 2022] PUT /identity/v3/projects/d494ddf087f24e208945f4357dfbf2c1/users/d94d0a36d381464c94e913afc03bb2d1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:14.739882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:14.742172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:14.742910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0198c698494a98a7b06756263cf241', 'request_id': 'req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:14.843104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c386a63-675f-482a-862b-a4614b8ade1e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:14.850150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:14.851540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.851979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.852789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] PATH_INFO: `/v3/projects/291ebd492ff74318b46cdb0714b682d9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.855245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=291ebd492ff74318b46cdb0714b682d9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:14.858860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:14.882966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] The token cache is being invalidate because project bd0198c698494a98a7b06756263cf241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:14.883349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:14.884756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a51a8f12-f0fd-4bdc-a9d1-a821caa0f0fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:14.887014 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3060/6095] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:14 2022] DELETE /identity/v3/projects/bd0198c698494a98a7b06756263cf241 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:14.888767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:14.890849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:14.891228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:14.959398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] MFA Rules not processed for user `d94d0a36d381464c94e913afc03bb2d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:14.961369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.001873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291ebd492ff74318b46cdb0714b682d9', 'request_id': 'req-7a79daac-aad5-4f54-9209-2c185ffd43ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.012262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291ebd492ff74318b46cdb0714b682d9', 'request_id': 'req-7a79daac-aad5-4f54-9209-2c185ffd43ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.120766 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3061/6096] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:15.122235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:15.127587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.148769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291ebd492ff74318b46cdb0714b682d9', 'request_id': 'req-7a79daac-aad5-4f54-9209-2c185ffd43ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.152264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:15.159811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a085a95-4f1b-4742-8516-e7fc052fd0fe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:15.179519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] The token cache is being invalidate because project 291ebd492ff74318b46cdb0714b682d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:15.180683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.181776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.185258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3036/6097] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:14 2022] DELETE /identity/v3/projects/291ebd492ff74318b46cdb0714b682d9 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:15.187288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:15.189147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.272279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:15.276427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.276427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.276427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] PATH_INFO: `/v3/users/379e29b5833f4eae893d4c10a773c6cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.279066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379e29b5833f4eae893d4c10a773c6cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:15.283978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:15.317543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79daac-aad5-4f54-9209-2c185ffd43ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:15.324562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:15.327399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.329781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.330699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.336290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.446797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:15.455434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:15.457663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee391dd-6b73-4734-aebc-7106066ec30a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:15.473590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3037/6098] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:15.476065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89823cd-19bf-4fd6-b120-35dc6ab6507c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.476513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89823cd-19bf-4fd6-b120-35dc6ab6507c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.476905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89823cd-19bf-4fd6-b120-35dc6ab6507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.512374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a89823cd-19bf-4fd6-b120-35dc6ab6507c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:15.514249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a89823cd-19bf-4fd6-b120-35dc6ab6507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.532413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3038/6099] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:15.538787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.539384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.540463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.577501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:15.580938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:15.604020 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3039/6100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:15.605467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:15.644319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631136-6692-48c4-a5a5-f5c4e181b553 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:15.663955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:15.665534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.666607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.668034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.670754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:15.672780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:15.677464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:15.704367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379e29b5833f4eae893d4c10a773c6cb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.716942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3040/6101] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:15.720795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:15.746457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927d27-4e5b-4e74-9306-2bcd9b3e83e1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:15.759999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:15.762532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:15.762532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:15.762744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:15.766596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:15.771400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:15.810585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379e29b5833f4eae893d4c10a773c6cb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.841560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379e29b5833f4eae893d4c10a773c6cb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.854195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379e29b5833f4eae893d4c10a773c6cb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.855028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379e29b5833f4eae893d4c10a773c6cb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:15.879253 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3062/6102] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:15 2022] DELETE /identity/v3/users/379e29b5833f4eae893d4c10a773c6cb => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:15.935886 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3041/6103] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:15 2022] POST /identity/v3/projects => generated 381 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:15.942244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:15.944020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:16.076913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a8f4-6dda-4121-a6e4-c8b85f38efa5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:16.160877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:16.161784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:16.162226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:16.162658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:16.163465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:16.165739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:16.283688 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3063/6104] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:15 2022] POST /identity/v3/users => generated 291 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:16.289134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:16.307350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8f25b-80c3-4f81-afb9-62aa91d43730 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:16.326705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:16.327780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:16.329785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:16.330235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:16.331222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:16.333729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:16.357874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3042/6105] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:16.361471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:16.375928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417641a7-05fc-464d-a5cd-a561395a707e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:16.396471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:16.398067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:16.398565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:16.399049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:16.399921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:16.402641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79d5f6-d841-4295-819c-e220cf0158df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:16.428436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3064/6106] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:52:16.430410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:16.455144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac21798-31c3-492c-b49c-aaa2962628d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:16.465992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:16.467586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:16.467968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:16.468316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] PATH_INFO: `/v3/projects/73f7f7c7d5f54d00af639d4c95431449/users/6a2dabb39cb540b787e822a63a4545a3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:16.493218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f7f7c7d5f54d00af639d4c95431449, user_id=6a2dabb39cb540b787e822a63a4545a3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:16.497920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:16.688562 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3043/6107] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:16 2022] PUT /identity/v3/projects/73f7f7c7d5f54d00af639d4c95431449/users/6a2dabb39cb540b787e822a63a4545a3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:16.699928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:16.700199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:16.705002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:16.793737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] MFA Rules not processed for user `6a2dabb39cb540b787e822a63a4545a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:16.795535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:16.810693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:16.813964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:17.062245 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3065/6108] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:17.083510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:17.085665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:17.087377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68acc9-282f-42c1-b279-cc1432b3c199 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:17.099755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:17.101411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.102151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.105338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] PATH_INFO: `/v3/projects/63ecf6583ba1457792647c6ed165d609` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.109264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ecf6583ba1457792647c6ed165d609)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:17.115753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:17.215382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9c201-08ad-4450-a885-4a4ab8bbe954 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:17.229359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:17.230852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.234077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.234952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.257167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:17.266212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:17.292174 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3066/6109] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:17.322782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:17.346757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c562d-2c7c-43c0-b433-f1d9127d1ed8 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:17.402390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ecf6583ba1457792647c6ed165d609', 'request_id': 'req-a947039d-36ea-4843-a94a-f5eb2ea59479'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.426300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ecf6583ba1457792647c6ed165d609', 'request_id': 'req-a947039d-36ea-4843-a94a-f5eb2ea59479'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.475701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:17.476912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.477890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.477890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] PATH_INFO: `/v3/users/6a2dabb39cb540b787e822a63a4545a3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.479724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2dabb39cb540b787e822a63a4545a3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:17.482946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:17.561407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ecf6583ba1457792647c6ed165d609', 'request_id': 'req-a947039d-36ea-4843-a94a-f5eb2ea59479'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.576402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] The token cache is being invalidate because project 63ecf6583ba1457792647c6ed165d609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:17.577286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.578182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a947039d-36ea-4843-a94a-f5eb2ea59479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.580273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3044/6110] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:16 2022] DELETE /identity/v3/projects/63ecf6583ba1457792647c6ed165d609 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:17.585997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc24c-12f9-4d1e-b867-8e005b80e975 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.586874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc24c-12f9-4d1e-b867-8e005b80e975 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.587709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dc24c-12f9-4d1e-b867-8e005b80e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.619462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9c1dc24c-12f9-4d1e-b867-8e005b80e975 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:17.625060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c1dc24c-12f9-4d1e-b867-8e005b80e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:17.641642 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3045/6111] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:17.655259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.655946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.656638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.697848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:17.699492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:17.733242 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3046/6112] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:17.737735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:17.751349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcb260-b503-4c91-a566-2137baa102e8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:17.763589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:17.764229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.764533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.764807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.765467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:17.765770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:17.771809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:17.802243 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3047/6113] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:52:17.819657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:17.836784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2dabb39cb540b787e822a63a4545a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:17.841549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df666353-cc51-4cc1-a80a-2d7075230674 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:17.849331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:17.849966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:17.850289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:17.850561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:17.851197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:17.853222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:18.062604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2dabb39cb540b787e822a63a4545a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.076340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3048/6114] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:17 2022] POST /identity/v3/projects => generated 369 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:18.080429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:18.095283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2dabb39cb540b787e822a63a4545a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.121724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2dabb39cb540b787e822a63a4545a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.124187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c36a7eb-6fa5-4de8-8390-7491de161161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2dabb39cb540b787e822a63a4545a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.153062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3067/6115] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:17 2022] DELETE /identity/v3/users/6a2dabb39cb540b787e822a63a4545a3 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:18.159121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.159408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.161494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.222499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:18.223759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:18.239865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05e70-5b28-41f7-b43a-fb79c10e9d27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:18.368241 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3068/6116] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:18.372672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:18.385970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:18.408866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7ebfd-4e2c-4f05-94b7-066f1137be9a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:18.414229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:18.415038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.415393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.415734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.416560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:18.418655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:18.422720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:18.423396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.423679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.423951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] PATH_INFO: `/v3/users/ef8649ace0724894a364e01e4fb80250` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.427574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8649ace0724894a364e01e4fb80250)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:18.436846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:18.616313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3049/6117] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:18 2022] POST /identity/v3/users => generated 285 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:18.617943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:18.624507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:18.657872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6b3dd-82ce-465d-900c-93da6c2a65a4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:18.672600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:18.673932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.674463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.675070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.676030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:18.678030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:18.708791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3050/6118] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:18.710321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:18.713099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:18.801117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8649ace0724894a364e01e4fb80250'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.862356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1c10b-d0dd-49e9-8e4f-1db75ebf03b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:18.867703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:18.874391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.874391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.874391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.881836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:18.883667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:18.911404 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3051/6119] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:18.925818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:18.937404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8649ace0724894a364e01e4fb80250'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.964738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15260eb6-cb10-4c13-99d6-14db04ea8440 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:18.971352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8649ace0724894a364e01e4fb80250'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:18.978855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:18.979642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:18.980718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:18.982379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:18.985264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:18.988109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:19.003093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:19.010552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8649ace0724894a364e01e4fb80250'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:19.014143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c075c16-2064-4ea2-bf5f-52d322cf025d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8649ace0724894a364e01e4fb80250'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:19.014683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3052/6120] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:19.018702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:19.023830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:19.031576 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3069/6121] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:18 2022] DELETE /identity/v3/users/ef8649ace0724894a364e01e4fb80250 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:19.036628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:19.037077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:19.037621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:19.066216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4dfaad-3494-4149-83a1-a1f0c6e38dda admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:19.077360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:19.079587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:19.233024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:19.233529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:19.234214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:19.234502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] PATH_INFO: `/v3/projects/31253f3142d44bf9b19240622d090444/users/c4c089a623e7465e9307f79f174382b1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:19.244836 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3070/6122] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:19.264906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31253f3142d44bf9b19240622d090444, user_id=c4c089a623e7465e9307f79f174382b1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:19.271444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2782ae-b894-4fcc-b80e-081270a5ff24 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:19.294828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:19.297721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:19.372656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:19.488684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f46e53-592d-47ca-8874-54b5fd34feef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:19.505760 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3053/6123] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:19 2022] PUT /identity/v3/projects/31253f3142d44bf9b19240622d090444/users/c4c089a623e7465e9307f79f174382b1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:19.508758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:19.508758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:19.508758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:19.612382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] MFA Rules not processed for user `c4c089a623e7465e9307f79f174382b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:19.612382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:19.617262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:19.617905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:19.618185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:19.618461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:19.748050 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3054/6124] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:19.752571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:19.790928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:19.792723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:19.834216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3071/6125] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:19.860054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639a959-8a43-41d2-890e-feb789805a74 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:19.869050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:19.874824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:19.875148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:19.880861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:19.880861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:19.888533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:20.118021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3055/6126] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:19 2022] POST /identity/v3/projects => generated 369 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:20.145139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:20.161878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfa0a5-eb7e-46bb-be4d-9f2ea379ccf7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:20.347767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:20.349131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:20.349560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:20.349977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:20.350944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:20.353650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:20.542286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:20.543262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3072/6127] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:20 2022] POST /identity/v3/users => generated 291 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:20.558690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc36db-54c0-4ee7-9feb-9806fafd8cfb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:20.578606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:20.579290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:20.579569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:20.579842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:20.581297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:20.582941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:20.606539 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3056/6128] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:20.611424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:20.647649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2923e215-6fb5-4d33-9374-443d42d64cdd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:20.683195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:20.685502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:20.686589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:20.687334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] PATH_INFO: `/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9/users/acdfaefc3cd643e0873be70cd69ad9d4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:20.765414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf3fa70e5bd4a33af8f79cb6e7cede9, user_id=acdfaefc3cd643e0873be70cd69ad9d4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:20.771016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:20.953572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:20.955624 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3073/6129] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:20 2022] PUT /identity/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9/users/acdfaefc3cd643e0873be70cd69ad9d4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:20.988019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968434b-1c16-4536-b1dd-2f018d3c6c96 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:21.264061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:21.264842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:21.265128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:21.265404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:21.266072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:21.274137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75b61e-6c3c-49fd-9441-718e1c812784 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:21.316511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:21.317005 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3057/6130] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:52:21.333910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08495205-d415-45ee-85e5-58a4a3c8c9c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:21.355439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:21.356421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:21.356749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:21.364457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] PATH_INFO: `/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9/users/acdfaefc3cd643e0873be70cd69ad9d4/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:21.364457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf3fa70e5bd4a33af8f79cb6e7cede9, user_id=acdfaefc3cd643e0873be70cd69ad9d4, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:21.367130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:21.397463 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3074/6131] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:21 2022] PUT /identity/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9/users/acdfaefc3cd643e0873be70cd69ad9d4/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:21.415300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:21.415300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:21.415300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:21.468380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:21.470736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:21.529622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] MFA Rules not processed for user `acdfaefc3cd643e0873be70cd69ad9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:21.531778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:21.700799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079478-7265-436b-a9f3-f63a2b3fff2d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:21.707568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:21.708898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:21.709397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:21.713628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] PATH_INFO: `/v3/projects/73f7f7c7d5f54d00af639d4c95431449` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:21.729689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f7f7c7d5f54d00af639d4c95431449)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:21.734294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:21.753175 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3058/6132] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:21.754306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:21.773828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed1c24-d629-4f26-b636-5d068d1ec661 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:21.782728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:21.783822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:21.784288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:21.784742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:21.787881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:21.792259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:22.009765 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3059/6133] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:21 2022] POST /identity/v3/projects => generated 359 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:22.018210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:22.029394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f7f7c7d5f54d00af639d4c95431449', 'request_id': 'req-1d07906a-4341-41b7-b57b-a9f194069533'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.049438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f7f7c7d5f54d00af639d4c95431449', 'request_id': 'req-1d07906a-4341-41b7-b57b-a9f194069533'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.067929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f7f7c7d5f54d00af639d4c95431449', 'request_id': 'req-1d07906a-4341-41b7-b57b-a9f194069533'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.197076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] The token cache is being invalidate because project 73f7f7c7d5f54d00af639d4c95431449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:22.197649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.199763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.203345 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3075/6134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:21 2022] DELETE /identity/v3/projects/73f7f7c7d5f54d00af639d4c95431449 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:22.214864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:22.221715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:22.276313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842f00-a03d-44c9-bfbe-31f748a4c647 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:22.314036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:22.315949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:22.318395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:22.318684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:22.319379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:22.335293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f33bef-5e19-43b1-9156-7cd779f78125 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:22.343350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:22.477617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07906a-4341-41b7-b57b-a9f194069533 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:22.531427 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3060/6135] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:22 2022] POST /identity/v3/users => generated 413 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:22.533458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:22.538686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:22.539304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:22.607933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:22.619645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:22.623832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:22.630983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:22.631898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:22.632304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:22.632705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] PATH_INFO: `/v3/projects/d51481ca43dc4936b4d039170d10afc6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:22.634518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51481ca43dc4936b4d039170d10afc6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:22.636962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:22.744255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3061/6136] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:22.746613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:22.748329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:22.770047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41f9c7-73b3-4b77-bfb4-f53155e293d2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:22.775938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:22.776965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:22.781616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:22.781616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/users/55b09efa954645dba4b10906e3f32d61` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:22.799438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_user(user_id=55b09efa954645dba4b10906e3f32d61)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:22.802860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e3556-3610-4d65-9c39-89bf9379dfca tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:22.813273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3062/6137] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:52:22 2022] GET /identity/v3/users/55b09efa954645dba4b10906e3f32d61 => generated 413 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:22.814591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:22.814940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:22.815410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:22.950274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:22.952962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:22.955991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51481ca43dc4936b4d039170d10afc6', 'request_id': 'req-d05b04da-5bd0-4c95-9e3a-b36f74666848'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:22.982598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51481ca43dc4936b4d039170d10afc6', 'request_id': 'req-d05b04da-5bd0-4c95-9e3a-b36f74666848'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.028655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51481ca43dc4936b4d039170d10afc6', 'request_id': 'req-d05b04da-5bd0-4c95-9e3a-b36f74666848'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.132029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3063/6138] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:23.133808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.194175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] The token cache is being invalidate because project d51481ca43dc4936b4d039170d10afc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:23.205462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.205462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.205462 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3076/6139] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:22 2022] DELETE /identity/v3/projects/d51481ca43dc4936b4d039170d10afc6 => generated 0 bytes in 991 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:23.213153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.220272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.244572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b04da-5bd0-4c95-9e3a-b36f74666848 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.261964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.262932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.265003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.265369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] PATH_INFO: `/v3/users/07599fa7402e41958a674d974361b537` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.268332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07599fa7402e41958a674d974361b537)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.279056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.337353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eafc18-adc5-4086-95d8-d03117f6f3dc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.343512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.344170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.344446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.344753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/users/55b09efa954645dba4b10906e3f32d61` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.346114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_user(user_id=55b09efa954645dba4b10906e3f32d61)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.348168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.613650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b09efa954645dba4b10906e3f32d61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.711941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b09efa954645dba4b10906e3f32d61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.768615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b09efa954645dba4b10906e3f32d61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.770689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b09efa954645dba4b10906e3f32d61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.776992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07599fa7402e41958a674d974361b537'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.777524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b09efa954645dba4b10906e3f32d61'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.821240 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3064/6140] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:23 2022] DELETE /identity/v3/users/55b09efa954645dba4b10906e3f32d61 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:23.824866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:23.827896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:23.934794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370be971-9d98-476d-8bf2-17313f430389 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:23.939506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:23.940215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.940512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.940792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.941433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:23.941731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:23.943353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2dcd9-09c2-444a-824a-a601e2b42452 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:23.956884 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3065/6141] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:23.958438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:23.958723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:23.959035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:23.966428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07599fa7402e41958a674d974361b537'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.987012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07599fa7402e41958a674d974361b537'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:23.987371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:23.988700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.001267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07599fa7402e41958a674d974361b537'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.002194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07599fa7402e41958a674d974361b537'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.010713 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3077/6142] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:23 2022] DELETE /identity/v3/users/07599fa7402e41958a674d974361b537 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:24.017734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.017734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.023115 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3066/6143] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.023952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.037175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2f9a2-7a0a-4434-8277-6305496b0d29 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.043983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:24.147867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4125e8-2e81-4c97-9a50-c3d43116273f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.149094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.149765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.150046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.150327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/f3d1b6e0097e483d8ff50b27362f854b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.151521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3d1b6e0097e483d8ff50b27362f854b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.153530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.158298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.159210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.159650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.160126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.160809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.162812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1db1a3-d0a7-46ef-b791-0741cc264574 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.295486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3067/6144] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.297016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8786-9ed5-4bbf-b5b9-3773a38ce0d7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.297443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8786-9ed5-4bbf-b5b9-3773a38ce0d7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.297898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a8786-9ed5-4bbf-b5b9-3773a38ce0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.316221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d1b6e0097e483d8ff50b27362f854b', 'request_id': 'req-bed31839-4255-42aa-b917-d44d408dc2f6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.331113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d1b6e0097e483d8ff50b27362f854b', 'request_id': 'req-bed31839-4255-42aa-b917-d44d408dc2f6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.331397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-751a8786-9ed5-4bbf-b5b9-3773a38ce0d7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.332985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-751a8786-9ed5-4bbf-b5b9-3773a38ce0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.351275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d1b6e0097e483d8ff50b27362f854b', 'request_id': 'req-bed31839-4255-42aa-b917-d44d408dc2f6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.438821 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3068/6145] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.438821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.438821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.438821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.461436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:24.462649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.483432 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3069/6146] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:24.483432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.487754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.506079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0046f-ef4a-4b86-9112-c081374b91db None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.519343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.520180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.520437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project f3d1b6e0097e483d8ff50b27362f854b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:24.520766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.521226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.521583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] PATH_INFO: `/v3/users/4b64891cd6d44679b8a22b4303a97700` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.523138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b64891cd6d44679b8a22b4303a97700)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.525103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:24.526510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.531687 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3078/6147] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:24 2022] DELETE /identity/v3/projects/f3d1b6e0097e483d8ff50b27362f854b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:24.531687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.533363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.627914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed31839-4255-42aa-b917-d44d408dc2f6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:24.642739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:24.643645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:24.643998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:24.644411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:24.645195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:24.647641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:24.854066 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3079/6148] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:24 2022] POST /identity/v3/users => generated 287 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:24.858656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:24.865074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:24.889696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b64891cd6d44679b8a22b4303a97700'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:25.005780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b64891cd6d44679b8a22b4303a97700'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:25.011368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb5ed-f24a-4c81-a0a6-7153d48b7df0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.017848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.018578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.018855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.019329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.032566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.038517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b64891cd6d44679b8a22b4303a97700'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:25.039255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b64891cd6d44679b8a22b4303a97700'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:25.039888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b64891cd6d44679b8a22b4303a97700'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:25.074784 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3070/6149] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:24 2022] DELETE /identity/v3/users/4b64891cd6d44679b8a22b4303a97700 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:25.075888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.078146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.079658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.083292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.125551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3080/6150] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:25.126119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.127487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.289886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e157b43-6809-453f-bac9-2d373040f913 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.290542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2161f3d-5cd8-4be7-a014-117d4127dbd3 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.290638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.290638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.290638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.290638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.290965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:25.290965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.294233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.382109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3071/6151] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:25.383355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.397882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.496446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.497617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.497895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.498432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.502554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.611684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd661df-1e40-4b8b-9d24-d4db9a61b86f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.625021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.626137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.628814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.628814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.629903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.633395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.658482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.659936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.676751 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3081/6152] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:25.676751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.676751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.703061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bb5f1-5614-4783-9513-ffcbdef548f7 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.709119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.709847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.710207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.710485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.711125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.713838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ee587-b642-495a-ba9f-c9e200739d26 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:25.728934 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3082/6153] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:25.730378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.730666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.730965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.789139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:25.790438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:25.810738 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3083/6154] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:25.811372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.813052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3072/6155] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/projects => generated 348 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:25.815498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:25.835795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf7104-9760-422a-9f93-7a0fc2bc7079 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:25.945876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:25.946428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:25.946518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:25.946787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:25.947419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:25.949363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.039756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7c6c7-f07c-468a-a3e7-174a40951da3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.060024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.060024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.060024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.060024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.060463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.060463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.087063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3073/6156] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.088285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.092605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.112926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60621768-f0f1-4b10-bc74-bd48e3b52f6f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.129539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.130356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.130638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.130951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] PATH_INFO: `/v3/projects/c26d2fe9e5e743059c97bd0af976552c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.132336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26d2fe9e5e743059c97bd0af976552c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.134313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.156955 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3084/6157] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:25 2022] POST /identity/v3/projects => generated 379 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:26.158155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.250040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a620-7152-433f-aa5d-bc252ba9e529 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.250040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.250040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.250861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.250861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.250861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:26.250861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.250861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.251487 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3085/6158] 10.222.0.64 () {58 vars in 1160 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:26.251487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.251487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.318569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e469a-df9e-4cfa-b0bf-1ae348231348 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.318569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.318569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.319043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.319043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.415966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.418922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.419807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26d2fe9e5e743059c97bd0af976552c', 'request_id': 'req-3ec817a1-73dc-433d-87a1-82a3bbd22033'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:26.436827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26d2fe9e5e743059c97bd0af976552c', 'request_id': 'req-3ec817a1-73dc-433d-87a1-82a3bbd22033'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:26.437957 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3086/6159] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:26.439197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.453495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e28fa-54fd-4fb1-a4c6-4a67044f7bea service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.535085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.536717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.537032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.537351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] PATH_INFO: `/v3/projects/ec85550047b64522b160e22f69bdec50/users/5f4ed4bdc1714e95aa941ef4a36fa381/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.570675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec85550047b64522b160e22f69bdec50, user_id=5f4ed4bdc1714e95aa941ef4a36fa381, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.577037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.594960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26d2fe9e5e743059c97bd0af976552c', 'request_id': 'req-3ec817a1-73dc-433d-87a1-82a3bbd22033'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:26.616411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] The token cache is being invalidate because project c26d2fe9e5e743059c97bd0af976552c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:26.617563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:26.618955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:26.623447 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3074/6160] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:26 2022] DELETE /identity/v3/projects/c26d2fe9e5e743059c97bd0af976552c => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:26.627063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.629838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.651818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec817a1-73dc-433d-87a1-82a3bbd22033 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.673101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.674645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.675103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.682519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.682519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.682519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd57c74-ae1c-419e-b646-ef92c6cbf311 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.727069 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3087/6161] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:26 2022] PUT /identity/v3/projects/ec85550047b64522b160e22f69bdec50/users/5f4ed4bdc1714e95aa941ef4a36fa381/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:26.728121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:26.730301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.767143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:26.815501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f193e03-3229-4d46-9f69-4b767dcf0c92 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:26.820453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:26.831431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.831431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.831431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.831431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:26.831431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73685-ca3d-489b-b5a6-9bca656f6edd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:26.843113 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3088/6162] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:52:26 2022] GET /identity/v3/domains => generated 829 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:26.843113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.843113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.843113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.868048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.872196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.872319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3075/6163] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:26.872505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:26.872756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:26.873297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:26.937206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] MFA Rules not processed for user `5f4ed4bdc1714e95aa941ef4a36fa381`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:26.938470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:26.984998 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3089/6164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:26.987142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.000209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393943c-103f-456c-8576-5eb9fa64da68 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.006436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.007233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.007674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.008137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/2c1a233bc02845ea9e7f530307644e47` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.009737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_project(project_id=2c1a233bc02845ea9e7f530307644e47)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.010965 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:27.010965 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:52:27.010965 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:52:27.011902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.028698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.029563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.099267 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3076/6165] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:27.103933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.103933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.137604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa627fe-21e4-4c7b-b2e1-aa82ebd01a0d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.266481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.267980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-589aad71-ba80-42cb-9ab0-71bcafd46987 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.270697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.271412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.271759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.272088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.272882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.286124 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3090/6166] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:52:26 2022] PATCH /identity/v3/projects/2c1a233bc02845ea9e7f530307644e47 => generated 362 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:27.288613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.289083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.289530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.290803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.307267 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3077/6167] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:27.308208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.311665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.317550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:27.318907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.332356 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3091/6168] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:27.332867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.336468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18922a-06d7-41be-89d2-5cefca28c0d5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.339772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.350469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.351629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.352058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.353295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.353747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.356651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.487816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33199366-cc50-4a0f-8dcc-026f48f23bc4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.497292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.497292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.497787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.498462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/2c1a233bc02845ea9e7f530307644e47` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.530888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2c1a233bc02845ea9e7f530307644e47)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.532030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.569615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.575717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2c1a233bc02845ea9e7f530307644e47'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.599648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3078/6169] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:27 2022] POST /identity/v3/projects => generated 373 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:27.601478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.605398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.701563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976236c-afd3-4bd1-a383-79e7378c0c8d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.709847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.712511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.712511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.712511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.712511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.726189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.745049 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3079/6170] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:27.747457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.780176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.792889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.794880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d2e1c-2a2e-4658-a204-0bf82b878afd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.803689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.872362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.873540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.873818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.874095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.874748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:27.875048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.876697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.891497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3080/6171] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:27.892386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.894255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.908415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e75f-ccea-4788-874a-d399fb26d48d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:27.913515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:27.914239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:27.914581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:27.914913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] PATH_INFO: `/v3/projects/9b68dd5ddfaf4981a5262d3ff99d4595` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:27.916171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b68dd5ddfaf4981a5262d3ff99d4595)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:27.918256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:27.955599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 2c1a233bc02845ea9e7f530307644e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:27.955895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.956617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.969460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.973566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.974940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2c1a233bc02845ea9e7f530307644e47', 'request_id': 'req-67e73428-111d-403c-b0cd-ba5437e66b86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:27.982703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3092/6172] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:27 2022] DELETE /identity/v3/projects/2c1a233bc02845ea9e7f530307644e47 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:27.983753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:27.986638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:27.996217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:28.003329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e73428-111d-403c-b0cd-ba5437e66b86 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.008400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.009124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.010465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.010824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.011613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.014001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.101537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b68dd5ddfaf4981a5262d3ff99d4595', 'request_id': 'req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.110477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b68dd5ddfaf4981a5262d3ff99d4595', 'request_id': 'req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.171807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3093/6173] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:27 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:28.171807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.173695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.191758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c96e8-5e35-4506-93d8-ab6d78ed12bf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.260813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.261745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.262698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.262972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] PATH_INFO: `/v3/projects/67c2128d3a954ae7b5bcc30d9dd495b5/users/d39fd98884c9445ea13c94a9dfbffda0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.280882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b68dd5ddfaf4981a5262d3ff99d4595', 'request_id': 'req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.301836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c2128d3a954ae7b5bcc30d9dd495b5, user_id=d39fd98884c9445ea13c94a9dfbffda0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.307209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.311116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] The token cache is being invalidate because project 9b68dd5ddfaf4981a5262d3ff99d4595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:28.311706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.314711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:28.319177 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3081/6174] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:27 2022] DELETE /identity/v3/projects/9b68dd5ddfaf4981a5262d3ff99d4595 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:28.322722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.325892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.352913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a9d5-067c-40ea-810c-4f9d2e3d4ae9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.383180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.385176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.385796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.388005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.390075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.394633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.442216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3094/6175] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:28 2022] PUT /identity/v3/projects/67c2128d3a954ae7b5bcc30d9dd495b5/users/d39fd98884c9445ea13c94a9dfbffda0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:28.442966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.454736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.568884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692323f-1b38-4a51-a6c4-c14152ee2124 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.576555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.577202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.577492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.577767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.590498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.590498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579b5da-2990-4a1f-a7d1-46d35dee3916 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.668180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3082/6176] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/projects => generated 373 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:28.669386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.671186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.795237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa6d7d-644b-4b08-bd42-41902b094092 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:28.806241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:28.806925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.807279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.807652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.808366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:28.810665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc7589-79b2-4744-8024-c30f8e8b40ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:28.827885 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3095/6177] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/projects => generated 359 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:28.830404 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3083/6178] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:28.832383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.832802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.833787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.834518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:28.835844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:28.837168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:28.862648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:28.864066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.888009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] MFA Rules not processed for user `d39fd98884c9445ea13c94a9dfbffda0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:28.890913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:28.986048 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3084/6179] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:28.988440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:28.998614 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3096/6180] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:28.998614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.008238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f110769-e715-451b-9e6f-6c2ff1e6b2b3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.010936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be5116-e581-4756-99f9-c633d1d95395 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.019896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.022130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.022130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.022130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] PATH_INFO: `/v3/projects/15be6aca034244cead8b2428c2d89391/users/7a35ba19f5b94741ba8d18ec292b65a8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.031727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.031727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.031727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.031727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.032028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.032028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.046805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15be6aca034244cead8b2428c2d89391, user_id=7a35ba19f5b94741ba8d18ec292b65a8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.050674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4c2f0-3af1-4eb0-b240-079f6fbe43b1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.167462 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3085/6181] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:28 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:29.174017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.230949 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3097/6182] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:28 2022] PUT /identity/v3/projects/15be6aca034244cead8b2428c2d89391/users/7a35ba19f5b94741ba8d18ec292b65a8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:29.236082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.236082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.236082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.258734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:29.260175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.320732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ccbcb-dac9-4f83-ac9d-944c69511d42 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.361492 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3098/6183] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:29.363150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.365678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:29.411377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.412031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.412314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.412641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/64a25c9c3c92467fbcebd6b7cc3b5e37` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.413820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=64a25c9c3c92467fbcebd6b7cc3b5e37)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.416438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.421419 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3086/6184] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/projects/64a25c9c3c92467fbcebd6b7cc3b5e37 => generated 359 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:29.426140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.450308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333c57-b60b-47b2-a58a-728fdb06f744 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.456307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f1c6f-3b97-46c1-a4fa-441ee0b071a2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.457358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.458059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.458544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.458885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.459524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.460422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.462393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.462537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.462537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.462537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.474862 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3087/6185] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:29.475758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.486843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783915a-a8a3-400b-98bc-e06cf8637e26 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.492175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.493444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.493737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.494003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.494849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.496550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.514204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3088/6186] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:29.515410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.532967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652b10-cad9-43c3-9eaa-90f4aca4063e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.538246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.538866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.539140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.540803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.541515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:29.541866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.543621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.557769 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3089/6187] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:29.558696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.573881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.576961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.580060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb8467-3c22-4524-a808-e5a4f8007034 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.605115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.606824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.607113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.607391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/64a25c9c3c92467fbcebd6b7cc3b5e37` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.609634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=64a25c9c3c92467fbcebd6b7cc3b5e37)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.612395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.613472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3099/6188] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:29.616660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.648689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1e20f-5d6a-47ec-a9c2-76e854deb1a7 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.659261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.660004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.660293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.660615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.661264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.662877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.681523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3100/6189] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:29.682623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.696630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41f7bb-21f1-4fba-af9d-1b7d105f4bb7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:29.702377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:29.703044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:29.703454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:29.703734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] PATH_INFO: `/v3/projects/15be6aca034244cead8b2428c2d89391/users/7a35ba19f5b94741ba8d18ec292b65a8/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:29.706889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15be6aca034244cead8b2428c2d89391, user_id=7a35ba19f5b94741ba8d18ec292b65a8, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:29.711102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:29.724093 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3101/6190] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:29 2022] PUT /identity/v3/projects/15be6aca034244cead8b2428c2d89391/users/7a35ba19f5b94741ba8d18ec292b65a8/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:29.737886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:29.855255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a25c9c3c92467fbcebd6b7cc3b5e37', 'request_id': 'req-ff79e165-acfd-4e83-aa36-70022a076c3e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.869092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a25c9c3c92467fbcebd6b7cc3b5e37', 'request_id': 'req-ff79e165-acfd-4e83-aa36-70022a076c3e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:29.964255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd543367-925d-4fcf-ade8-59f87b8e0c07 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.053648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.055138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.055138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.055415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.056055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.059626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0372b9-bed9-4bc7-96f5-3de2371ebd79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.068280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a25c9c3c92467fbcebd6b7cc3b5e37', 'request_id': 'req-ff79e165-acfd-4e83-aa36-70022a076c3e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.083068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 64a25c9c3c92467fbcebd6b7cc3b5e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:30.083370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.084043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:30.091804 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3090/6191] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:29 2022] DELETE /identity/v3/projects/64a25c9c3c92467fbcebd6b7cc3b5e37 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:30.091804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.105760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.120124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e165-acfd-4e83-aa36-70022a076c3e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.125531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.126186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.126467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.126743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] PATH_INFO: `/v3/projects/c601de62d08142cd9da7d47e24dbe2a1/users/d335846701274b49b588553a3fbd14a1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.147036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c601de62d08142cd9da7d47e24dbe2a1, user_id=d335846701274b49b588553a3fbd14a1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.149931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.295895 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3102/6192] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:29 2022] POST /identity/v3/projects => generated 365 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:30.297272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.297556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.297832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.309893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3091/6193] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:30 2022] PUT /identity/v3/projects/c601de62d08142cd9da7d47e24dbe2a1/users/d335846701274b49b588553a3fbd14a1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:30.311176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.322125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.367294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] MFA Rules not processed for user `7a35ba19f5b94741ba8d18ec292b65a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:30.368585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.452996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92abfb-cd17-4137-a0a4-2ab96d64949a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.472263 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3103/6194] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:30.473478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.475274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.558355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.559731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.560019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.560297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.561361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.563752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd379534-3318-4ea3-a751-cd6769413457 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.590518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a584c-07f1-448f-939b-37d4961a0442 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.595429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:30.596052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.596330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.596650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.597280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:30.599205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:30.862322 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3104/6195] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/users => generated 283 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:30.864446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:30.873012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:30.879834 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3092/6196] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/projects => generated 360 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:30.884984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ccea-c256-4c86-9f31-e258176031db None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:30.885876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ccea-c256-4c86-9f31-e258176031db None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:30.888011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ccea-c256-4c86-9f31-e258176031db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:30.903418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4042-956d-468e-93c7-28ad167c6d66 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:30.950318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3145ccea-c256-4c86-9f31-e258176031db None None] MFA Rules not processed for user `d335846701274b49b588553a3fbd14a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:30.962460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3145ccea-c256-4c86-9f31-e258176031db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.003872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.004728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.005013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.005289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] PATH_INFO: `/v3/users/17e27dd146f145d9a51697a0453f7664` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.006958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17e27dd146f145d9a51697a0453f7664)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.008873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.087979 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3093/6197] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:31.089364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145ccea-c256-4c86-9f31-e258176031db None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.092126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3145ccea-c256-4c86-9f31-e258176031db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.103132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:31.190539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145ccea-c256-4c86-9f31-e258176031db None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.197871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.198750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.199073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.199343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.285696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17e27dd146f145d9a51697a0453f7664'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:31.289008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.290748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.306985 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3094/6198] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:31.309667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.322991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6c4b7-08e5-4d6e-91be-4fa55d2ba0d3 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.328427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.329078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.329356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.329776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.330525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.332228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.348171 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3095/6199] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:31.348171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.428842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94272ff8-99de-4e96-9c63-48375439bf58 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.433924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.434647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.435018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.435360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/d4f654f25128413ea1734c67fd16ec6e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.436716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=d4f654f25128413ea1734c67fd16ec6e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.438909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.443746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3096/6200] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/projects/d4f654f25128413ea1734c67fd16ec6e => generated 360 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:31.443746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.446437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.490750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17e27dd146f145d9a51697a0453f7664'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:31.533861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17e27dd146f145d9a51697a0453f7664'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:31.565235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17e27dd146f145d9a51697a0453f7664'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:31.566154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17e27dd146f145d9a51697a0453f7664'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:31.576440 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3105/6201] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:30 2022] DELETE /identity/v3/users/17e27dd146f145d9a51697a0453f7664 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:31.577392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.579084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.641334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3b000-33ec-40d2-90e3-bc20bde42ae0 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.699795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f0c2-24d7-436f-90e1-bb52d782a0c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.705943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.706677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.707057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.707432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.708217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.710348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.752783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3106/6202] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:31.754524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:31.757079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.764303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.764954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.765234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.765509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.770612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:31.903688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db73bd-4566-42f5-b5e3-6837608f32be admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:31.914501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:31.914501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.914501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.914821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/d4f654f25128413ea1734c67fd16ec6e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.917347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4f654f25128413ea1734c67fd16ec6e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.918642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:31.920107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f65d6e-3f24-45cb-a371-fba75a8eb365 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.920957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:31.939552 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3097/6203] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:31.940975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:31.941263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:31.941556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:31.987186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:31.988425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.004923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:32.015988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3098/6204] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:32.016530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.019893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.117842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f654f25128413ea1734c67fd16ec6e', 'request_id': 'req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.136594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f654f25128413ea1734c67fd16ec6e', 'request_id': 'req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.148922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d05a97-dc81-49a7-b28c-056bdd14ce66 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.154968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f654f25128413ea1734c67fd16ec6e', 'request_id': 'req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.244423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.246415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.246860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.247344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.253414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.281108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project d4f654f25128413ea1734c67fd16ec6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:32.281108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.281108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:32.281108 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3107/6205] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:31 2022] DELETE /identity/v3/projects/d4f654f25128413ea1734c67fd16ec6e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:32.281445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.284663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.373098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.378733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.398436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3099/6206] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:32.399177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.401057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.431608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d06d2-1dd5-44f7-9ff0-12d3999fdd8a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.439882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.441040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.441325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.441600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] PATH_INFO: `/v3/projects/32c159e7b9aa43b0a725237464af91df/users/1bb27f8045614a03b4cd495689b6d10a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.468784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c159e7b9aa43b0a725237464af91df, user_id=1bb27f8045614a03b4cd495689b6d10a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.470269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403d21-fe09-4251-b34b-1b6418f4172d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.481966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee70aaa-4a8d-4756-8c62-d87873e9290b service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.493624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.494466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.494843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.495208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.501789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.541038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.544287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.566108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3100/6207] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:32.566974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:32.585644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.714886 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3108/6208] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:32 2022] PUT /identity/v3/projects/32c159e7b9aa43b0a725237464af91df/users/1bb27f8045614a03b4cd495689b6d10a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:32.725894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.726407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.726859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.765398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] MFA Rules not processed for user `1bb27f8045614a03b4cd495689b6d10a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:32.767246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:32.773044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ba22a-5fbd-407f-9ef3-1365c4b00ce6 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:32.886858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:32.887496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:32.887884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:32.888190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:32.888935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:32.891302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:32.914310 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3109/6209] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:32.919312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.042025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924edb9a-ab0f-43c2-a227-3b4fc66c75dd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.050861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.056621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.056621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.056621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.056621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.056621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.089952 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3101/6210] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/projects => generated 346 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:33.090645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.094174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.231140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbc37d-f2ef-4903-af64-9d6838a9adfe tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.238661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.238661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.238980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.239134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.241007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.256256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.258175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.272307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3102/6211] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:33.273591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.312563 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3110/6212] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:32 2022] POST /identity/v3/projects => generated 365 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:52:33.313357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.332251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.430009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251b6fc-fb98-4534-8984-68c3bc0386b2 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.523018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fedcd-7a1e-4e57-9887-a5b34ae92614 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.531952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.532743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.533088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.533465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] PATH_INFO: `/v3/projects/7e8f0f160b634aeebb04fc7f66a15f23` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.535409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8f0f160b634aeebb04fc7f66a15f23)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.537523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.582910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.583620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.583909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.584192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/b98500996bb143e98aec1d1070d23f68` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.593624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=b98500996bb143e98aec1d1070d23f68)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.601335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.609136 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3103/6213] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:33 2022] GET /identity/v3/projects/b98500996bb143e98aec1d1070d23f68 => generated 346 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:33.615291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.631880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc639b7-d378-429a-8b89-373a726f8d8b tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.640038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.640867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.641160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.641528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.642250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.644446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.728621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8f0f160b634aeebb04fc7f66a15f23', 'request_id': 'req-a8d6d346-822d-4f27-8fcf-1c559026807b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.741218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3104/6214] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:33 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:33.741218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.742247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.758054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8f0f160b634aeebb04fc7f66a15f23', 'request_id': 'req-a8d6d346-822d-4f27-8fcf-1c559026807b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.764915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04313-8e4e-4c04-ac3b-aba34217898a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.770285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8f0f160b634aeebb04fc7f66a15f23', 'request_id': 'req-a8d6d346-822d-4f27-8fcf-1c559026807b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.830296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.830844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.831121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.831391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] PATH_INFO: `/v3/users/d335846701274b49b588553a3fbd14a1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.832582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d335846701274b49b588553a3fbd14a1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.834556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:33.844200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] The token cache is being invalidate because project 7e8f0f160b634aeebb04fc7f66a15f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:33.844423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.845447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:33.853625 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3111/6215] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:33 2022] DELETE /identity/v3/projects/7e8f0f160b634aeebb04fc7f66a15f23 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:33.854937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:33.856651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:33.945010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d346-822d-4f27-8fcf-1c559026807b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:33.950949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:33.952934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:33.953212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:33.953486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/b98500996bb143e98aec1d1070d23f68` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:33.955428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b98500996bb143e98aec1d1070d23f68)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:33.957470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.077625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd335846701274b49b588553a3fbd14a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.149741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b98500996bb143e98aec1d1070d23f68', 'request_id': 'req-21f102ee-8fe2-4011-806a-e1f77f566441'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.156242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b98500996bb143e98aec1d1070d23f68', 'request_id': 'req-21f102ee-8fe2-4011-806a-e1f77f566441'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.161808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b98500996bb143e98aec1d1070d23f68', 'request_id': 'req-21f102ee-8fe2-4011-806a-e1f77f566441'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.164454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd335846701274b49b588553a3fbd14a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.179658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd335846701274b49b588553a3fbd14a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.181115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd335846701274b49b588553a3fbd14a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.181872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd335846701274b49b588553a3fbd14a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.197752 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3105/6216] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:33 2022] DELETE /identity/v3/users/d335846701274b49b588553a3fbd14a1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.198602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.200020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.280910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14133ea2-1818-4a2b-9948-ac7b899d5349 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.286139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.286835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.287190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.287980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.288353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.290123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df50d0d-61dc-4398-8e7e-a24b6d73a76a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.298168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:34.303623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project b98500996bb143e98aec1d1070d23f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:34.308087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.308087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21f102ee-8fe2-4011-806a-e1f77f566441 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:34.308087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3112/6217] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:33 2022] DELETE /identity/v3/projects/b98500996bb143e98aec1d1070d23f68 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.313261 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3106/6218] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:34.314706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.315173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.315254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.316137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.317855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.318351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.351743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:34.353098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.357440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:34.358677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.377101 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3113/6219] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:34.377101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.377549 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3107/6220] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:34.377632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.377705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.378520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.411458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6936f-6d4c-4505-89fb-e95fd9a9dd2c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.421086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.423241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.423523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.423798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] PATH_INFO: `/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025/users/5c3d27ffad584588a6ededd101069b5c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.474648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df8048-85bf-41ca-bc7f-49d1f6cf9ceb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.476246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22be5f8abaf74ab7a5f3c77b3452a025, user_id=5c3d27ffad584588a6ededd101069b5c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.479001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b0426-73b7-4dba-8251-b60fc7c69803 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.481625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.482501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.483211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.484219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.486002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.488261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.591970 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3108/6221] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:34 2022] PUT /identity/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025/users/5c3d27ffad584588a6ededd101069b5c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.594640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.595180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.596106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.613379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3114/6222] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/domains => generated 276 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:34.614176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.616471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.629635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:34.631328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:34.709633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198e6dc-6d50-42b0-b7d5-1071cfbec4e4 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.714044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.715920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.716346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.716870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.717012 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3109/6223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:34.718210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.730909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.731139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328897d4-d638-41fd-9d9a-074dc623af94 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.733111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.736779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.738101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.738523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.738800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.739499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.745480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.766980 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3110/6224] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:34.768051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.771108 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3115/6225] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:34.772006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.785411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf55e-c9df-44f0-b80b-b5ec13981743 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.790888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.791988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.792274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.792606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.793455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:34.793610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.796650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.816931 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3116/6226] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:34.816931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:34.844464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a300a3c-4ff6-4b3b-bf17-c6acd643d6f4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.854568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:34.855553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:34.855978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:34.856398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] PATH_INFO: `/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025/users/5c3d27ffad584588a6ededd101069b5c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:34.862093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22be5f8abaf74ab7a5f3c77b3452a025, user_id=5c3d27ffad584588a6ededd101069b5c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:34.865040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:34.882542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e492d-f19f-44ca-919e-4c943f06e9d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:34.889919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3117/6227] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:34 2022] PUT /identity/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025/users/5c3d27ffad584588a6ededd101069b5c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:34.891076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.020889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efde0a-3da0-4438-b9af-865c6476d592 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.037939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.038567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.038846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.039136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.039764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.040752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.042509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05528281-b206-47b9-a33b-7783dfd01543 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.043327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.043781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.044535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.045885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.050864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.203135 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3111/6228] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/projects => generated 404 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:35.206577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3118/6229] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:34 2022] POST /identity/v3/projects => generated 367 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:35.207597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.208499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.208792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.210495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.275910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] MFA Rules not processed for user `5c3d27ffad584588a6ededd101069b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:35.277423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:35.334819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006549-a6e0-48ec-8eb4-a51c22a47ca6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.341916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.342686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.343036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.343377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/7aeb82829358445d9344238d256179bf` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.346795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=7aeb82829358445d9344238d256179bf)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.358953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.371190 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3119/6230] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:35 2022] GET /identity/v3/projects/7aeb82829358445d9344238d256179bf => generated 404 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:35.374730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.452967 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3112/6231] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:35.458164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.472903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cceea35-89f7-496d-ad1c-c1eb4f09e179 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.478415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.479191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.479316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.479554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/7aeb82829358445d9344238d256179bf` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.481403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7aeb82829358445d9344238d256179bf)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.484048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.492458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f8882-65d3-43f8-9aae-feb1e8219c11 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.518688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.525448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.525448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.525448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.525448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.541798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.687075 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3120/6232] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:35 2022] POST /identity/v3/users => generated 284 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:35.688131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.703160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbd5b0-e5e4-4a9e-8016-6da8f16bd593 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:35.715395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aeb82829358445d9344238d256179bf', 'request_id': 'req-a8607f57-862a-41ea-8ec5-56e2913e525a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.734340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aeb82829358445d9344238d256179bf', 'request_id': 'req-a8607f57-862a-41ea-8ec5-56e2913e525a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.748935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:35.812730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:35.839240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aeb82829358445d9344238d256179bf', 'request_id': 'req-a8607f57-862a-41ea-8ec5-56e2913e525a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.880701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 7aeb82829358445d9344238d256179bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:35.881030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.882613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:35.883455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:35.883983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:35.884786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:35.887104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:35.887957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:35.890779 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3113/6233] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:35 2022] DELETE /identity/v3/projects/7aeb82829358445d9344238d256179bf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:35.892122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:35.892929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:35.896591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:36.007753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8607f57-862a-41ea-8ec5-56e2913e525a tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.022106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:36.022947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.023334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.023807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] PATH_INFO: `/v3/projects/c601de62d08142cd9da7d47e24dbe2a1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.026924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c601de62d08142cd9da7d47e24dbe2a1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:36.029090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:36.044116 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3121/6234] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:52:35 2022] POST /identity/v3/domains => generated 275 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:36.045321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:36.053562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:36.185545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cb151-13be-4718-8f6c-b541ba51f829 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.192467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:36.197789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.197789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.197789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.197789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:36.197789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:36.223619 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3122/6235] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:36.225398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:36.228087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:36.257438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c601de62d08142cd9da7d47e24dbe2a1', 'request_id': 'req-82b50faf-6e6c-4cdd-aa5b-05521847eb75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.273267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c601de62d08142cd9da7d47e24dbe2a1', 'request_id': 'req-82b50faf-6e6c-4cdd-aa5b-05521847eb75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.376179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c601de62d08142cd9da7d47e24dbe2a1', 'request_id': 'req-82b50faf-6e6c-4cdd-aa5b-05521847eb75'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.395655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] The token cache is being invalidate because project c601de62d08142cd9da7d47e24dbe2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:36.396440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.398449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.401922 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3114/6236] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:35 2022] DELETE /identity/v3/projects/c601de62d08142cd9da7d47e24dbe2a1 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:36.403491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:36.409925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:36.551959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b50faf-6e6c-4cdd-aa5b-05521847eb75 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.558767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:36.559799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.560294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.560806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.561724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:36.564347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:36.566429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f8220-65dc-422c-b853-706f1c848a04 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.681919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:36.684157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.684842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.691353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/8ba02f946cf14aa498fd27abbc47894e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.691596 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3115/6237] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:36 2022] POST /identity/v3/users => generated 347 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:36.691678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8ba02f946cf14aa498fd27abbc47894e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:36.691751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:36.691832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:36.694509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:36.724101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.726072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.859421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.862160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1fc7d263-fac2-45c3-a0c0-60a6124fadd3 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:36.869068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3123/6238] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:52:36 2022] PATCH /identity/v3/domains/8ba02f946cf14aa498fd27abbc47894e => generated 277 bytes in 645 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:36.877727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:36.878004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:36.878279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:36.913449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d05b01-5c90-4567-8e19-c6ccedf44f0d tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:36.965763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:36.973254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.101405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:37.102283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:37.102712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:37.103112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:37.103869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:37.107038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:37.140423 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3116/6239] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:37.140423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:37.143513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.149995 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3124/6240] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:37.151161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:37.162786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.304331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305855c-7fad-47fc-8d01-7d5e54f31c19 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:37.311045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:37.314979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:37.314979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:37.314979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/8ba02f946cf14aa498fd27abbc47894e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:37.331087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8ba02f946cf14aa498fd27abbc47894e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:37.334226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:37.335873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cda75-e1b6-45ee-b2b6-8a6e43a0fa19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:37.361134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:37.361134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:37.361134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:37.361707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:37.361707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:37.361707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:37.391958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.401205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.572582 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3117/6241] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:37 2022] POST /identity/v3/users => generated 323 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:37.573625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:37.578283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.604287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2f02a-398b-4c1d-8ea0-e78829566d31 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:37.630828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.639098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.647700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.686033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:37.687109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:37.687565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:37.687982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] PATH_INFO: `/v3/projects/7d3e207adaab4614babb8fb6e2c10f77/users/12e14ff08ea84c95bdafd89bd79083a0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:37.707874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3e207adaab4614babb8fb6e2c10f77, user_id=12e14ff08ea84c95bdafd89bd79083a0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:37.711933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:37.768919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 8ba02f946cf14aa498fd27abbc47894e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:37.769397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.770161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.780407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.784364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.785225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c06a63ae-5889-4614-8c56-5bb7f679bb4d tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8ba02f946cf14aa498fd27abbc47894e', 'request_id': 'req-c06a63ae-5889-4614-8c56-5bb7f679bb4d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:37.792860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3125/6242] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:37 2022] DELETE /identity/v3/domains/8ba02f946cf14aa498fd27abbc47894e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:37.794400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:37.794812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:37.795079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:37.834125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:37.835588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.856863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3126/6243] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:37.861357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:37.862941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.914583 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3118/6244] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:37 2022] PUT /identity/v3/projects/7d3e207adaab4614babb8fb6e2c10f77/users/12e14ff08ea84c95bdafd89bd79083a0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:37.921018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:37.922897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:37.943449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:37.991694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0a58-bb8d-4aaf-b5ea-5daf2b9eccca None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.061737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e2d95-88f5-43a0-ba40-9ab72536dc36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.067507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.068331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.068791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.069214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.071288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.072232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.072543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.072826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users/732586e20bfd46f0895ba5e727910ba0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.076522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.078994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c2c46-3820-4aca-be44-7523e1beca6e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.094715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:get_user(user_id=732586e20bfd46f0895ba5e727910ba0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.097463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.100110 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3127/6245] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:52:37 2022] GET /identity/v3/users/732586e20bfd46f0895ba5e727910ba0 => generated 347 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:38.100899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.199748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701fdef-f0c5-4941-9311-f68adc640ae2 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.206245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.207186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.208227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.208833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.209757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:38.210205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.213533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.214856 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3119/6246] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:52:37 2022] POST /identity/v3/domains => generated 274 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:38.216949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.217333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.217728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.234072 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3128/6247] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:38.235183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.254541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aebdf-f207-4645-b1bd-fb6fb9a13f4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.261544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] MFA Rules not processed for user `12e14ff08ea84c95bdafd89bd79083a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:38.263102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.343829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.344469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.344836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.345076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.346856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Adding query filter params (domain_id=3a0614844a77485cb844453e84f1c063) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:38.347154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.350050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.370716 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3129/6248] 10.222.0.64 () {58 vars in 1207 bytes} [Wed Nov 2 12:52:38 2022] GET /identity/v3/users?domain_id=3a0614844a77485cb844453e84f1c063 => generated 484 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:38.371532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.382214 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3120/6249] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:38.383651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.470028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7ff2a-1d4e-45c3-9e62-a1614a1742e3 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.476599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.477403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.477787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.478164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.480877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.484665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.491802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c9020-8bd2-44f8-9ada-7ef6c650b85c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.505693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.507021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.507301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.507724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.508366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.513069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.746242 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3130/6250] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:38 2022] POST /identity/v3/projects => generated 409 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:38.746242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.763689 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3121/6251] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:38 2022] POST /identity/v3/projects => generated 359 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:38.763689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:38.768840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:38.848084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f272-cdb8-4612-9019-cabec2b419c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.882501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eac7f8-03ad-469a-8169-3f5c6c2f05be admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:38.886740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.888174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.888456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.888769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.940306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:38.941645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:38.941645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:38.941645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:38.942379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:38.944530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:38.956233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:39.007002 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3131/6252] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:38 2022] GET /identity/v3/users => generated 8852 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:39.007002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.028027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.029952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.041193 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3122/6253] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:39.042089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.129537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17cfc70-add2-4224-8843-200a19119eb9 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.137729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.138672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.138925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.139198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.139849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.141870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.159973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956d3b1-f800-4cf6-8cb5-d3ea73e34c6a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.166298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.166920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.167764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.171889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.171889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.171889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.358968 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3132/6254] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/projects => generated 403 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:39.358968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.381255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3123/6255] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:39 2022] POST /identity/v3/users => generated 280 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:39.382122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.406467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9284ebd-666a-4d2b-92a4-98e69ce389a4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.561838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.562888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.563320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.563728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/39af0e02de3c4e7d9771b4796e4f4f81` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.564607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d175b31-b0b2-481f-9ca8-8c996d83ad18 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.566056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39af0e02de3c4e7d9771b4796e4f4f81)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.568564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.578381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.579328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.591846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.591846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.591846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1967194243) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:39.591846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.591846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.665916 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3133/6256] 10.222.0.64 () {58 vars in 1189 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/users?name=tempest-test_user-1967194243 => generated 475 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:39.667040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.749122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b44af8-4b54-4259-80f6-211dc904d562 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.754541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.755294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.755949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.755949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.756770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.758465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.772619 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3134/6257] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:39.772619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.784423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af4d4-072b-420c-a563-3bb6ac3ab2bf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.794622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39af0e02de3c4e7d9771b4796e4f4f81', 'request_id': 'req-63a9b265-27a0-4c6a-a962-793c88fa17b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:39.802147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39af0e02de3c4e7d9771b4796e4f4f81', 'request_id': 'req-63a9b265-27a0-4c6a-a962-793c88fa17b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:39.877306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.878442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.878992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.879482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:39.880413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:39.880922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:39.883176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:39.919046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39af0e02de3c4e7d9771b4796e4f4f81', 'request_id': 'req-63a9b265-27a0-4c6a-a962-793c88fa17b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:39.927427 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3135/6258] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:39.929382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.939149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 39af0e02de3c4e7d9771b4796e4f4f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:39.940187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:39.942102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:39.946171 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3124/6259] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:39 2022] DELETE /identity/v3/projects/39af0e02de3c4e7d9771b4796e4f4f81 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:39.950870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:39.954746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:39.983383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b265-27a0-4c6a-a962-793c88fa17b5 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:39.997537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:39.998262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:39.998544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:39.998816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users/3455cb0d271f4a1db345241d40e4e702` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.032285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95784a-80a5-40de-86f4-36ebd4b2ee7c tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.034927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3455cb0d271f4a1db345241d40e4e702)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.041644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.046617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.047546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.047811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.048216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.049008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.054720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.089378 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3136/6260] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:40.090649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.097895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:40.250796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b56556-e5bf-4901-bbb5-e51e5310bfe1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.262342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.263021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.263341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.263576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/cd2f4a8ef1a345b7b500d6e1908b2c71` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.282567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cd2f4a8ef1a345b7b500d6e1908b2c71)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.287898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.315219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3455cb0d271f4a1db345241d40e4e702'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.415279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3455cb0d271f4a1db345241d40e4e702'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.436846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3455cb0d271f4a1db345241d40e4e702'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.437625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3455cb0d271f4a1db345241d40e4e702'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.438240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3455cb0d271f4a1db345241d40e4e702'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.454462 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3125/6261] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:39 2022] DELETE /identity/v3/users/3455cb0d271f4a1db345241d40e4e702 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:40.464340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.464340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:40.526008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2f4a8ef1a345b7b500d6e1908b2c71', 'request_id': 'req-24ce0090-385c-48b8-86db-c727dd6da826'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.548847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2f4a8ef1a345b7b500d6e1908b2c71', 'request_id': 'req-24ce0090-385c-48b8-86db-c727dd6da826'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.576747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2f4a8ef1a345b7b500d6e1908b2c71', 'request_id': 'req-24ce0090-385c-48b8-86db-c727dd6da826'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.639653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473143d-cfa1-43a7-b910-3975fab2b413 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.679995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project cd2f4a8ef1a345b7b500d6e1908b2c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:40.680643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.681477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:40.684598 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3137/6262] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:40 2022] DELETE /identity/v3/projects/cd2f4a8ef1a345b7b500d6e1908b2c71 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:40.685651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.689854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:40.771095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.771783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.772313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.772626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] PATH_INFO: `/v3/projects/71d14f22e3da4c8c974fbc239c9614cb/users/cb79f24ffb11419b862e2f1e465def8a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.801396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d14f22e3da4c8c974fbc239c9614cb, user_id=cb79f24ffb11419b862e2f1e465def8a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.802868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0090-385c-48b8-86db-c727dd6da826 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:40.804182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.810110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:40.811249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:40.814346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:40.814346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/users/732586e20bfd46f0895ba5e727910ba0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:40.814346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:delete_user(user_id=732586e20bfd46f0895ba5e727910ba0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:40.815699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:40.942363 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3126/6263] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:40 2022] PUT /identity/v3/projects/71d14f22e3da4c8c974fbc239c9614cb/users/cb79f24ffb11419b862e2f1e465def8a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:40.943278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:40.953045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.018273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732586e20bfd46f0895ba5e727910ba0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.114087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732586e20bfd46f0895ba5e727910ba0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.133730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732586e20bfd46f0895ba5e727910ba0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.140776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb194f89-da48-4f3d-88cd-367e1d814e72 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.148949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732586e20bfd46f0895ba5e727910ba0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.150607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6c888757-740e-4da7-b105-8eb1ebf77589 tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732586e20bfd46f0895ba5e727910ba0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.151925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.153926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.154228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.154508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.158612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=62e9cb8eb8bc4a34ad277334fd78c2c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.161934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.172163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3138/6264] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:40 2022] DELETE /identity/v3/users/732586e20bfd46f0895ba5e727910ba0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:41.172163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.172163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.172163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.207771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:41.225720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.227078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.263867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] MFA Rules not processed for user `cb79f24ffb11419b862e2f1e465def8a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:41.266286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.380679 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3139/6265] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:41.385789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.387270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.415735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.416403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.426653 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3127/6266] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:52:40 2022] PATCH /identity/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1 => generated 275 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:41.428967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.431097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.486892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45c254-1d44-428f-ad6b-0a21dfd8fe29 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.492146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.492917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.493241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.493664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/domains/3a0614844a77485cb844453e84f1c063` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.495042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3a0614844a77485cb844453e84f1c063)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.498785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.529876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a36f5d-d89c-4048-8c32-06c20f70b98c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.535174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.536177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.536692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.537813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.539907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.540697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.557283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.577414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.579254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:41.591889 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3128/6267] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:41.592839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.594918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.708704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f22819-452a-4d58-a6ce-6d5264d4fb34 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:41.767926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.770278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:41.788338 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3140/6268] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:52:41 2022] PATCH /identity/v3/domains/3a0614844a77485cb844453e84f1c063 => generated 276 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:41.789401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:41.795363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:41.907591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:41.908725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:41.910540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:41.910773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:41.946114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=62e9cb8eb8bc4a34ad277334fd78c2c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:41.954108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:42.014031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602b3a4-6b28-4ecd-9975-a92e6b2f034f tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:42.033065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:42.033727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.034002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.034251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.034359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] PATH_INFO: `/v3/users/9cf542cf5b224a04aa1580bf52e0192c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.037201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf542cf5b224a04aa1580bf52e0192c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:42.039063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:42.066091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.368735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf542cf5b224a04aa1580bf52e0192c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.397765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.442988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.600171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf542cf5b224a04aa1580bf52e0192c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.616476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf542cf5b224a04aa1580bf52e0192c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.625330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf542cf5b224a04aa1580bf52e0192c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.626507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf542cf5b224a04aa1580bf52e0192c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.637992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3141/6269] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:41 2022] DELETE /identity/v3/users/9cf542cf5b224a04aa1580bf52e0192c => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:42.642475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:42.642475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.781533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.801029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 62e9cb8eb8bc4a34ad277334fd78c2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:42.801029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.819053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e17b7-cb23-4f93-a07a-5bbe152e6571 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:42.819966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.841807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3d27ffad584588a6ededd101069b5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22be5f8abaf74ab7a5f3c77b3452a025', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:42.844380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.845930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.846194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] PATH_INFO: `/v3/domains/3a0614844a77485cb844453e84f1c063` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.863194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.880520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3a0614844a77485cb844453e84f1c063)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:42.882479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:42.884129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.887280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e81b07e-7102-4551-abfb-333b956d5dbd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '62e9cb8eb8bc4a34ad277334fd78c2c1', 'request_id': 'req-0e81b07e-7102-4551-abfb-333b956d5dbd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.915100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3129/6270] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:41 2022] DELETE /identity/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1 => generated 0 bytes in 1319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:42.915100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:42.915100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:42.916376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:42.961579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:42.963030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:42.982531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:42.998817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3a0614844a77485cb844453e84f1c063'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.141533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3130/6271] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:43.145378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:43.149205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:43.281889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.293908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.311489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.345073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f3936-9d94-4d19-b54c-f9368ec95fcc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:43.498862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] The token cache is being invalidate because project 3a0614844a77485cb844453e84f1c063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:43.499379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.500680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.515701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.522488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.523762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3a0614844a77485cb844453e84f1c063', 'request_id': 'req-f03d5f12-5677-4b15-aa3c-ab81743da56a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:43.541039 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3142/6272] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:42 2022] DELETE /identity/v3/domains/3a0614844a77485cb844453e84f1c063 => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:43.542232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:43.547816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:43.638419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:43.670647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:43.678236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:43.678236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:43.678653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:43.680984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:43.689389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:43.703089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5f12-5677-4b15-aa3c-ab81743da56a tempest-UsersV3TestJSON-728755906 tempest-UsersV3TestJSON-728755906-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:43.718348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:43.718348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:43.718348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:43.718348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:43.721289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:43.781426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:43.877063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3131/6273] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:43 2022] POST /identity/v3/projects => generated 378 bytes in 731 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:43.878872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:43.885417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:43.938114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:43.941681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:43.969602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3143/6274] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:43.972114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:43.975639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:44.011520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85141f-27cc-4ac8-b314-adc8f56329bc service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.115859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031ecf4-5f05-4bdc-9a32-5f5692eaf9dd tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.128174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.134619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.135715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.136996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] PATH_INFO: `/v3/users/1bb27f8045614a03b4cd495689b6d10a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.141311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb27f8045614a03b4cd495689b6d10a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.144088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:44.199920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.202750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.203958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.208667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/0a680a21e61d468a961fea9a03b1b7aa` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.209851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=0a680a21e61d468a961fea9a03b1b7aa)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.218891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:44.242086 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3144/6275] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:43 2022] GET /identity/v3/projects/0a680a21e61d468a961fea9a03b1b7aa => generated 378 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:44.250700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:44.283747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c403e-9f2b-422a-b1a3-d44fb9ed99c1 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.306871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.308988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.310720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.311341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.313778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.315843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:44.386137 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3145/6276] 10.222.0.64 () {58 vars in 1131 bytes} [Wed Nov 2 12:52:44 2022] GET /identity/v3/projects => generated 7239 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:44.394611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:44.413928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cddbe1-e3be-4517-9650-b5e88acfbec9 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.429440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.431007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.431573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.432203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/0a680a21e61d468a961fea9a03b1b7aa` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.436109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a680a21e61d468a961fea9a03b1b7aa)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.439429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:44.555376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb27f8045614a03b4cd495689b6d10a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.643855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb27f8045614a03b4cd495689b6d10a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.652710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a680a21e61d468a961fea9a03b1b7aa', 'request_id': 'req-642033ce-ae63-44e6-a4f8-f201d008f8a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.664829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a680a21e61d468a961fea9a03b1b7aa', 'request_id': 'req-642033ce-ae63-44e6-a4f8-f201d008f8a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.669113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb27f8045614a03b4cd495689b6d10a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.670387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb27f8045614a03b4cd495689b6d10a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.671146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b9895de-7a3c-49c0-9acd-a957370e26de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb27f8045614a03b4cd495689b6d10a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.674710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a680a21e61d468a961fea9a03b1b7aa', 'request_id': 'req-642033ce-ae63-44e6-a4f8-f201d008f8a7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.687574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3132/6277] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:43 2022] DELETE /identity/v3/users/1bb27f8045614a03b4cd495689b6d10a => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:44.691954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.692246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.692552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.715496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:44.717441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:44.784686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 0a680a21e61d468a961fea9a03b1b7aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:44.784686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.785015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:44.788057 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3146/6278] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:44 2022] DELETE /identity/v3/projects/0a680a21e61d468a961fea9a03b1b7aa => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:44.795568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:44.800757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:44.820626 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3133/6279] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:44.835053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:44.837121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:44.886452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642033ce-ae63-44e6-a4f8-f201d008f8a7 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.915362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5080d964-bd5b-4128-8f25-0c19a39aec33 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:44.919877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.920783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.920981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.921250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.937607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.941826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:44.956417 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3134/6280] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:44.988771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:44.995371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:44.995371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:44.995371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:44.995371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:44.995371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:45.134844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3147/6281] 10.222.0.64 () {60 vars in 1152 bytes} [Wed Nov 2 12:52:44 2022] POST /identity/v3/projects => generated 347 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:45.137459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:45.153044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef1ca6-1f84-4dd8-b281-d91a5b6994ea service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:45.219355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:45.220121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:45.220525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:45.220909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/99bf45440c144954a92b7a35a12f7161` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:45.222479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_project(project_id=99bf45440c144954a92b7a35a12f7161)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:45.224629 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:45.224629 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:52:45.224629 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:52:45.226485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:45.262587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:45.364949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:45.403957 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3135/6282] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:52:45 2022] PATCH /identity/v3/projects/99bf45440c144954a92b7a35a12f7161 => generated 360 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:45.408769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:45.427308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18113-7987-4861-a4ca-2d082fd6ba85 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:45.434917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:45.439161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:45.439161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:45.439161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/99bf45440c144954a92b7a35a12f7161` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:45.467658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=99bf45440c144954a92b7a35a12f7161)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:45.470714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:45.479388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:45.490375 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3148/6283] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:45 2022] GET /identity/v3/projects/99bf45440c144954a92b7a35a12f7161 => generated 347 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:45.501671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db58afe-3103-4ad1-882c-4ea1adea329e tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:45.513554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:45.514194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:45.514652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:45.515027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/99bf45440c144954a92b7a35a12f7161` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:45.516431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=99bf45440c144954a92b7a35a12f7161)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:45.520633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:45.571741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:45.576288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:45.746889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439077f-a522-4be9-93ca-fdf886a54598 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:45.755654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:45.755897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:45.757392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:45.757392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] PATH_INFO: `/v3/projects/d07448f47fb941c2bb152c22ae2fe7c1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:45.759420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07448f47fb941c2bb152c22ae2fe7c1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:45.762433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:45.830560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bf45440c144954a92b7a35a12f7161', 'request_id': 'req-04c678fb-a783-4012-ba3b-d3ef4a64b23f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:45.850740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bf45440c144954a92b7a35a12f7161', 'request_id': 'req-04c678fb-a783-4012-ba3b-d3ef4a64b23f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:45.965786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bf45440c144954a92b7a35a12f7161', 'request_id': 'req-04c678fb-a783-4012-ba3b-d3ef4a64b23f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.011114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 99bf45440c144954a92b7a35a12f7161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:46.011406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.013292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.019627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3136/6284] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:45 2022] DELETE /identity/v3/projects/99bf45440c144954a92b7a35a12f7161 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:46.030216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:46.030458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07448f47fb941c2bb152c22ae2fe7c1', 'request_id': 'req-d518a924-f625-4766-80d4-fb268814e2a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.036855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:46.043818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07448f47fb941c2bb152c22ae2fe7c1', 'request_id': 'req-d518a924-f625-4766-80d4-fb268814e2a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.051266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07448f47fb941c2bb152c22ae2fe7c1', 'request_id': 'req-d518a924-f625-4766-80d4-fb268814e2a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.171920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] The token cache is being invalidate because project d07448f47fb941c2bb152c22ae2fe7c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:46.171920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.171920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.171920 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3149/6285] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:45 2022] DELETE /identity/v3/projects/d07448f47fb941c2bb152c22ae2fe7c1 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:46.175533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:46.177193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:46.203278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c678fb-a783-4012-ba3b-d3ef4a64b23f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:46.315251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518a924-f625-4766-80d4-fb268814e2a8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:46.333793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:46.334544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.336410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.336410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] PATH_INFO: `/v3/users/d94d0a36d381464c94e913afc03bb2d1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.337340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94d0a36d381464c94e913afc03bb2d1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:46.338723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:46.442548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:46.443242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.443572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:46.444004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:46.446418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:46.451104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:46.894036 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3137/6286] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:46 2022] POST /identity/v3/projects => generated 361 bytes in 863 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:46.894036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:46.897248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:46.902302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94d0a36d381464c94e913afc03bb2d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:46.987962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16075b-01a3-4fd9-af27-53bc8143ae5c tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:46.995268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:46.996054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:46.996659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.002753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] PATH_INFO: `/v3/projects/32c159e7b9aa43b0a725237464af91df` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.002753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c159e7b9aa43b0a725237464af91df)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.003162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.169914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94d0a36d381464c94e913afc03bb2d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.199880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94d0a36d381464c94e913afc03bb2d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.234518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94d0a36d381464c94e913afc03bb2d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.235278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94d0a36d381464c94e913afc03bb2d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.255090 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3150/6287] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:46 2022] DELETE /identity/v3/users/d94d0a36d381464c94e913afc03bb2d1 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:47.256112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.259597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c159e7b9aa43b0a725237464af91df', 'request_id': 'req-7520ad61-4558-4259-87a7-7ab89f9795b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.269719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.277647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c159e7b9aa43b0a725237464af91df', 'request_id': 'req-7520ad61-4558-4259-87a7-7ab89f9795b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.492652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a94a1-540e-441d-a184-633d404bd8a1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.495125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c159e7b9aa43b0a725237464af91df', 'request_id': 'req-7520ad61-4558-4259-87a7-7ab89f9795b9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.513217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.514795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.515544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.516195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/7a331b3f83f249dc84fa39f4392faf70` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.519442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_project(project_id=7a331b3f83f249dc84fa39f4392faf70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.523771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.538054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] The token cache is being invalidate because project 32c159e7b9aa43b0a725237464af91df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:47.538373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.543966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:47.546061 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3138/6288] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:46 2022] DELETE /identity/v3/projects/32c159e7b9aa43b0a725237464af91df => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:47.549887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.551329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.699785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520ad61-4558-4259-87a7-7ab89f9795b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.717360 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3151/6289] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:52:47 2022] PATCH /identity/v3/projects/7a331b3f83f249dc84fa39f4392faf70 => generated 373 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:47.720427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.730300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:47.766779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ced8b-7c18-409c-bc5e-df20be8fa4cb tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.781294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.783146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.783663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.783959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/7a331b3f83f249dc84fa39f4392faf70` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.814550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=7a331b3f83f249dc84fa39f4392faf70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.818525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.824532 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3152/6290] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:47 2022] GET /identity/v3/projects/7a331b3f83f249dc84fa39f4392faf70 => generated 360 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:47.825323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:47.846783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487ea8c-6cb5-4ae2-b517-f83a3d72d6d6 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:47.865990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.876279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.876385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:47.876385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:47.876906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.877239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/7a331b3f83f249dc84fa39f4392faf70` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.878131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:47.879029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7a331b3f83f249dc84fa39f4392faf70)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.880648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] PATH_INFO: `/v3/users/5c3d27ffad584588a6ededd101069b5c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:47.883240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3d27ffad584588a6ededd101069b5c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:47.895610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:47.897960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:48.252816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3d27ffad584588a6ededd101069b5c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.274457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a331b3f83f249dc84fa39f4392faf70', 'request_id': 'req-83268def-eaee-4acc-a7de-f96f53ab3bf2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.289336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a331b3f83f249dc84fa39f4392faf70', 'request_id': 'req-83268def-eaee-4acc-a7de-f96f53ab3bf2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.299758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a331b3f83f249dc84fa39f4392faf70', 'request_id': 'req-83268def-eaee-4acc-a7de-f96f53ab3bf2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.443859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3d27ffad584588a6ededd101069b5c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.470948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3d27ffad584588a6ededd101069b5c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.474457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3d27ffad584588a6ededd101069b5c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.475206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3d27ffad584588a6ededd101069b5c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.503322 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3139/6291] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:47 2022] DELETE /identity/v3/users/5c3d27ffad584588a6ededd101069b5c => generated 0 bytes in 954 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:48.588837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 7a331b3f83f249dc84fa39f4392faf70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:48.589966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.595391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:48.599610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3153/6292] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:47 2022] DELETE /identity/v3/projects/7a331b3f83f249dc84fa39f4392faf70 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:48.613126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:48.614648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:48.759712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989244e6-6602-4d10-bed0-aed43aa935c7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:48.774286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:48.774862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:48.775146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:48.775441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:48.776102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:48.778050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:48.914868 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3140/6293] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:48 2022] POST /identity/v3/projects => generated 352 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:48.918069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:48.919982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.030660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:49.042506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:49.042506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.149232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83268def-eaee-4acc-a7de-f96f53ab3bf2 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.185559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef868d-0fbe-42b4-91f8-b5a131a3da2f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.194686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.195785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.196248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.199193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] PATH_INFO: `/v3/projects/d494ddf087f24e208945f4357dfbf2c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.234297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d494ddf087f24e208945f4357dfbf2c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.250241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.267887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.269359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.269825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.271179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.275038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:update_project(project_id=9bb64e0b490e42eeb8e0d99b173b4514)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.280727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.346871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:49.424625 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3154/6294] 10.222.0.64 () {60 vars in 1252 bytes} [Wed Nov 2 12:52:48 2022] PATCH /identity/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514 => generated 368 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:49.429209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:49.448716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd494ddf087f24e208945f4357dfbf2c1', 'request_id': 'req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.451985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5a40a-78ad-4a39-96ff-a5ee38a11c20 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.465940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd494ddf087f24e208945f4357dfbf2c1', 'request_id': 'req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.569011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd494ddf087f24e208945f4357dfbf2c1', 'request_id': 'req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.590254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] The token cache is being invalidate because project d494ddf087f24e208945f4357dfbf2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:49.591730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.593654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-80ff5d29-2956-4ab7-a3ce-be5407bd6b6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.596302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3141/6295] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:49 2022] DELETE /identity/v3/projects/d494ddf087f24e208945f4357dfbf2c1 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:52:49.601549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a47f-dc68-49fd-8d33-84034378702d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.602089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a47f-dc68-49fd-8d33-84034378702d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.602518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a47f-dc68-49fd-8d33-84034378702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.633211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.633211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.633469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-29a4a47f-dc68-49fd-8d33-84034378702d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:49.633571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.634417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.636361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29a4a47f-dc68-49fd-8d33-84034378702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.684380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:get_project(project_id=9bb64e0b490e42eeb8e0d99b173b4514)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.688402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.692832 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3155/6296] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:52:49 2022] GET /identity/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514 => generated 355 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:49.696893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:49.702229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.725647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb13bd1-4504-4b44-96de-93f534f67a7f tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.741019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.741970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.742686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.743069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.745576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9bb64e0b490e42eeb8e0d99b173b4514)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.748890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.785962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3142/6297] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:49.788353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.788992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.789289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.834093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:49.835122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:49.856391 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3143/6298] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:49.861626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:49.892252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9bf82-1ee0-43b4-a903-3e45345ec3d0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:49.922032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:49.925593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:49.927113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:49.928805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:49.930064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:49.932682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:49.939275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:49.957209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb64e0b490e42eeb8e0d99b173b4514', 'request_id': 'req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:49.966181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:50.002404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb64e0b490e42eeb8e0d99b173b4514', 'request_id': 'req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.006306 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3144/6299] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:52:50.010893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.037063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb64e0b490e42eeb8e0d99b173b4514', 'request_id': 'req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.056361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf21f66-e055-4831-8120-70e09a0374c2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.139462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] The token cache is being invalidate because project 9bb64e0b490e42eeb8e0d99b173b4514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:50.140898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.142650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.149064 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3156/6300] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:49 2022] DELETE /identity/v3/projects/9bb64e0b490e42eeb8e0d99b173b4514 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:50.154282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.162984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:50.264286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.265368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.269227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.269227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.269227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.270586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.361102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8b1e3-6c86-4db9-8eb6-e13ec4439691 tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.366896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.368024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.368606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.369022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] PATH_INFO: `/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.371357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22be5f8abaf74ab7a5f3c77b3452a025)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.375485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.448628 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3145/6301] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:50 2022] POST /identity/v3/projects => generated 379 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:50.450239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.461722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:50.607312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c431b-dc96-492f-ac28-f55cba26de1e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.618091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.618920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.619826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.620115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.653742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Could not find domain: 62e9cb8eb8bc4a34ad277334fd78c2c1.: keystone.exception.DomainNotFound: Could not find domain: 62e9cb8eb8bc4a34ad277334fd78c2c1. Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 62e9cb8eb8bc4a34ad277334fd78c2c1. Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:52:50.661891 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:52:50.662998 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application with Lock( Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 62e9cb8eb8bc4a34ad277334fd78c2c1. Nov 02 12:52:50.663897 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:52:50.668114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3146/6302] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:52:50 2022] PATCH /identity/v3/domains/62e9cb8eb8bc4a34ad277334fd78c2c1 => generated 112 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:52:50.670088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.676228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:50.703741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22be5f8abaf74ab7a5f3c77b3452a025', 'request_id': 'req-0d6bf838-060c-45d2-8e26-919fa5b34737'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.714958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22be5f8abaf74ab7a5f3c77b3452a025', 'request_id': 'req-0d6bf838-060c-45d2-8e26-919fa5b34737'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.724869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22be5f8abaf74ab7a5f3c77b3452a025', 'request_id': 'req-0d6bf838-060c-45d2-8e26-919fa5b34737'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.784173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8b6c-7ce5-40df-8814-be061eee87db tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:50.871982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:50.872786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:50.873141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:50.873485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:50.874210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:50.876401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34828a-ff6e-4b0f-bafe-43b020ae63be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:50.943345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] The token cache is being invalidate because project 22be5f8abaf74ab7a5f3c77b3452a025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:50.943645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.947119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:50.952348 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3157/6303] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:50 2022] DELETE /identity/v3/projects/22be5f8abaf74ab7a5f3c77b3452a025 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:50.953439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:50.958857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.101769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6bf838-060c-45d2-8e26-919fa5b34737 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.107685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'acdfaefc3cd643e0873be70cd69ad9d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.113082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.113582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.114041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] PATH_INFO: `/v3/domains/8ba02f946cf14aa498fd27abbc47894e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.127473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 02 12:52:51.132732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3147/6304] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:50 2022] POST /identity/v3/users => generated 290 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Could not find domain: 8ba02f946cf14aa498fd27abbc47894e.: keystone.exception.DomainNotFound: Could not find domain: 8ba02f946cf14aa498fd27abbc47894e. Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8ba02f946cf14aa498fd27abbc47894e. Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:52:51.134177 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:52:51.135963 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.get_or_create( Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application with Lock( Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._enter() Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.creator() Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application created_value = creator( Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8ba02f946cf14aa498fd27abbc47894e. Nov 02 12:52:51.146743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:52:51.154222 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3158/6305] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:52:50 2022] PATCH /identity/v3/domains/8ba02f946cf14aa498fd27abbc47894e => generated 112 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:52:51.154222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.154222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.156786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.157659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.158279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.163229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16372f44-0134-4c36-a8a1-9608eafb94de tempest-ProjectsTestJSON-1777216579 tempest-ProjectsTestJSON-1777216579-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.170042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.171112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.171575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.172281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.173168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.178745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.212840 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3159/6306] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:51.215460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.219844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:51.219998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.221719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.253761 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3148/6307] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:51.254896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.278303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069483ae-2803-4f20-a469-ac89677b3227 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.313459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.314057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.314332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.314602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] PATH_INFO: `/v3/users/c4c089a623e7465e9307f79f174382b1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.317120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310edac-f0a0-4daa-a987-baa92aa07c62 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.318475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c089a623e7465e9307f79f174382b1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.320424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.339309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.339309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.339309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.339309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.339949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.341606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d361c2c-002a-4ce9-9abd-d0fb1515c124 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.369289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3149/6308] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:51.370630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.371176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.371451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.428978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:51.430313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:51.450429 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3150/6309] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:51.451292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.476399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2db859-456f-4978-9aa0-1930a13ac0a4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.487265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.488065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.488349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.488650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] PATH_INFO: `/v3/projects/e76a4d0d270c4f46a34df991233cb35e/users/6fb0311da6104d1b924dae3a5e43f843/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.557117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76a4d0d270c4f46a34df991233cb35e, user_id=6fb0311da6104d1b924dae3a5e43f843, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.559837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.766899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3151/6310] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:51 2022] PUT /identity/v3/projects/e76a4d0d270c4f46a34df991233cb35e/users/6fb0311da6104d1b924dae3a5e43f843/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:51.768234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:51.890187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57532e-b069-4ea3-a358-ada82031ebca admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:51.901720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:51.902734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.903011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.903986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:51.905475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:51.906557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:51.909230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022d138-affc-4645-ac52-c3162cdcd5c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:51.920975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c089a623e7465e9307f79f174382b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:51.929258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3152/6311] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:51.930942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:51.932099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:51.937548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.005990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] MFA Rules not processed for user `6fb0311da6104d1b924dae3a5e43f843`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:52.011530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.037417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c089a623e7465e9307f79f174382b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.078117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c089a623e7465e9307f79f174382b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.095265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c089a623e7465e9307f79f174382b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.095265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c089a623e7465e9307f79f174382b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.106360 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3160/6312] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:51 2022] DELETE /identity/v3/users/c4c089a623e7465e9307f79f174382b1 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:52.109039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.110823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.117203 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3153/6313] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:52.122946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.124592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.143118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f37e6-7dea-41bc-8486-f12d22540ce4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.273888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.276280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.276686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.277482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] PATH_INFO: `/v3/users/100f54b207074f79a3600c380b5d13bc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.278379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39d437-6117-40af-aa6d-66e723112c20 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.281214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=100f54b207074f79a3600c380b5d13bc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.291825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.297011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.297908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.298189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.298469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.299124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.301134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a422-7b73-4e7f-aeeb-6dc06ce025b5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.381584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:52.498523 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3161/6314] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/projects => generated 375 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:52.504424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.504748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.505027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.558607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:52.559897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.656161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3162/6315] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:52.656161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.660029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:52.674877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721fdca-4069-4e1f-a9bc-74e0a5395750 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.681126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:52.682106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:52.682683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:52.683110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:52.683926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:52.686503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:52.754753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100f54b207074f79a3600c380b5d13bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.841162 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3163/6316] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:52.842036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.920473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100f54b207074f79a3600c380b5d13bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.941710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100f54b207074f79a3600c380b5d13bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.942516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100f54b207074f79a3600c380b5d13bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.943203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100f54b207074f79a3600c380b5d13bc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:52.960088 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3154/6317] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:52 2022] DELETE /identity/v3/users/100f54b207074f79a3600c380b5d13bc => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:52.961192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:52.961378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f8dc0-866f-4cb4-bac2-03d4e8417783 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:52.963844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.073533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36706f-d953-4d97-a08f-bb81e6380370 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.078941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.079909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.083546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.085023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.085566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.086054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.086200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.086388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.088459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.089702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.092025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b83579-072e-40dd-baa4-c6d17d93b115 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.115034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.115034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.127075 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3155/6318] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:53.127924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.129638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.155319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8203-214b-469e-9140-fa32ee0a8835 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.172278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.172278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.172278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.172278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.172786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.176916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.277795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:53.402559 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3164/6319] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:52 2022] POST /identity/v3/users => generated 288 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:53.402559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.402904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.404012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.436578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:53.437786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.451207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3165/6320] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:53.452350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.457065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.478282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3156/6321] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:53 2022] POST /identity/v3/users => generated 294 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:53.479124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.479882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f58f9c-6d25-46fb-ac16-37af8c39a26a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.485853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.486835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.487012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:53.487435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.491610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.492789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.495500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.515030 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3166/6322] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:53.517452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.535976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268102ec-5b2b-47ad-9601-b5b9587f4edc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.536160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3b396-e7d1-4d10-b665-2825eab10d1a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.539850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.540808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.541325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.541807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.542701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.543172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.543901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.544181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.545130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.545520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.557718 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3167/6323] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:53.559092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.566454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.569630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.573120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfe03f-6a48-4f8e-890c-343f235b95ea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.578875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.579928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.581762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.581762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.581762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.583543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.612623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3157/6324] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:53.618057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.620293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3168/6325] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:53.622501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:53.643089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97b52-9b5b-4698-9ae4-227f31d67386 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.649276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.652173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1253813-f375-43c9-8203-052d5184e8cf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:53.656767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.657087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.657370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] PATH_INFO: `/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f/users/1cd8fa67eebe49d28123221da4c6fd93/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.658579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:53.659520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.660221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.660834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] PATH_INFO: `/v3/projects/a2e770e3f5b5476e93b61cb9871d77e7/users/3a3f3cc0ccf44e67924ba05bd445b9d2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.699740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2e770e3f5b5476e93b61cb9871d77e7, user_id=3a3f3cc0ccf44e67924ba05bd445b9d2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.703214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821ef4-456c-42ad-abef-d0f28b1ace34 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.739717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52a994bd3224e4fa01ffbb5e13cfe7f, user_id=1cd8fa67eebe49d28123221da4c6fd93, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:53.739717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:53.948727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3169/6326] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:53 2022] PUT /identity/v3/projects/a2e770e3f5b5476e93b61cb9871d77e7/users/3a3f3cc0ccf44e67924ba05bd445b9d2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:53.963495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:53.964062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:53.964062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:53.966302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3158/6327] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:53 2022] PUT /identity/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f/users/1cd8fa67eebe49d28123221da4c6fd93/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:53.970057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.022951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] MFA Rules not processed for user `3a3f3cc0ccf44e67924ba05bd445b9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:54.025609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.056974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb083c4b-4e28-4408-9dfe-6e32df0bb159 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.064241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.065135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.065572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.066030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.066830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.069698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.090758 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3159/6328] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:52:54.092570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.094472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.137164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3170/6329] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:54.138506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.160727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ca97-fa54-46b8-b9c3-db54cb741680 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.172559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.173533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.174031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.174568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] PATH_INFO: `/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f/users/1cd8fa67eebe49d28123221da4c6fd93/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.177268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a52a994bd3224e4fa01ffbb5e13cfe7f, user_id=1cd8fa67eebe49d28123221da4c6fd93, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.181357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.202412 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3171/6330] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:54 2022] PUT /identity/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f/users/1cd8fa67eebe49d28123221da4c6fd93/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:54.204033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.206342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.229105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3338fc24-42c1-4ede-8703-d39566e2c057 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.319620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ded5f2-7957-4bd1-a2de-e93a5039daaa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.328169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.329409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.329816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.330297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] PATH_INFO: `/v3/projects/10a6938d401e44a3933549dbb7943abd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.331897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=10a6938d401e44a3933549dbb7943abd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.334806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.338819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.339964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.340468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.340985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.343250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.363263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.365158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.397855 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3160/6331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:54.399275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.414399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438db11-3ef3-4aa4-937f-9707e6f229ba service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.421703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.422493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.422957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.423375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.424880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.427449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd43ca8-3248-486b-a512-227c8acfc434 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.496306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10a6938d401e44a3933549dbb7943abd', 'request_id': 'req-7052d6b6-941c-4849-8441-92f815c0d0af'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:54.502722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10a6938d401e44a3933549dbb7943abd', 'request_id': 'req-7052d6b6-941c-4849-8441-92f815c0d0af'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:54.509221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10a6938d401e44a3933549dbb7943abd', 'request_id': 'req-7052d6b6-941c-4849-8441-92f815c0d0af'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:54.633963 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3161/6332] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:54.636513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.636784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.637080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.671273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] MFA Rules not processed for user `1cd8fa67eebe49d28123221da4c6fd93`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:54.672920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.685767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] The token cache is being invalidate because project 10a6938d401e44a3933549dbb7943abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:54.686740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:54.687580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:54.689457 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3172/6333] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:54 2022] DELETE /identity/v3/projects/10a6938d401e44a3933549dbb7943abd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:54.691456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.693559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.789955 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3162/6334] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:54.789955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:54.798060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:54.825669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052d6b6-941c-4849-8441-92f815c0d0af admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.894162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7f28e-7afb-4919-a78a-0bf282be2e81 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:54.899436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.900252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.900712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.901138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.901920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.902517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:54.903459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:54.904585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf714fd8-2ca5-49f6-91bc-5f04370ab5ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:54.905164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:54.906342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] PATH_INFO: `/v3/projects/31253f3142d44bf9b19240622d090444` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:54.908838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31253f3142d44bf9b19240622d090444)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:54.913906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.117985 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3163/6335] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:54 2022] POST /identity/v3/users => generated 294 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:55.119539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.119968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.120250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.141139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:55.142386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.156151 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3164/6336] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:55.169078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.169078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.178010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31253f3142d44bf9b19240622d090444', 'request_id': 'req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.187459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31253f3142d44bf9b19240622d090444', 'request_id': 'req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.195406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31253f3142d44bf9b19240622d090444', 'request_id': 'req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.221721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea11e7-08a3-48e7-9209-8a8259cf8bd1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.277460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.278088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.278297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.278528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.280480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.344223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.345833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.356905 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3165/6337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:55.357759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.379332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] The token cache is being invalidate because project 31253f3142d44bf9b19240622d090444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:55.379634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.380624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-eae6a86c-ecf7-4c46-8af8-33d9c377bda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:55.386018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3173/6338] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:54 2022] DELETE /identity/v3/projects/31253f3142d44bf9b19240622d090444 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:55.389120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.393180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.393488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.440149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:55.440149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.488818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69191584-d02b-48a0-9248-53a4f605e95a service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.513375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.524024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.524024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.524024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.524024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.524547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.570615 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3166/6339] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:55.574125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.579113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.599536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3174/6340] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:55.601302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:55.602131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086169-fbda-426c-882b-16596a027208 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.605612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:55.628572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.629601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.630902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.630902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] PATH_INFO: `/v3/users/acdfaefc3cd643e0873be70cd69ad9d4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.631337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdfaefc3cd643e0873be70cd69ad9d4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.637974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:55.673222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5d2e3-6418-4952-86be-f324c05444a7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:55.693206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:55.694034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:55.694410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:55.694722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] PATH_INFO: `/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5/users/82f05b25ca5147c4a9f7c60733df74d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:55.730592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d9c1b2a0744993b8f82d543e9cffc5, user_id=82f05b25ca5147c4a9f7c60733df74d9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:55.733506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.015165 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3175/6341] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:55 2022] PUT /identity/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5/users/82f05b25ca5147c4a9f7c60733df74d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:56.016193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.110604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabbb43-a29b-4888-8aa3-b9e00821531c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.125928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.125928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.125928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.125928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.126391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:56.126391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.126391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.162428 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3176/6342] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:56.162428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.180037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdfaefc3cd643e0873be70cd69ad9d4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:56.187325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c3c7-50f1-4ab5-9805-9ffe2c54613a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.202743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.202743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.202743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.202743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.203120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.203120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.213846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3177/6343] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:56.217646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.232860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168abc46-1b04-446d-b717-d6e0e74105a3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.238855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.239973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.240255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.240576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.241220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.247284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.348237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdfaefc3cd643e0873be70cd69ad9d4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:56.367885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdfaefc3cd643e0873be70cd69ad9d4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:56.369280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdfaefc3cd643e0873be70cd69ad9d4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:56.369963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdfaefc3cd643e0873be70cd69ad9d4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:56.389663 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3167/6344] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:55 2022] DELETE /identity/v3/users/acdfaefc3cd643e0873be70cd69ad9d4 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:56.390577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.392308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:56.467076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3178/6345] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:56.470978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.472784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:56.523069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734052a6-4c68-4b73-aab6-a6636f1a5c87 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.617325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52efc-9cc3-4759-8375-a5aa98dbc0a9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.627120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.627729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.628013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.628317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.628993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.631087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.695686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.697459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.697739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.698017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] PATH_INFO: `/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5/users/82f05b25ca5147c4a9f7c60733df74d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.700514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d9c1b2a0744993b8f82d543e9cffc5, user_id=82f05b25ca5147c4a9f7c60733df74d9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.703577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979eb4b-72af-4483-8b4b-d1a1aa7db876 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:56.717815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3168/6346] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:56 2022] PUT /identity/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5/users/82f05b25ca5147c4a9f7c60733df74d9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:56.728608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.729777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.729777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.762540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] MFA Rules not processed for user `82f05b25ca5147c4a9f7c60733df74d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:56.764390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:56.858155 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3179/6347] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/users => generated 281 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:56.861877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.889069 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3169/6348] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:56.893938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:56.909920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adf550-7811-4da9-8b3a-e2d89d4a1397 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.910965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afff0-dd9e-4d5d-8b22-808184495f9e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:56.921009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:56.923393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:56.924215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:56.924686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:56.925624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:56.928075 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:56.928075 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:52:56.928075 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:52:56.931995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.047070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:57.053109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3170/6349] 10.222.0.64 () {60 vars in 1185 bytes} [Wed Nov 2 12:52:56 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:57.057904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.099732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a5772-ecf5-43de-8285-50faede20a0e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.132834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.132834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.132834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.132834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.133172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.133172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.133330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.133330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.133330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.133581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03cc2632d054404d887a28de9984a467` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.133581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=03cc2632d054404d887a28de9984a467)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.133581 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:57.133581 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:52:57.133581 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:52:57.133948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.158626 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3171/6350] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:52:57 2022] GET /identity/v3/OS-OAUTH1/consumers/03cc2632d054404d887a28de9984a467 => generated 221 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:52:57.158626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.158907 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3180/6351] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:57.161141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.183536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86197845-0f62-4e8b-a6a6-070548b6e5ab tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.187624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21b04f-c1c6-496b-968d-dedea176412f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.195494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.196248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.197889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.198128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.198505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.199329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.199957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.200304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.201825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/03cc2632d054404d887a28de9984a467` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.202182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=03cc2632d054404d887a28de9984a467)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.203946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.204761 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:57.204761 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:52:57.204761 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:52:57.207616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.207991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer 03cc2632d054404d887a28de9984a467 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:57.208350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:57.211486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:57.236196 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3172/6352] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:52:57.236196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.242043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:57.262705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c215f85-2a67-4071-ab01-27a067d62c4e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.269613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.270442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.270787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.271236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] PATH_INFO: `/v3/users/d39fd98884c9445ea13c94a9dfbffda0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.272741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39fd98884c9445ea13c94a9dfbffda0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.276137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.350667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '03cc2632d054404d887a28de9984a467', 'request_id': 'req-c2286269-c5eb-4707-a5f7-340116d0536f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:57.678064 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3181/6353] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:52:57 2022] DELETE /identity/v3/OS-OAUTH1/consumers/03cc2632d054404d887a28de9984a467 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:57.679209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:57.680743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:57.703003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2286269-c5eb-4707-a5f7-340116d0536f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:57.712769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:57.713878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:57.715428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:57.716102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] PATH_INFO: `/v3/projects/3d34b3cffbc44c0aae74d45280e6cf4d/users/149dc2cb594c45198b1a146e44c1444e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:57.742923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d34b3cffbc44c0aae74d45280e6cf4d, user_id=149dc2cb594c45198b1a146e44c1444e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:57.753403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:57.893618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39fd98884c9445ea13c94a9dfbffda0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.014483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3182/6354] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:52:57 2022] PUT /identity/v3/projects/3d34b3cffbc44c0aae74d45280e6cf4d/users/149dc2cb594c45198b1a146e44c1444e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:58.014483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.014483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.153201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39fd98884c9445ea13c94a9dfbffda0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.169248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bcd99-b2af-4084-b260-0f18376c63bd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.183118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.183968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.184430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.184882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.185695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.187534 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:58.187534 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:52:58.187534 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:52:58.189306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665481e-759b-4ea1-981c-e65b15628006 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.222185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39fd98884c9445ea13c94a9dfbffda0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.236261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39fd98884c9445ea13c94a9dfbffda0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.236261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39fd98884c9445ea13c94a9dfbffda0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.274114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3173/6355] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:52:57 2022] DELETE /identity/v3/users/d39fd98884c9445ea13c94a9dfbffda0 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:58.275069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.280419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.322485 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3183/6356] 10.222.0.64 () {60 vars in 1185 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:58.322485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ba0-550e-48a4-a177-4cded53ba730 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.322485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ba0-550e-48a4-a177-4cded53ba730 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.322485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9851ba0-550e-48a4-a177-4cded53ba730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.357409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:58.398953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c9851ba0-550e-48a4-a177-4cded53ba730 None None] MFA Rules not processed for user `149dc2cb594c45198b1a146e44c1444e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:58.401167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9851ba0-550e-48a4-a177-4cded53ba730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.416783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d355eb-da6a-488a-8276-86e0042150e8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.425363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.426584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.427069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.427909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] PATH_INFO: `/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.430154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf3fa70e5bd4a33af8f79cb6e7cede9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.433336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.556379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3184/6357] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:58.558099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39630-1229-4644-b893-266e991a9062 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.558557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39630-1229-4644-b893-266e991a9062 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.558981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f39630-1229-4644-b893-266e991a9062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.583109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b2f39630-1229-4644-b893-266e991a9062 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:58.584371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2f39630-1229-4644-b893-266e991a9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.596318 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3185/6358] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:58.597769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39630-1229-4644-b893-266e991a9062 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.600026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2f39630-1229-4644-b893-266e991a9062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.672350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'request_id': 'req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.680661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'request_id': 'req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.694792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f39630-1229-4644-b893-266e991a9062 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.756697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.757357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.757640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.757916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.758515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=80b67145bd0f433e803f684a7d1e266f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:58.760063 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:52:58.760063 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:52:58.760063 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:52:58.760998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:58.772581 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3186/6359] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:52:58 2022] GET /identity/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f => generated 221 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:58.772581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.772581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:58.863860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2849f-c6c1-44ae-85de-120a9bf07a68 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:58.868297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:58.868988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:58.869245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:58.869509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:58.963797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:58.964382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf3fa70e5bd4a33af8f79cb6e7cede9', 'request_id': 'req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.978272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] The token cache is being invalidate because project 6cf3fa70e5bd4a33af8f79cb6e7cede9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:58.995521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.995521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:58.995521 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3174/6360] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:52:58 2022] DELETE /identity/v3/projects/6cf3fa70e5bd4a33af8f79cb6e7cede9 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:58.995521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:58.995521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.007017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71bfc5-e2b9-4643-a37f-fa04a5f54d3d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.009479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.012538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.013417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.013540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.013961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.014573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.018176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.043952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3187/6361] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:59.045382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.065415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1facc8-1c96-4bae-9b3d-1ee10df1ce4c service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.078877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.081272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.081272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.081272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.081272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=80b67145bd0f433e803f684a7d1e266f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.082719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.083363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer 80b67145bd0f433e803f684a7d1e266f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:59.084147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:59.085756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:59.135287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.140626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2915b-4682-4232-9096-efbb1c023739 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.172168 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3175/6362] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:52:59.173621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555ffe-43fc-4380-a9ca-33c8e825d6fd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.174052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555ffe-43fc-4380-a9ca-33c8e825d6fd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.174372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62555ffe-43fc-4380-a9ca-33c8e825d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.197758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-62555ffe-43fc-4380-a9ca-33c8e825d6fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:59.199509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-62555ffe-43fc-4380-a9ca-33c8e825d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.209807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3176/6363] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:52:59.217630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.218738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.219026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.242433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:52:59.244319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.258102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3177/6364] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:52:59.262907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.279377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a3513-5f81-4acf-909f-c30bc2d599cd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.291119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.292596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.292908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.293188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.294048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:52:59.294329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.296135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.317012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '80b67145bd0f433e803f684a7d1e266f', 'request_id': 'req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:59.338661 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3178/6365] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:52:59.339784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.367159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463a0c-b285-4e74-bec2-0ecb1df4aebf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.376072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.376072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.381756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.382235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.384256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.386469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.500607 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3188/6366] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:52:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:52:59.507270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.509795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.533711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d8265-67fa-4eed-bf1f-a28bcd6ceba4 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.547463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.548391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.548850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.549287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.550034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=80b67145bd0f433e803f684a7d1e266f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.551976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Nov 02 12:52:59.574283 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Nov 02 12:52:59.576069 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:52:59.584719 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3189/6367] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:52:59 2022] GET /identity/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f => generated 74 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:52:59.585978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.612428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1128918-3943-429e-aa30-7c84a1b1784f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.619994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.627055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.627055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.627055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.627055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=80b67145bd0f433e803f684a7d1e266f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.627775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.636392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer 80b67145bd0f433e803f684a7d1e266f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:52:59.637783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:59.638683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Nov 02 12:52:59.661155 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Nov 02 12:52:59.662263 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:52:59.662987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3179/6368] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:52:59.665007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3190/6369] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:52:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/80b67145bd0f433e803f684a7d1e266f => generated 74 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:52:59.666130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.668060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.672341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:52:59.686336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:52:59.731052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901d57-8f5e-43a5-9a0d-5b66a7661c89 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.809013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb337b-d07e-4309-9de1-9a4a595fda1c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:52:59.814519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.815315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.815794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.816137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.816898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.819092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:52:59.859542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:52:59.860476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:52:59.860660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:52:59.860950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:52:59.865326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:52:59.868885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.008981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3180/6370] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:00.010326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.013139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.021854 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3191/6371] 10.222.0.64 () {60 vars in 1185 bytes} [Wed Nov 2 12:52:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:00.023771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.052737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c844aa4-68e3-491f-9964-bcb03a7809fc tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.058339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.059179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.059755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.060359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.061150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83c028-67bb-45f1-abfa-510bcb7783f9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.061538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.063579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.067939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.068830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.069317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.069677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] PATH_INFO: `/v3/projects/67c2128d3a954ae7b5bcc30d9dd495b5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.071092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c2128d3a954ae7b5bcc30d9dd495b5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.083389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.084669 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3192/6372] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:00.085844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.106528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7f45c-baa8-471d-91fe-35c511ca0fd6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.117697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.118538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.118819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.119096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.119749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.121701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.294382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3193/6373] 10.222.0.64 () {60 vars in 1185 bytes} [Wed Nov 2 12:53:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:00.295405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.323698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ccc21-b845-4571-af30-60bac4e8a2d8 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.324228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c2128d3a954ae7b5bcc30d9dd495b5', 'request_id': 'req-cb3c8a92-f552-4277-adb8-103340206937'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.330966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c2128d3a954ae7b5bcc30d9dd495b5', 'request_id': 'req-cb3c8a92-f552-4277-adb8-103340206937'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.425913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.428971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.430242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.430538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.431446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.447952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.474320 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3194/6374] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:00.476759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.481051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.503985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c2128d3a954ae7b5bcc30d9dd495b5', 'request_id': 'req-cb3c8a92-f552-4277-adb8-103340206937'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.543559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] The token cache is being invalidate because project 67c2128d3a954ae7b5bcc30d9dd495b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:00.543927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.545044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.550200 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3181/6375] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:00 2022] DELETE /identity/v3/projects/67c2128d3a954ae7b5bcc30d9dd495b5 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:00.550858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.555215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.610388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7182cf7-760b-40b2-820f-202d3333edc2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.615326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.616348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.616724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.617064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.621289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.695239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8a92-f552-4277-adb8-103340206937 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.712843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.713791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.714132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.714417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.715511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.721838 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:53:00.721838 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:53:00.721838 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:53:00.722823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.747841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3182/6376] 10.222.0.64 () {58 vars in 1164 bytes} [Wed Nov 2 12:53:00 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:00.747841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.747841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.757669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ccc4b-4d66-4ed0-84d8-b7026863e767 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.765169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.765845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.766121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.766391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] PATH_INFO: `/v3/projects/d0581b732e004d1daa7fc194eb2fd645/users/3733ac5b0e8f40989353cedac81004e7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.778375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.779997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea367a-d2cc-4fc7-bd14-7ae70f8d3547 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.784516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0581b732e004d1daa7fc194eb2fd645, user_id=3733ac5b0e8f40989353cedac81004e7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.787580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa359ca2-0950-4355-aefb-28ccfe41fcd5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.800888 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3195/6377] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:00.802670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897950-4094-409b-99d7-656f707983c5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.802953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897950-4094-409b-99d7-656f707983c5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.803222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6897950-4094-409b-99d7-656f707983c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.828636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a6897950-4094-409b-99d7-656f707983c5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:00.829912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a6897950-4094-409b-99d7-656f707983c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:00.845533 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3196/6378] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:00.845533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6897950-4094-409b-99d7-656f707983c5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:00.900641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6897950-4094-409b-99d7-656f707983c5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:00.909631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:00.910343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:00.910586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:00.910861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9f103b07c3f14727ae2b33ed85a8fae2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:00.911774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9f103b07c3f14727ae2b33ed85a8fae2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:00.913564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:00.913696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer 9f103b07c3f14727ae2b33ed85a8fae2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:00.914023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:00.919605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.014623 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3183/6379] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:00 2022] PUT /identity/v3/projects/d0581b732e004d1daa7fc194eb2fd645/users/3733ac5b0e8f40989353cedac81004e7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:01.015984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33702f-3a30-4d49-8d58-5ad03e336530 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.016273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33702f-3a30-4d49-8d58-5ad03e336530 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.016572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33702f-3a30-4d49-8d58-5ad03e336530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.036450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ee33702f-3a30-4d49-8d58-5ad03e336530 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:01.037606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee33702f-3a30-4d49-8d58-5ad03e336530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.065290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9f103b07c3f14727ae2b33ed85a8fae2', 'request_id': 'req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.132686 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3184/6380] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:01.136130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.136460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.136965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.179509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:01.181453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.242195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3197/6381] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:53:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9f103b07c3f14727ae2b33ed85a8fae2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:01.243825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.259780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c4948-fbbb-4ebc-b654-61b97a4ec69e tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.265246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.265943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.266293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.266635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.271789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:01.272199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:01.274551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:01.292628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3198/6382] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:01.294043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.299252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.310581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3185/6383] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:01.311539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.330076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e427d92-44f0-4705-bf39-142a2815bdc3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.336389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.337747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.338033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.338361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.339014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:01.341115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:01.415757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279741f5-7e2c-4f8c-92db-ec00a3088525 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.415757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.415757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.416467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.416467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/9558a1ad2594486aa0dbf87b308178b3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.416904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=9558a1ad2594486aa0dbf87b308178b3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:01.418412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:01.418687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer 9558a1ad2594486aa0dbf87b308178b3 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:01.418969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.419676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.568771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '9558a1ad2594486aa0dbf87b308178b3', 'request_id': 'req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.587638 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3186/6384] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:01 2022] POST /identity/v3/projects => generated 383 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:01.594625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.600601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.742833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5309fd-1cc5-4833-a2e8-e4515811428c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.758226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.759315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.759660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.760750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.764780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3199/6385] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:53:01 2022] DELETE /identity/v3/OS-OAUTH1/consumers/9558a1ad2594486aa0dbf87b308178b3 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:01.768924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:01.775685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:01.806834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5ea76-bd8c-4ddf-8d89-e8313f094c0d tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:01.953133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:01.954001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:01.954292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:01.963036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:01.963036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:01.963264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:01.963359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:01.969860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:02.076453 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3187/6386] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:01 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:02.077243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.079822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.130562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3200/6387] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:01 2022] POST /identity/v3/users => generated 292 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:02.137298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.164321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704799-e7af-4ae9-9ed7-03b6fc551c38 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.180441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.183372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.183372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.183372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.184811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.190723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.220020 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3201/6388] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:02.222475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.232059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd716f5-8a38-4a0b-98a7-b74aa7269c69 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.244298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.245232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.245524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.245798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.246520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.249493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad63f7-fc2d-4d23-86d5-24c7cc308785 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.256306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.269845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.269845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.270030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.270308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.270967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.273234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.289547 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3202/6389] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:02.293714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.311843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf1ba-fa20-4909-9f16-259c32eedf03 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.323700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.324846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.325136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.325417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] PATH_INFO: `/v3/projects/22e30d928bca405f84a615ec80ee8868/users/252f971fc4da418baec5ad1257271783/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.367035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e30d928bca405f84a615ec80ee8868, user_id=252f971fc4da418baec5ad1257271783, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.373080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1de936-a73d-4350-8d6f-cd5d232d27b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.410018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3188/6390] 10.222.0.64 () {60 vars in 1185 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:02.413265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.437680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa3145-8e40-4202-ae14-ac5490b8bea2 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.443209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.443866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.444147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.444581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.445347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=a39cb664d41c4ee28b2e46ae8fcbbc36)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.448691 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:53:02.448691 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:53:02.448691 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:53:02.454665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.552816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3203/6391] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:02 2022] PUT /identity/v3/projects/22e30d928bca405f84a615ec80ee8868/users/252f971fc4da418baec5ad1257271783/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:02.566390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.566777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.567129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.599860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] MFA Rules not processed for user `252f971fc4da418baec5ad1257271783`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:02.601260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.637710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3189/6392] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Nov 2 12:53:02 2022] PATCH /identity/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36 => generated 219 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:02.641931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.655365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7e994-a074-4f38-9d9a-f0f189287250 tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.770986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.772013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.772570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.773058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.773858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a39cb664d41c4ee28b2e46ae8fcbbc36)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.779256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.792030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3190/6393] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36 => generated 219 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:02.796798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.817203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a99cd-cfce-4bff-90aa-88f7aa805b8f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.839267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82f05b25ca5147c4a9f7c60733df74d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.839987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.840274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.840597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.841188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a39cb664d41c4ee28b2e46ae8fcbbc36)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.842983 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3204/6394] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:02.843262 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:53:02.843262 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 12:53:02.843262 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 12:53:02.844422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:02.844739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invalidating token cache because consumer a39cb664d41c4ee28b2e46ae8fcbbc36 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:02.845027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.849096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:02.854568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:02.856000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.960283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af4a31-3a44-45d7-b8d6-6aedcf01258d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:02.965800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:02.966433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:02.966711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:02.967484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:02.971873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:02.989990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:02.996877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8a0a-b83c-4cb6-b0a8-d87f5bdf1cd9 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.041095 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3205/6395] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:03.081420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268af3-c509-457f-9483-a4f8f7f4708e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.085663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268af3-c509-457f-9483-a4f8f7f4708e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.085663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57268af3-c509-457f-9483-a4f8f7f4708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.134799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a39cb664d41c4ee28b2e46ae8fcbbc36', 'request_id': 'req-62431f5a-b798-4fdf-93a2-ea54dd858f5f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.140143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-57268af3-c509-457f-9483-a4f8f7f4708e None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:03.147995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-57268af3-c509-457f-9483-a4f8f7f4708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.162996 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3206/6396] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Nov 02 12:53:03.166332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.168272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.170038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.193125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:03.194492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.276435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3191/6397] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:53:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a39cb664d41c4ee28b2e46ae8fcbbc36 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:03.278435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.283639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:03.315765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3207/6398] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:03.320026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.333441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a97b-e297-4227-b33e-c0ba85c6b14c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.343411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.344316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.344474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.344764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:53:03.427047 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 02 12:53:03.428043 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:03.430429 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3208/6399] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 188 bytes in 114 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:53:03.440177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.444464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62431f5a-b798-4fdf-93a2-ea54dd858f5f tempest-OAUTHConsumersV3Test-690169384 tempest-OAUTHConsumersV3Test-690169384-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.452580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.458528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.459373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.459816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] PATH_INFO: `/v3/users/3a3f3cc0ccf44e67924ba05bd445b9d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.464062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3f3cc0ccf44e67924ba05bd445b9d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:03.466369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:03.466750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f85fe-76e0-4a9f-b48e-32ad9b2a2861 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.478990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.478990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.478990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.479231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:53:03.601137 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Nov 02 12:53:03.602481 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:03.604405 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3209/6400] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 188 bytes in 154 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:53:03.604405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:03.617064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6480a1-c4ec-4953-ad0d-2670e69ca6ce tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:03.627509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:03.628128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:03.628411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:03.628743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:03.746345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:03.839012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:03.943594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3f3cc0ccf44e67924ba05bd445b9d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:04.074654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3210/6401] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:03 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:04.074654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.077268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.097602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819484a-1da6-4be2-a313-3324c896d766 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.102828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.103545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.103757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.104210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] PATH_INFO: `/v3/users/252f971fc4da418baec5ad1257271783` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.105472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252f971fc4da418baec5ad1257271783)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.107418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:04.199042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3f3cc0ccf44e67924ba05bd445b9d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:04.257986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3f3cc0ccf44e67924ba05bd445b9d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:04.259100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3f3cc0ccf44e67924ba05bd445b9d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:04.259917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d724e11d-a9cc-4842-a3fb-b49ba29ac195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3f3cc0ccf44e67924ba05bd445b9d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:04.276361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3192/6402] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:03 2022] DELETE /identity/v3/users/3a3f3cc0ccf44e67924ba05bd445b9d2 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:04.279588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.280081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.280404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.308201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:04.309473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.393307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3193/6403] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:04.394204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:04.395744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:04.428454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592c615-a5a6-429c-bcfb-250ea5106006 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:04.438637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:04.439374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:04.439639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:04.439915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] PATH_INFO: `/v3/users/cb79f24ffb11419b862e2f1e465def8a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:04.441409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb79f24ffb11419b862e2f1e465def8a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:04.443582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:04.570134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252f971fc4da418baec5ad1257271783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.036906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252f971fc4da418baec5ad1257271783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.061380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252f971fc4da418baec5ad1257271783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.074447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252f971fc4da418baec5ad1257271783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.077167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252f971fc4da418baec5ad1257271783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.087932 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3211/6404] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:04 2022] DELETE /identity/v3/users/252f971fc4da418baec5ad1257271783 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.088747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.091509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.156533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb79f24ffb11419b862e2f1e465def8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.191667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49e729-52e4-4de7-9865-85d7b169a127 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.200139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.200805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.201088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.201362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.203173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.226714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:05.341778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.344943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb79f24ffb11419b862e2f1e465def8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.345576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77372bf-6e75-4eab-9437-be2267490c69 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.365517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3212/6405] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:05.373427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7332-bf6a-49f9-b77b-2b3d86b800ca None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.374176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7332-bf6a-49f9-b77b-2b3d86b800ca None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.374915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc7332-bf6a-49f9-b77b-2b3d86b800ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.377186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb79f24ffb11419b862e2f1e465def8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.378025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb79f24ffb11419b862e2f1e465def8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.385017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-26c531d5-dfcf-44d7-a409-a277e940bbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb79f24ffb11419b862e2f1e465def8a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:05.412600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-05fc7332-bf6a-49f9-b77b-2b3d86b800ca None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:05.414721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05fc7332-bf6a-49f9-b77b-2b3d86b800ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.427892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3194/6406] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:04 2022] DELETE /identity/v3/users/cb79f24ffb11419b862e2f1e465def8a => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:05.428225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3213/6407] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:05.428331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.428331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.428718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d857a-682b-4198-a7e0-3375391dbb3b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.428718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d857a-682b-4198-a7e0-3375391dbb3b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.428718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d857a-682b-4198-a7e0-3375391dbb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.428919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.465538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-971d857a-682b-4198-a7e0-3375391dbb3b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:05.466767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-971d857a-682b-4198-a7e0-3375391dbb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.478374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:05.490064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.616216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3214/6408] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:05.621645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.621974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.622196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.690446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:05.692698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.814615 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3195/6409] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:05.818009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.823562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.861729 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3215/6410] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:05.865589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.865589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:05.952683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70332e1f-4e04-4db1-bbfc-abe7412cdbd9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.957832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9708829-3cb7-4db9-8cd4-fa3551a84960 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:05.958292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.958935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.959199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.959469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.961659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:05.962303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:05.970003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:05.970003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:05.970244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.971899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.977431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:05.979111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:05.983204 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3196/6411] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:05.984165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:05.994125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3216/6412] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:06.000880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aad949-c766-4f53-ae68-75fc00303d07 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.006323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.006984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.007265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.007537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.225007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:06.428481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3197/6413] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:05 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:06.765684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:06.768786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:06.790028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b3457-03cf-410d-abd3-94098b7a1459 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:06.795267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:06.796777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:06.796777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:06.796777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] PATH_INFO: `/v3/projects/a2e770e3f5b5476e93b61cb9871d77e7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:06.797793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2e770e3f5b5476e93b61cb9871d77e7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:06.800553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.186951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.189110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.197889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2e770e3f5b5476e93b61cb9871d77e7', 'request_id': 'req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.209435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2e770e3f5b5476e93b61cb9871d77e7', 'request_id': 'req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.221734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede0cf1-bb43-4f6b-8322-d8a2557bc24c tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.226650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2e770e3f5b5476e93b61cb9871d77e7', 'request_id': 'req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.355192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] The token cache is being invalidate because project a2e770e3f5b5476e93b61cb9871d77e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:07.355503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.361296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.374285 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3217/6414] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:06 2022] DELETE /identity/v3/projects/a2e770e3f5b5476e93b61cb9871d77e7 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:07.374691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:07.380344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:07.387269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.388570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.388866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.389190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] PATH_INFO: `/v3/projects/71d14f22e3da4c8c974fbc239c9614cb` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.391167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d14f22e3da4c8c974fbc239c9614cb)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.397046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.419109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10e9b-8c47-47dd-a28c-189a5abad7b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:07.425256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:07.425919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:07.431954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:07.431954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] PATH_INFO: `/v3/users/82f05b25ca5147c4a9f7c60733df74d9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:07.431954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f05b25ca5147c4a9f7c60733df74d9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:07.431954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:07.833431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f05b25ca5147c4a9f7c60733df74d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.837237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d14f22e3da4c8c974fbc239c9614cb', 'request_id': 'req-78b60c24-7c7c-461b-9c60-e5921d616b2b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:07.851485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d14f22e3da4c8c974fbc239c9614cb', 'request_id': 'req-78b60c24-7c7c-461b-9c60-e5921d616b2b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.023640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f05b25ca5147c4a9f7c60733df74d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.048767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f05b25ca5147c4a9f7c60733df74d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.058321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f05b25ca5147c4a9f7c60733df74d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.059451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cbd15a04-b329-416e-848b-eae76d0d3d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f05b25ca5147c4a9f7c60733df74d9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.070666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3218/6415] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:07 2022] DELETE /identity/v3/users/82f05b25ca5147c4a9f7c60733df74d9 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.088775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.094159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.094511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.153782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.153782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.161793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3219/6416] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:08.161793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.166556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.242062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d14f22e3da4c8c974fbc239c9614cb', 'request_id': 'req-78b60c24-7c7c-461b-9c60-e5921d616b2b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.260335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] The token cache is being invalidate because project 71d14f22e3da4c8c974fbc239c9614cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:08.261031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.267247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78b60c24-7c7c-461b-9c60-e5921d616b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.273423 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3198/6417] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:07 2022] DELETE /identity/v3/projects/71d14f22e3da4c8c974fbc239c9614cb => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.275596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e894a-bc8d-4438-9914-020b5c6a79c8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.276050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e894a-bc8d-4438-9914-020b5c6a79c8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.276514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e894a-bc8d-4438-9914-020b5c6a79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.313710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6d2e894a-bc8d-4438-9914-020b5c6a79c8 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.314952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6d2e894a-bc8d-4438-9914-020b5c6a79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.347992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d78db2-14ee-4ec0-a140-91ca7cc2c843 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.347992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.347992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.347992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.348829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] PATH_INFO: `/v3/projects/22e30d928bca405f84a615ec80ee8868` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.348829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e30d928bca405f84a615ec80ee8868)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:08.348829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:08.491302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3199/6418] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.492764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.493350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.493628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.524402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.524402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:08.544002 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3200/6419] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:08.545223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:08.565138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50851a5f-9903-4283-8740-0b2ebb9a5335 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:08.572998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599bc60-318f-4e70-84ca-aa6fd5e0adba tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:08.581735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599bc60-318f-4e70-84ca-aa6fd5e0adba tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.581735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599bc60-318f-4e70-84ca-aa6fd5e0adba tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.581735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599bc60-318f-4e70-84ca-aa6fd5e0adba tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.734199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e30d928bca405f84a615ec80ee8868', 'request_id': 'req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.743614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e30d928bca405f84a615ec80ee8868', 'request_id': 'req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.751507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e30d928bca405f84a615ec80ee8868', 'request_id': 'req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.921195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] The token cache is being invalidate because project 22e30d928bca405f84a615ec80ee8868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:08.921882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.922461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-27a2ac9a-0eec-4074-b43b-0ee7d3c7b482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.925986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9599bc60-318f-4e70-84ca-aa6fd5e0adba tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:08.928229 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3220/6420] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:08 2022] DELETE /identity/v3/projects/22e30d928bca405f84a615ec80ee8868 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:08.929704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:08.930612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:08.931133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:08.971582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:08.972946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.048341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:09.051730 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3201/6421] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:09.053439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.053663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.053942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.118834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:09.118834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.138298 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3221/6422] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.138936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.140900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.159237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a678d-29f1-4635-9287-41b9fb0a18b8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.165846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.166733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.166874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.167178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] PATH_INFO: `/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.168201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d9c1b2a0744993b8f82d543e9cffc5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.170534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.223476 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3202/6423] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.224737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.235775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a470ac-bfb5-48c7-9f00-a1898bd2a955 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.243562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.244309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.245009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.245381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.246210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:09.246620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.252021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a898341b-c024-4916-8cc6-4353924a7a05 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.276471 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3203/6424] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:09.279042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.283119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.284005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.322293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:09.324199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.340749 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3204/6425] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.344436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.355902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d61c-0c35-4983-896d-aa5ca0bbde37 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.366047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.366940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.367345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.368352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.369150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.372551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e1e71-98bb-41b7-8feb-cc0f757ebf7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.424315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'request_id': 'req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:09.434749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'request_id': 'req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:09.444876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d9c1b2a0744993b8f82d543e9cffc5', 'request_id': 'req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:09.688597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] The token cache is being invalidate because project a2d9c1b2a0744993b8f82d543e9cffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:09.688597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:09.689563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:09.691564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3222/6426] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:09 2022] DELETE /identity/v3/projects/a2d9c1b2a0744993b8f82d543e9cffc5 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:09.692729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.693273 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3205/6427] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:09.695005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.706664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.706858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.707061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.760814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:09.762298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.870108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb33fd-bdaa-4c59-98e5-1e8d7db546e1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.888302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3206/6428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:09.890365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:09.893707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:09.927923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:09.928725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9438d0-70b9-4309-a6a3-735b4bc0cef8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:09.939598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.942193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.942193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.942193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.943154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.946030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.948450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:09.949292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.949819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.950297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:09.951190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:09.955694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:09.958358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9b8fa-2bcf-4c89-83f7-9611fdff6ff6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:09.980204 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3223/6429] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:09.981867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:09.981985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:09.982352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.009318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.010674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.026587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3224/6430] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:10.026587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.045054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2e94-2c37-458f-b755-09fe5930b6a8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.049943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.050557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.050836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.051111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.051784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.054201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.223192 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3207/6431] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:09 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.224163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.234023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98892e21-9ea8-4034-b8a2-1ceffa63c23e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.238624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.239206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.239476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.239743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.240375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:10.240711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.242300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-b585-4c28-95ff-7922bcb02467 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.255685 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3208/6432] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:10.257033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.257316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.257591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.278199 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3225/6433] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.279647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.282085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.283278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.286816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3209/6434] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:10.287335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.356678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733421d0-df60-4b9f-b352-120599a5d030 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.362366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.362996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.362996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.363554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.364234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.365879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.372552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d923722-39c7-4b2f-8bed-8192e86ae719 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.377483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3226/6435] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:10.377996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.378508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.378639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.378878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.379147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.379774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.381812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ef5f4-93a3-48b3-955d-685cac6783b6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.393228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10373af-f186-450b-9cf9-e52e7fc49489 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.398615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.429033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.429033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.429033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.429033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.429033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.560994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3210/6436] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/projects => generated 367 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.562474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.562762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.563191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.588261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:10.589733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:10.631382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3227/6437] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/users => generated 288 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:10.632959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.646972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee44b7-44b1-4d5e-ace5-a8454838124b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.657836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3211/6438] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:10.661868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.718500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.719192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.719463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.719822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.720466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.722745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.743491 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3228/6439] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:10.744624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.746938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb01bc-31be-4566-979e-96f05d9698c5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.757183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.760120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.760631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.761190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.761346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f3d02-c72b-4190-8397-4812b77f8a67 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.762175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.764410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.766624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.767242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.767519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.767998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:10.768953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:10.770563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:10.792633 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3229/6440] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:10.792633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:10.805067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fedf77-de13-4977-83da-087ce5874341 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:10.810440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:10.811289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:10.811579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:10.811851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.033205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:11.034723 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3212/6441] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/users => generated 284 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:11.035437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.053880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01efae7-b302-4e1b-a05d-89c8088a697e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.059676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.059992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.060272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.060585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] PATH_INFO: `/v3/projects/15cfd14dec0a4be4832c9a052aa3c8b8/users/1d48f7acb1184b3eb85af336ef4a5db1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.082561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cfd14dec0a4be4832c9a052aa3c8b8, user_id=1d48f7acb1184b3eb85af336ef4a5db1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.085330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.214029 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3230/6442] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:10 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:11.215602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.227861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07842-c309-439f-9844-8e93116b8723 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.233349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.233945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.234228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.234519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.235152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.236789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.248022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3231/6443] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:11.248887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.259493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9048562-30ed-4e64-97a0-86d9047e3a8c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.284980 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3213/6444] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:11 2022] PUT /identity/v3/projects/15cfd14dec0a4be4832c9a052aa3c8b8/users/1d48f7acb1184b3eb85af336ef4a5db1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:11.284980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.285185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.285185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.285185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.285185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.285513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.285513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3808a-5653-4e42-aea2-f4a74407309f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.300843 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3232/6445] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:11.302480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.302931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.303301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.341601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] MFA Rules not processed for user `1d48f7acb1184b3eb85af336ef4a5db1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:11.342881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:11.422218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a7b1-ae72-471c-a621-f8d4d98ff404 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.441103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.444164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.444519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.445259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] PATH_INFO: `/v3/projects/2d7834e545604dfcab709c3662801725/users/6f74ffe9261d401f843a9e6486000eff/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.531822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7834e545604dfcab709c3662801725, user_id=6f74ffe9261d401f843a9e6486000eff, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.531822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.532637 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3233/6446] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:11.532637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.545179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83a56d-f641-46f6-b320-92758f81b76b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.551259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.554754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.554754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.554754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.554754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.555265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.567238 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3234/6447] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:11.568210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.579430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad720c4-c427-493d-ba8c-7706b6a01daa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.585878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.587269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.587587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.587870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.588550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:11.590497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5fb676-d37a-40bf-b0eb-761e566bfa95 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:11.743674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3214/6448] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:11 2022] PUT /identity/v3/projects/2d7834e545604dfcab709c3662801725/users/6f74ffe9261d401f843a9e6486000eff/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:11.743674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:11.781930 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3235/6449] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:11 2022] POST /identity/v3/projects => generated 363 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:11.783408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.783686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.784034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.828346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356b494-3032-40c3-a506-4e9415897da5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:11.833709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] MFA Rules not processed for user `6f74ffe9261d401f843a9e6486000eff`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:11.835223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:11.979539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:11.981894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:11.982614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:11.985482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] PATH_INFO: `/v3/projects/926415d28b694be19320580d8d2b0c6f/users/fc669ada98d947c58a24c6e86536fd13/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:11.991367 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3236/6450] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:11.993853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.020372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=926415d28b694be19320580d8d2b0c6f, user_id=fc669ada98d947c58a24c6e86536fd13, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.022149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a648aad-b2e0-455b-b703-504b1f4e99fe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.024461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.033853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.034531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.034851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.035125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.035888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.043828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.126754 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3215/6451] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:11 2022] PUT /identity/v3/projects/926415d28b694be19320580d8d2b0c6f/users/fc669ada98d947c58a24c6e86536fd13/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:12.128265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.137186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.225332 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3237/6452] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:11 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:12.226622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.228277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddc14c-3204-4cfa-b660-430c6e0958dd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.228831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.237503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.239145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.239598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.240831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] PATH_INFO: `/v3/users/6fb0311da6104d1b924dae3a5e43f843` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.242716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb0311da6104d1b924dae3a5e43f843)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.245501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.338555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e0976-0e67-4d1e-9500-b04528d17ca2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.408948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.410665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.410665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.410665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.571185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb0311da6104d1b924dae3a5e43f843'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.595156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.596655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f7150-43fb-47b7-ad88-a449df8134e5 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.606209 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3238/6453] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:12.611579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3be3-7b90-4f1b-8598-d2071a6b4761 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.611579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3be3-7b90-4f1b-8598-d2071a6b4761 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.611579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b3be3-7b90-4f1b-8598-d2071a6b4761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.648138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a94b3be3-7b90-4f1b-8598-d2071a6b4761 None None] MFA Rules not processed for user `fc669ada98d947c58a24c6e86536fd13`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:12.649394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a94b3be3-7b90-4f1b-8598-d2071a6b4761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.734185 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3239/6454] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:12.736060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.736510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.736921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.766226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:12.767568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:12.772043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3240/6455] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:12.773112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.787532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7351-a82e-4265-8489-f06f97b9bf6d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.801356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.801356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.801356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.801356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.801778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.801778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.819051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3241/6456] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:12.821154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.830613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb0311da6104d1b924dae3a5e43f843'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.835098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d0109-b282-48f5-8ede-bdbe81ec9680 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:12.847668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:12.848269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:12.848974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb0311da6104d1b924dae3a5e43f843'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.849769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:12.850596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb0311da6104d1b924dae3a5e43f843'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.851830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:12.851936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb0311da6104d1b924dae3a5e43f843'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:12.854274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:12.857201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581aa2e5-ca88-43a3-a76c-6802ac8814f2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:12.886730 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3216/6457] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:12 2022] DELETE /identity/v3/users/6fb0311da6104d1b924dae3a5e43f843 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:12.889411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:12.893420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.058262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3242/6458] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:12 2022] POST /identity/v3/projects => generated 367 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:13.060917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.061370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.062352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.072410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13e9f2-9020-4429-acf7-d6934d418f86 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.111096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:13.119811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.225109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.226096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.227017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.227367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] PATH_INFO: `/v3/projects/9b15f6cf9cf3492282a79e039ce7a758/users/fb6041057c804071b77388d95a014d8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.254478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b15f6cf9cf3492282a79e039ce7a758, user_id=fb6041057c804071b77388d95a014d8d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.258986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.292628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3243/6459] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:13.292628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.297770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.317366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a844b-4b52-4940-83ee-cfda44676fac None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.323207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.324123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.324688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.325144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.326187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.328556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.400166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3217/6460] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:12 2022] PUT /identity/v3/projects/9b15f6cf9cf3492282a79e039ce7a758/users/fb6041057c804071b77388d95a014d8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:13.405403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.408935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.505063 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3244/6461] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:13 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:13.506301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.529616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adbcdf-39e5-427e-955a-d286a8a08cdf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.543528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a89a0c-b219-49f7-b981-d748f6393601 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.549641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.551436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.551730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.552007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.591743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.592352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.592653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.592928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.593559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.595156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.607273 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3245/6462] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:13.608675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.621172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.622788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.625094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3513b8-8ead-4d74-83ab-eec1e4148aff admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.631395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.632111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.632454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.632775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.633433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.634875 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3218/6463] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:13.635212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.637614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.649259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3246/6464] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:13.649453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726c96-f083-491e-b6c6-cad24b232769 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.653206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.656889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.657594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.657877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.658152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] PATH_INFO: `/v3/projects/9b15f6cf9cf3492282a79e039ce7a758/users/fb6041057c804071b77388d95a014d8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.661615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b15f6cf9cf3492282a79e039ce7a758, user_id=fb6041057c804071b77388d95a014d8d, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.665676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48431c00-425f-44d0-ab58-cb0be1816bb5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.667636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f0620-f5ae-4981-9c0f-d21515c77511 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:13.674586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:13.675648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.676123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.676676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] PATH_INFO: `/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba/users/28b8f0bf4cce46c58f8f0c158c11829c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.685195 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3219/6465] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:13 2022] PUT /identity/v3/projects/9b15f6cf9cf3492282a79e039ce7a758/users/fb6041057c804071b77388d95a014d8d/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:13.699349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e923-8e6e-4af0-8e95-694b1e1efb1d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.699349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e923-8e6e-4af0-8e95-694b1e1efb1d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.699349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718e923-8e6e-4af0-8e95-694b1e1efb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.704644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcfe378cd50414eb36e6d3c2abbb0ba, user_id=28b8f0bf4cce46c58f8f0c158c11829c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:13.710106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:13.737409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a718e923-8e6e-4af0-8e95-694b1e1efb1d None None] MFA Rules not processed for user `fb6041057c804071b77388d95a014d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:13.738685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a718e923-8e6e-4af0-8e95-694b1e1efb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.852767 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3220/6466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:13.854249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:13.854531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:13.854804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:13.879692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:13.881131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:13.917769 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3247/6467] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:13 2022] PUT /identity/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba/users/28b8f0bf4cce46c58f8f0c158c11829c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:13.919165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:13.927373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:14.008006 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3221/6468] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:14.016010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.064864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:14.066189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba74cc-2084-405e-9347-7d8e55ac2865 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.081246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.087140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.088143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.088891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.126293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace388f4-8f29-4b59-a0a1-4d3af8603259 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.256177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.256941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.258358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.258964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.261508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.262982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.263302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.267175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0427b6-e9c5-4505-8b65-ee6088186db0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.293570 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3222/6469] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:14.294616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bb82-4bb7-4e19-9db8-ec3e5aee7701 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.295270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bb82-4bb7-4e19-9db8-ec3e5aee7701 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.296270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2bb82-4bb7-4e19-9db8-ec3e5aee7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.298618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3248/6470] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:14.299676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.327873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1b00-8d11-4995-90d0-fdd912cbabfc service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.337868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.339967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.339967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.339967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] PATH_INFO: `/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba/users/28b8f0bf4cce46c58f8f0c158c11829c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.342744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcfe378cd50414eb36e6d3c2abbb0ba, user_id=28b8f0bf4cce46c58f8f0c158c11829c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.345734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99923ec6-3048-4a69-a6e8-6915629d9276 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.374449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:14.374449 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3249/6471] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:14 2022] PUT /identity/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba/users/28b8f0bf4cce46c58f8f0c158c11829c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:14.375671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.375978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.376254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.385183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bae2bb82-4bb7-4e19-9db8-ec3e5aee7701 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:14.387301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bae2bb82-4bb7-4e19-9db8-ec3e5aee7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:14.397865 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3223/6472] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:14.400793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909f55-f7bf-4b6c-aea9-878f3d7a3533 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.401323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909f55-f7bf-4b6c-aea9-878f3d7a3533 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.401839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de909f55-f7bf-4b6c-aea9-878f3d7a3533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.418819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] MFA Rules not processed for user `28b8f0bf4cce46c58f8f0c158c11829c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:14.418819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:14.562668 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3250/6473] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:14.567313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.579300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c31f6-e74a-4ef4-9f4f-d6457751efae None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.587862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.589138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.589138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.589138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.589965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.591497 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:53:14.591497 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:53:14.591497 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:53:14.592442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.659970 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.application [None req-de909f55-f7bf-4b6c-aea9-878f3d7a3533 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:53:14.662063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3224/6474] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 264 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 02 12:53:14.676180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.676180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.676180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.764652 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3251/6475] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/regions => generated 223 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:14.766208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.791512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd78ad-0033-4c79-a855-88db78caadd0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:14.798078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:14.798783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.799026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.799303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:14.799996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:14.802188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f06e69-79cd-4785-bbf6-1177046b9dce tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:14.852466 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.application [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:53:14.865104 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3225/6476] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 197 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Nov 02 12:53:14.865104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:14.865928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:14.981711 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3252/6477] 10.222.0.64 () {60 vars in 1149 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/regions => generated 224 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:14.985100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:14.985472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:14.985828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.029476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7e3d3-7ca3-4339-b093-4f32a18d3487 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.031931 n-d-857339-6 devstack@keystone.service[82131]: WARNING keystone.server.flask.application [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:53:15.035445 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3253/6478] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:14 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 51 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 02 12:53:15.035445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.038108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.039500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.040027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.040548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] PATH_INFO: `/v3/projects/e76a4d0d270c4f46a34df991233cb35e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.042024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76a4d0d270c4f46a34df991233cb35e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.044112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.107391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48268ba8-4bfb-4467-a6ee-bc3a155a91a3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.121751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.124352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.124915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.126150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/226e964c-eaa6-4679-8207-dadc29572e07` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.127071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:create_region(region_id=226e964c-eaa6-4679-8207-dadc29572e07)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.131099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.298360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76a4d0d270c4f46a34df991233cb35e', 'request_id': 'req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:15.308330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76a4d0d270c4f46a34df991233cb35e', 'request_id': 'req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:15.366417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3254/6479] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Nov 2 12:53:15 2022] PUT /identity/v3/regions/226e964c-eaa6-4679-8207-dadc29572e07 => generated 232 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:15.366417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.419911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7bb79-c058-438a-ae2c-9635f6bb5cbf tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.535978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76a4d0d270c4f46a34df991233cb35e', 'request_id': 'req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:15.551642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] The token cache is being invalidate because project e76a4d0d270c4f46a34df991233cb35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:15.552945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:15.553772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:15.560590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3226/6480] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:14 2022] DELETE /identity/v3/projects/e76a4d0d270c4f46a34df991233cb35e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:15.561043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.561586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.561769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.562042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.562320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/226e964c-eaa6-4679-8207-dadc29572e07` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.562908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=226e964c-eaa6-4679-8207-dadc29572e07)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.563222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:15.564807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.653876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f61ee-dc26-4f8c-9d4c-c7399857fee6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.681494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.682640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.682936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.683195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] PATH_INFO: `/v3/users/1cd8fa67eebe49d28123221da4c6fd93` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.684460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd8fa67eebe49d28123221da4c6fd93)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.687329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:15.899286 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3255/6481] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:53:15 2022] DELETE /identity/v3/regions/226e964c-eaa6-4679-8207-dadc29572e07 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:15.905852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:15.908149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:15.947466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bf7bb-979e-4961-b60a-2d3e1fda705a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:15.967158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:15.969111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:15.971344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:15.971632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:15.977633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:15.980922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.076805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd8fa67eebe49d28123221da4c6fd93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.150908 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3256/6482] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:53:15 2022] POST /identity/v3/regions => generated 253 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:16.155119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.182199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe0064-b827-413b-98b6-56201f36658c tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.187639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.188579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.189082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.189504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/8fe76d9644174f8eb807eab6d307b556` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.190333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:update_region(region_id=8fe76d9644174f8eb807eab6d307b556)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.191513 n-d-857339-6 devstack@keystone.service[82131]: WARNING py.warnings [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 12:53:16.191513 n-d-857339-6 devstack@keystone.service[82131]: warnings.warn(msg) Nov 02 12:53:16.191513 n-d-857339-6 devstack@keystone.service[82131]: Nov 02 12:53:16.192768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.245897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd8fa67eebe49d28123221da4c6fd93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.265550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd8fa67eebe49d28123221da4c6fd93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.268824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd8fa67eebe49d28123221da4c6fd93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.270706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd8fa67eebe49d28123221da4c6fd93'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.292071 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3227/6483] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:15 2022] DELETE /identity/v3/users/1cd8fa67eebe49d28123221da4c6fd93 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:16.480156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.480156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:16.480156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aafdb1-b06a-4f78-b8e7-bfa197c5fad5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.484032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.484032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.484032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.484032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] PATH_INFO: `/v3/users/1d48f7acb1184b3eb85af336ef4a5db1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.484702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d48f7acb1184b3eb85af336ef4a5db1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.484702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.509980 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3257/6484] 10.222.0.64 () {60 vars in 1250 bytes} [Wed Nov 2 12:53:16 2022] PATCH /identity/v3/regions/8fe76d9644174f8eb807eab6d307b556 => generated 253 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:16.514214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.520197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:16.582368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f446a9d-702a-4dd9-9443-20e081d1b7c0 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.678909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.679799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.680154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.680587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/8fe76d9644174f8eb807eab6d307b556` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.681289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:get_region(region_id=8fe76d9644174f8eb807eab6d307b556)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.682713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.690827 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3258/6485] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:53:16 2022] GET /identity/v3/regions/8fe76d9644174f8eb807eab6d307b556 => generated 253 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:16.707780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.727140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5f426-7ed1-4d52-8900-86314c76f48a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.733310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.734238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.734724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.735176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/8fe76d9644174f8eb807eab6d307b556` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.735940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=8fe76d9644174f8eb807eab6d307b556)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.738132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.894061 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3259/6486] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:53:16 2022] DELETE /identity/v3/regions/8fe76d9644174f8eb807eab6d307b556 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:16.903738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d48f7acb1184b3eb85af336ef4a5db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:16.904239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.937732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3a062-1f88-4ba5-9c0b-1bdd09336087 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:16.943934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:16.945269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:16.945745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:16.946119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:16.947758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:16.949511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:16.958343 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3260/6487] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:53:16 2022] GET /identity/v3/regions => generated 669 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:16.964544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:16.995373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531bfeb-6b00-4b7d-9a50-bbbe6245d70a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.015829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d48f7acb1184b3eb85af336ef4a5db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.030720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.032168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.033637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.034184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/8fe76d9644174f8eb807eab6d307b556` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.035369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=8fe76d9644174f8eb807eab6d307b556)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.038477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.044578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d48f7acb1184b3eb85af336ef4a5db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.045984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d48f7acb1184b3eb85af336ef4a5db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.050390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2d48b9a4-0deb-47c5-a738-6f8ab0e75860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d48f7acb1184b3eb85af336ef4a5db1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Could not find region: 8fe76d9644174f8eb807eab6d307b556.: keystone.exception.RegionNotFound: Could not find region: 8fe76d9644174f8eb807eab6d307b556. Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 8fe76d9644174f8eb807eab6d307b556. Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:53:17.092680 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 8fe76d9644174f8eb807eab6d307b556. Nov 02 12:53:17.094555 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:17.096246 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3228/6488] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:16 2022] DELETE /identity/v3/users/1d48f7acb1184b3eb85af336ef4a5db1 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:17.100008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.100959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.104749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.105018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3261/6489] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:53:16 2022] DELETE /identity/v3/regions/8fe76d9644174f8eb807eab6d307b556 => generated 112 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Nov 02 12:53:17.106268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.110726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:17.140257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215778e-8ec7-45dd-9bd6-2c5f715bb637 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.151937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:17.154701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:17.232452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.233131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.233398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.233668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.234641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.235768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.247780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3262/6490] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:53:17 2022] GET /identity/v3/regions => generated 669 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:17.261469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.281535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d804-47cc-4368-af02-36e43e380591 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.293399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.294042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.294321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.294773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.295423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.297101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.333980 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3229/6491] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:17.354486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.356248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:17.450284 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3263/6492] 10.222.0.64 () {60 vars in 1150 bytes} [Wed Nov 2 12:53:17 2022] POST /identity/v3/regions => generated 253 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:17.454681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.520553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed3961-a77b-428b-9732-93e15eac2a16 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.547124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406be7-9d1d-46b1-9c6b-4ee41ac0d02d tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.553605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.554330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.554618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.554769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.554892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.555338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.556652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.556936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.557574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Adding query filter params (parent_region_id=4ad42606590d4548a3b3f59528163e24) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:17.558145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.563126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.577768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.579163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.579277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3264/6493] 10.222.0.64 () {58 vars in 1227 bytes} [Wed Nov 2 12:53:17 2022] GET /identity/v3/regions?parent_region_id=4ad42606590d4548a3b3f59528163e24 => generated 399 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:17.581051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.609187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc30fb-c166-4bc9-97d7-53e8b27c92e2 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.622345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.623056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.623344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.623662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/673ecc8993674d9ab0cfee05dc8295f0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.624004 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3230/6494] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:17.624199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=673ecc8993674d9ab0cfee05dc8295f0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.626622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.670148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.671633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:17.698946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87def670-34cb-4c85-8d53-a6ac54aa8814 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.706598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.707444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.707918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.708342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] PATH_INFO: `/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.711183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=a52a994bd3224e4fa01ffbb5e13cfe7f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.715057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.785415 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3265/6495] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:53:17 2022] DELETE /identity/v3/regions/673ecc8993674d9ab0cfee05dc8295f0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:17.790635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:17.821789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:17.823808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bc3cc-18b6-4404-9411-78832f19c07a tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:17.832214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:17.833241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:17.833526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:17.833807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/92b80853c39f4fa78132031d9a7bcfac` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:17.834407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=92b80853c39f4fa78132031d9a7bcfac)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:17.837149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:17.946868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a52a994bd3224e4fa01ffbb5e13cfe7f', 'request_id': 'req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.955049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a52a994bd3224e4fa01ffbb5e13cfe7f', 'request_id': 'req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:17.996421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3266/6496] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:53:17 2022] DELETE /identity/v3/regions/92b80853c39f4fa78132031d9a7bcfac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:17.997807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:18.048178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b77dce-2c2a-4537-a9a9-9f41f9574147 tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:18.087677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a52a994bd3224e4fa01ffbb5e13cfe7f', 'request_id': 'req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:18.115432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] The token cache is being invalidate because project a52a994bd3224e4fa01ffbb5e13cfe7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:18.115977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:18.116411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-24a62312-93fa-4767-b7d1-afc5d6f9d7ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:18.121811 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3231/6497] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:17 2022] DELETE /identity/v3/projects/a52a994bd3224e4fa01ffbb5e13cfe7f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:18.127510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092f8f-0c3b-4d4f-8e13-7673085a84d4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.128159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092f8f-0c3b-4d4f-8e13-7673085a84d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.128159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f092f8f-0c3b-4d4f-8e13-7673085a84d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.158649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4f092f8f-0c3b-4d4f-8e13-7673085a84d4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:18.159910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4f092f8f-0c3b-4d4f-8e13-7673085a84d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:18.174946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28b8f0bf4cce46c58f8f0c158c11829c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:18.175618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.175902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.176402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] PATH_INFO: `/v3/regions/4ad42606590d4548a3b3f59528163e24` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.177076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4ad42606590d4548a3b3f59528163e24)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:18.178726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:18.322575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3232/6498] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:18.332212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.332331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.332727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.349759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3267/6499] 10.222.0.64 () {58 vars in 1230 bytes} [Wed Nov 2 12:53:17 2022] DELETE /identity/v3/regions/4ad42606590d4548a3b3f59528163e24 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:18.360386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:18.363689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:18.378938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:18.383269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:18.402766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:18.416030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3233/6500] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:18.425792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:18.425910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed13e9-658c-4591-b45e-79cc36645c1e tempest-RegionsTestJSON-2092227774 tempest-RegionsTestJSON-2092227774-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:18.440814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a321e49-2922-456f-8dd5-9fbb615c660d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:18.452121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:18.452121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.452121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.452121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] PATH_INFO: `/v3/users/fc669ada98d947c58a24c6e86536fd13` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.452570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc669ada98d947c58a24c6e86536fd13)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:18.452570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:18.452749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:18.452749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.452985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.453399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.455276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:18.455590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:18.457633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:18.474413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3234/6501] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:18.479713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:18.492419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e03c02-33a8-412f-9705-d3df779009b5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:18.498343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:18.499591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.499591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.499991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.500736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:18.502817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:18.784731 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3235/6502] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:18 2022] POST /identity/v3/projects => generated 393 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:18.784731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:18.788909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:18.880987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d650bca-7607-4b15-b458-f6525a5d1974 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:18.886989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:18.887780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:18.889864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:18.889864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] PATH_INFO: `/v3/projects/15cfd14dec0a4be4832c9a052aa3c8b8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:18.889864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cfd14dec0a4be4832c9a052aa3c8b8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:18.891888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:18.932619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc669ada98d947c58a24c6e86536fd13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.045801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc669ada98d947c58a24c6e86536fd13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.063624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc669ada98d947c58a24c6e86536fd13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.073333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc669ada98d947c58a24c6e86536fd13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.074114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc669ada98d947c58a24c6e86536fd13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.075970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cfd14dec0a4be4832c9a052aa3c8b8', 'request_id': 'req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.082655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3268/6503] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:18 2022] DELETE /identity/v3/users/fc669ada98d947c58a24c6e86536fd13 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:19.084618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cfd14dec0a4be4832c9a052aa3c8b8', 'request_id': 'req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.085866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.087791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:19.155680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94054401-6522-4555-a629-aa3d33a836b9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.162052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.162052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.162052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.162052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.162516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.164659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.224031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cfd14dec0a4be4832c9a052aa3c8b8', 'request_id': 'req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.238149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] The token cache is being invalidate because project 15cfd14dec0a4be4832c9a052aa3c8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:19.238700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.239582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca0bcd43-25bd-420d-97a6-8f4f4e889a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.244774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3236/6504] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:18 2022] DELETE /identity/v3/projects/15cfd14dec0a4be4832c9a052aa3c8b8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:19.246310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.246641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.246935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.279086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:19.298085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:19.298085 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3237/6505] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:19.298085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.298085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:19.311513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f003-e974-478a-a940-42476d12cdd3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.316646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.318860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.319185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.319467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] PATH_INFO: `/v3/users/fb6041057c804071b77388d95a014d8d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.320904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6041057c804071b77388d95a014d8d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.322981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.352659 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3269/6506] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:19 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:19.353747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.356782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:19.565998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a9f3-3e34-491d-b7d0-4a2c6ba7be04 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.571300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.572199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.572474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.573248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.603618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.605242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.646828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3270/6507] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:19.650537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.653713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:19.689070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ff8991-e050-4daf-b551-f887b31f7847 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.702245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.705057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.705057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.705337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.706019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.715002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.747250 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3271/6508] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:19.751294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.805681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0d765-b186-46a9-9879-f1938bb09298 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.834941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.843644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.843644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.843644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.843644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.845490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:19.872529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3272/6509] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:19.885784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6041057c804071b77388d95a014d8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.890982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:19.923793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a117b-9f2d-4d53-9e73-6a8c7acb21d8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:19.931336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:19.932421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:19.933032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:19.933510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] PATH_INFO: `/v3/projects/5b059fc7270c4c7c857733dc9c7c5b1f/users/06300598c538413db596c1bb7a112a6c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:19.962064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6041057c804071b77388d95a014d8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:19.975921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b059fc7270c4c7c857733dc9c7c5b1f, user_id=06300598c538413db596c1bb7a112a6c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:19.984872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.011778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6041057c804071b77388d95a014d8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.013936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6041057c804071b77388d95a014d8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.018210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6034b61f-1804-49e1-a63e-ac8b6a0663ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6041057c804071b77388d95a014d8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:20.069045 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3238/6510] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:19 2022] DELETE /identity/v3/users/fb6041057c804071b77388d95a014d8d => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:20.162708 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3273/6511] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:19 2022] PUT /identity/v3/projects/5b059fc7270c4c7c857733dc9c7c5b1f/users/06300598c538413db596c1bb7a112a6c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:20.171964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.172329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.172804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.242392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] MFA Rules not processed for user `06300598c538413db596c1bb7a112a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:20.248651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.403444 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3239/6512] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:20.407671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.414141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.654188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e5570-cd3e-4be3-9525-c847b9b0591b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.677388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.680077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.680687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.681222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.682159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.686120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:20.732097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.737033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:20.780283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:20.826420 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3274/6513] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:20 2022] POST /identity/v3/projects => generated 389 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:20.829243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860370e-d2a2-4c98-ae0d-727214f937b0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:20.831874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:20.989295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:20.989953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:20.990232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:20.990498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] PATH_INFO: `/v3/projects/926415d28b694be19320580d8d2b0c6f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:20.997455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] RBAC: Authorizing `identity:delete_project(project_id=926415d28b694be19320580d8d2b0c6f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:20.999473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.050282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0c091-0ad6-4cc2-b414-5dcd258205b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.067398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.068131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.068413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.068724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.069402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.071338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.098183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:21.249154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926415d28b694be19320580d8d2b0c6f', 'request_id': 'req-ca45750b-fb79-4306-85bc-652e67a1817e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.289203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926415d28b694be19320580d8d2b0c6f', 'request_id': 'req-ca45750b-fb79-4306-85bc-652e67a1817e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.321279 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3275/6514] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:20 2022] POST /identity/v3/users => generated 301 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:21.325578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.363520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c945da9-2659-4e78-b8b8-7d1eb56dfa6f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.441132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926415d28b694be19320580d8d2b0c6f', 'request_id': 'req-ca45750b-fb79-4306-85bc-652e67a1817e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.475411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] The token cache is being invalidate because project 926415d28b694be19320580d8d2b0c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:21.482772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.486088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:21.488020 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3240/6515] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:20 2022] DELETE /identity/v3/projects/926415d28b694be19320580d8d2b0c6f => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:21.493734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.494947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.495153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.495802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.496182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.497047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.499493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.502826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.524742 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3276/6516] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:21 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:21.526523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.528468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.534954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45750b-fb79-4306-85bc-652e67a1817e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.549603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.550563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.551015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.552207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] PATH_INFO: `/v3/users/28b8f0bf4cce46c58f8f0c158c11829c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.554244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b8f0bf4cce46c58f8f0c158c11829c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.556440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.568323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ccce0-da86-4c8f-851f-cedce2230902 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:21.574399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:21.575536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:21.575817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:21.576084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] PATH_INFO: `/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec/users/6ecb5583b7e6475ba0cbd26e33ced6a5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:21.604189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fde523165c477bbc9af94a9ee9f6ec, user_id=6ecb5583b7e6475ba0cbd26e33ced6a5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:21.608063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:21.836334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3277/6517] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:21 2022] PUT /identity/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec/users/6ecb5583b7e6475ba0cbd26e33ced6a5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:21.840304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:21.848262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:21.900997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b8f0bf4cce46c58f8f0c158c11829c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.005354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b8f0bf4cce46c58f8f0c158c11829c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.030520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b8f0bf4cce46c58f8f0c158c11829c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.031562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b8f0bf4cce46c58f8f0c158c11829c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.032893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b8f0bf4cce46c58f8f0c158c11829c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.048464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466420f-1c81-48e2-b58c-0b7c35249f8a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.058406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.059064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.059342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.059618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] PATH_INFO: `/v3/projects/9b15f6cf9cf3492282a79e039ce7a758` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.060821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b15f6cf9cf3492282a79e039ce7a758)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.062772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.075846 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3241/6518] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:21 2022] DELETE /identity/v3/users/28b8f0bf4cce46c58f8f0c158c11829c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.082683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.082683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.254086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c364-cbec-4072-9229-173bc17b37d2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.283560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.284271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.284859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.285131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.286336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.287555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.314419 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3242/6519] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:22.319062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.340675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eb249-3ed1-4d1b-97ef-62a2879111f1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.393055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b15f6cf9cf3492282a79e039ce7a758', 'request_id': 'req-6dccba63-568a-44ea-be75-ffaab07743ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.401173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b15f6cf9cf3492282a79e039ce7a758', 'request_id': 'req-6dccba63-568a-44ea-be75-ffaab07743ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.458147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b15f6cf9cf3492282a79e039ce7a758', 'request_id': 'req-6dccba63-568a-44ea-be75-ffaab07743ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.487490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.487973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.489528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.491706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] PATH_INFO: `/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec/users/6ecb5583b7e6475ba0cbd26e33ced6a5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.498950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fde523165c477bbc9af94a9ee9f6ec, user_id=6ecb5583b7e6475ba0cbd26e33ced6a5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.504443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbfd3e9-23d8-404a-9ea8-7b124409bd64 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.558455 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3243/6520] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:22 2022] PUT /identity/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec/users/6ecb5583b7e6475ba0cbd26e33ced6a5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.563965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.564267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.564585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.627099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] MFA Rules not processed for user `6ecb5583b7e6475ba0cbd26e33ced6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:22.629474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.642998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] The token cache is being invalidate because project 9b15f6cf9cf3492282a79e039ce7a758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:22.643478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.644983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6dccba63-568a-44ea-be75-ffaab07743ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:22.648540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3278/6521] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:21 2022] DELETE /identity/v3/projects/9b15f6cf9cf3492282a79e039ce7a758 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:22.654036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.655253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.655545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.714605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:22.716331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.753668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3244/6522] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:22.767154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.771655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.850192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3279/6523] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:22.851495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:22.857724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:22.883513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09349ac0-29e0-4754-b9d5-7e805c66b10f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.889758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.890571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.890946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.891360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] PATH_INFO: `/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.893282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcfe378cd50414eb36e6d3c2abbb0ba)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.895358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.919692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e036-8f7f-4a02-8fc9-740cd5af43ef None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:22.925916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:22.926571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.927098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.927530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.943417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:22.943417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0394f-cd83-422e-801f-b3f28b58f5c5 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:22.958883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3245/6524] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:22.969885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:22.970124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:22.970409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:22.998346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:23.000460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.012574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3246/6525] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:23.015012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.035836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a40be-0068-4082-9503-dd0d9b705987 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.047685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.049005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.049294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.057777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.059054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:23.061221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.061221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.081732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'request_id': 'req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.092956 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3247/6526] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:23.093933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.107412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'request_id': 'req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.107753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.109768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcfe378cd50414eb36e6d3c2abbb0ba', 'request_id': 'req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.127154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a61bf-e67e-4c2a-88e7-4c3a7f8e3b64 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.192859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.193584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.193933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.195052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.197025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.222327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] The token cache is being invalidate because project 1fcfe378cd50414eb36e6d3c2abbb0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:23.222732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.224913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:23.226531 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3280/6527] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:22 2022] DELETE /identity/v3/projects/1fcfe378cd50414eb36e6d3c2abbb0ba => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:23.230646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.235279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.245444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:23.319229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.322511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04635aa4-607d-48dc-adb8-d1a8072b72d4 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.338453 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3248/6528] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:23.340204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf72925-72fd-47e4-8538-3be91853af3a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.341017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf72925-72fd-47e4-8538-3be91853af3a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.341632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf72925-72fd-47e4-8538-3be91853af3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.348436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b92d4-b4a1-4c7b-9f4d-b0880e7aa836 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.356927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.357583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.357918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.358712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.359378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.361624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.368165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-edf72925-72fd-47e4-8538-3be91853af3a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:23.370626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-edf72925-72fd-47e4-8538-3be91853af3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.387306 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3249/6529] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:23.389450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.389880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.390152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.415147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:23.438761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:23.451096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3250/6530] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:23.456280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.468178 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3281/6531] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/projects => generated 363 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:23.476902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6debb0-7a90-42fb-8f18-beaba52c85d1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.478054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.584343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.586075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.586515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.587740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.588936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:23.589891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.592648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.609420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:23.634834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d109179-a19f-4004-adcc-7f2141eb0b6b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.635937 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3251/6532] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:53:23.637439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.649682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.653285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.653285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.653285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.653285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.654940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.657821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f17d4-594f-4035-9038-95507ded6f06 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.665299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.666223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.666511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.667289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.669045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.671121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.775500 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3282/6533] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/users => generated 282 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:23.776687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.790618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe637b5c-fc10-4f16-84c8-f1346d359e0c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.808830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.809584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.809859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.810128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.810936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.812957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.824908 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3283/6534] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:23.834991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.853078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd630c5a-860b-45f1-86ae-38fc82c2b3cb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:23.859031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:23.863265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:23.863265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:23.863265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:23.863265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:23.863265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:23.872764 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3252/6535] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/projects => generated 391 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:23.874810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.884456 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3284/6536] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:23.885655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:23.898414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec65264-0f20-4e44-970e-1dcc0960ee72 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.034416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25d7f4-4a4d-4157-be14-cbf380de2989 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.036726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.037484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.037869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.038214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] PATH_INFO: `/v3/projects/e2dcb849fb9446298147ae4926d38cd6/users/fc8b7e0dc65040c69e379f8df2f3443a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.047526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.048159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.048435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.048736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.049401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.051499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.075842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dcb849fb9446298147ae4926d38cd6, user_id=fc8b7e0dc65040c69e379f8df2f3443a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.079048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4f1f6-7b0c-42cb-84f8-c86f448437c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.179355 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3285/6537] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:23 2022] PUT /identity/v3/projects/e2dcb849fb9446298147ae4926d38cd6/users/fc8b7e0dc65040c69e379f8df2f3443a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.193850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.193850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.193850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.202018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3253/6538] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:23 2022] POST /identity/v3/users => generated 302 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:24.206315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.249925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3475e4-6396-46d3-9046-7459552c0b98 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.258356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] MFA Rules not processed for user `fc8b7e0dc65040c69e379f8df2f3443a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:24.260802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:24.396355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.397051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.397417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.397742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.398422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.412354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.427127 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3286/6539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:24.432394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.438952 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3254/6540] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:24.440299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.480543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b30c7-237f-486a-b512-b6cd63189047 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.490173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2fcce-03b0-4620-bb1c-777e45d856b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.497644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.502726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.502726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.502726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] PATH_INFO: `/v3/projects/22939b0c49eb42bb8fb863e736016d2e/users/83202230617944d7bba522a80bf6f6be/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.503010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.503010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:24.503010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:24.503010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:24.503355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.504563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.591822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22939b0c49eb42bb8fb863e736016d2e, user_id=83202230617944d7bba522a80bf6f6be, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:24.607115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:24.677828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3287/6541] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/projects => generated 363 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:24.681859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.742300 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3255/6542] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:24 2022] PUT /identity/v3/projects/22939b0c49eb42bb8fb863e736016d2e/users/83202230617944d7bba522a80bf6f6be/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:24.762093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:24.849495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2cf0-d2b9-484b-9c05-375e6dbc1523 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:24.999328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:24.999954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.002958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57204663-2596-448e-ba7e-f6ba20437de2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.003588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.003879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.004616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.007104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0055bc0-710f-44e9-8b0f-0ecfa4aff336 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.015212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.015845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.016125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.016403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.017094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.018788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.040185 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3256/6543] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:25.043394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.055965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6309f-5dcc-43cc-8158-44276875d49a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.073351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.073351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.073697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.074260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] PATH_INFO: `/v3/projects/22939b0c49eb42bb8fb863e736016d2e/users/83202230617944d7bba522a80bf6f6be/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.076660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22939b0c49eb42bb8fb863e736016d2e, user_id=83202230617944d7bba522a80bf6f6be, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.081164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.120520 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3257/6544] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:25 2022] PUT /identity/v3/projects/22939b0c49eb42bb8fb863e736016d2e/users/83202230617944d7bba522a80bf6f6be/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:25.147969 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3288/6545] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:24 2022] POST /identity/v3/users => generated 288 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:25.151666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.246024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.246999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.247589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.332962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] MFA Rules not processed for user `83202230617944d7bba522a80bf6f6be`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:25.337249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:25.539416 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3289/6546] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:25 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:25.543814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.710463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406feb0-0192-4b54-8567-42a814d5181a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.726278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080651-5ae6-4de3-bfe4-a5c80aae2401 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.740327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.741751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.742037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.744756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.745124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.752540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.752871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.756126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.760912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.761652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.763164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.775893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.801851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3258/6547] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:25.804245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:25.833091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358a5f1-9b31-4179-9f14-5d5ea7522276 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:25.844007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:25.846144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:25.846373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:25.846907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] PATH_INFO: `/v3/projects/de5a4d4fb188466baba441083b0ddd31/users/81696424d578469bad0d8131d7eee315/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:25.932499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5a4d4fb188466baba441083b0ddd31, user_id=81696424d578469bad0d8131d7eee315, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:25.939711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb49df-c768-44cf-81cd-eca930273b1e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:25.984408 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3290/6548] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:25 2022] POST /identity/v3/projects => generated 393 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:25.987855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.068600 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3259/6549] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:25 2022] PUT /identity/v3/projects/de5a4d4fb188466baba441083b0ddd31/users/81696424d578469bad0d8131d7eee315/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:26.068600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.068600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.068600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.201305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bead75-732b-411e-a6c0-b76e8ea2c5db admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.358747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:26.362756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.382682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3260/6550] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:26.382682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.392635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.393279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.393552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.393821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.394454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.397712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.422633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03716078-e701-4623-9532-80b53e2ee1cf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.446877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.448141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.450038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.453815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.460396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.467425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.503580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3261/6551] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:26.504930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.509823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:26.545226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3291/6552] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:25 2022] POST /identity/v3/users => generated 297 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:26.547259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.581747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4186b8-7d68-4caa-a2b2-a874520a7c6a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.601441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.605245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.606191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.607167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] PATH_INFO: `/v3/projects/de5a4d4fb188466baba441083b0ddd31/users/81696424d578469bad0d8131d7eee315/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.621714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5a4d4fb188466baba441083b0ddd31, user_id=81696424d578469bad0d8131d7eee315, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.629630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.708960 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3292/6553] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:26 2022] PUT /identity/v3/projects/de5a4d4fb188466baba441083b0ddd31/users/81696424d578469bad0d8131d7eee315/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:26.709939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:26.826910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45e72e-155f-4685-9de3-20cc8e6b9ab5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.881163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:26.907051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc795ab-17ac-40e1-afac-5456086924bd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:26.913944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.916510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.917005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:26.917870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.918359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.919239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:26.921200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a40ffa-ce78-4aa7-b298-80d7982086bd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:26.933992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3293/6554] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:26.938867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.939459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.939940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.964579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:26.965218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:26.965495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:26.965766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:26.987742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] MFA Rules not processed for user `81696424d578469bad0d8131d7eee315`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:26.994174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.148363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3294/6555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:27.148363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.168009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0f539-afb3-48b5-aefb-7db35c659ad5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.176669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.177304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.177592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.181705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.187684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.187684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.214863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:27.223119 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3295/6556] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:27.231615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.239434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.340321 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3262/6557] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:26 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:27.347955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.374672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064e01c-6c8a-41f5-993f-5757d3386ae2 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.393026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.394786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.395275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.395749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] PATH_INFO: `/v3/projects/2e89b1f11ca14f25869236cd308963d2/users/14898c88285e45aaacb11d56210aa8f9/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.406276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cacf84-ec23-478b-8ee5-b945af2dd716 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:27.416194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:27.418303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.424563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.425040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.436628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e89b1f11ca14f25869236cd308963d2, user_id=14898c88285e45aaacb11d56210aa8f9, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.440029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.452149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:27.457322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af989272-19ca-4435-9615-222c7ce47a82 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:27.488289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3296/6558] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:27.589366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3263/6559] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:27 2022] PUT /identity/v3/projects/2e89b1f11ca14f25869236cd308963d2/users/14898c88285e45aaacb11d56210aa8f9/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:27.591753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:27.592620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:27.593144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:27.656850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] MFA Rules not processed for user `14898c88285e45aaacb11d56210aa8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:27.659174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.824585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3297/6560] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:27.841539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:27.844250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:27.931229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:28.005701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d1bf8-d372-465d-923b-1317b1a33682 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:28.016174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:28.018367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.018683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.018959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.137865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484411-c626-489e-a8fe-e4b64c185cfc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:28.151126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:28.151905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.152401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.152919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.199096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:28.201549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51ff6-0464-4e61-bdc7-20f411847f19 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:28.243806 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3264/6561] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:28.312768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:28.317231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf6d64-19ef-4110-b1c9-daf3a56b69cf service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:28.346320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b7cf-de8f-456d-bf5d-75086a55fa76 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.346854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b7cf-de8f-456d-bf5d-75086a55fa76 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.347127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954b7cf-de8f-456d-bf5d-75086a55fa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.355234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3298/6562] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:28.383981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f954b7cf-de8f-456d-bf5d-75086a55fa76 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:28.389425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f954b7cf-de8f-456d-bf5d-75086a55fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:28.404015 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3265/6563] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:28 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:28.405606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f048a0a-1fe0-4a2d-81ac-de9b5b2abc12 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.405908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f048a0a-1fe0-4a2d-81ac-de9b5b2abc12 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.406188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f048a0a-1fe0-4a2d-81ac-de9b5b2abc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7f048a0a-1fe0-4a2d-81ac-de9b5b2abc12 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:53:28.634018 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self.check_revocation(token) Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:28.635184 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Nov 02 12:53:28.637143 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:53:28.640461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3299/6564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:28 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 02 12:53:28.645417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.645712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.645997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.896393 n-d-857339-6 devstack@keystone.service[82132]: WARNING keystone.server.flask.application [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.64: keystone.exception.Unauthorized: The request you have made requires authentication. Nov 02 12:53:28.903904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd91d03-1f0a-492c-a2e1-acac0c1989bd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:28.904422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd91d03-1f0a-492c-a2e1-acac0c1989bd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:28.904866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd91d03-1f0a-492c-a2e1-acac0c1989bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:28.908255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3266/6565] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:28 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 264 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Nov 02 12:53:29.092826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:29.147521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fbd91d03-1f0a-492c-a2e1-acac0c1989bd None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:29.152032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fbd91d03-1f0a-492c-a2e1-acac0c1989bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:29.167199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:29.172392 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3300/6566] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:29.199496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c590c3-b697-4614-bc0f-d2a886dd80a4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:29.202764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9eac2-86bf-4b3a-9240-0470966aef19 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:29.203589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9eac2-86bf-4b3a-9240-0470966aef19 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:29.203933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9eac2-86bf-4b3a-9240-0470966aef19 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:29.206561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9eac2-86bf-4b3a-9240-0470966aef19 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:29.457000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-79d9eac2-86bf-4b3a-9240-0470966aef19 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:29.755361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3267/6567] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:29 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:30.349609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:30.761133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:30.761629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:30.762060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:30.798844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:30.800089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:30.812338 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3301/6568] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:30.817168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9579-80f5-4b75-a40a-3ef7b11f2193 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:30.817632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9579-80f5-4b75-a40a-3ef7b11f2193 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:30.817727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e9579-80f5-4b75-a40a-3ef7b11f2193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:30.857616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b01e9579-80f5-4b75-a40a-3ef7b11f2193 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:30.858868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b01e9579-80f5-4b75-a40a-3ef7b11f2193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:30.886786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3268/6569] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:30.887963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:30.908957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c61c0c-230f-4444-99e3-bc176c4a6afe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:30.920835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:30.921752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:30.922189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:30.922616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:31.176950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:31.301691 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3302/6570] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:30 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:31.708172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:32.307508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd344c-674c-4bb5-8ccb-49b8ee5bb61a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.308762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd344c-674c-4bb5-8ccb-49b8ee5bb61a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.309197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd344c-674c-4bb5-8ccb-49b8ee5bb61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.329769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.348586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d2fd344c-674c-4bb5-8ccb-49b8ee5bb61a None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:32.357492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d2fd344c-674c-4bb5-8ccb-49b8ee5bb61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.370280 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3269/6571] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:32 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:32.372253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.376704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.377254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.438237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:32.441175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:32.477942 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3270/6572] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:32.479161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:32.499647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e77641-3204-460c-af64-78900ea9c2ed tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.501809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24323b9-9b35-4570-9ecd-395539ccb8d3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:32.517941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.518538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.518814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.522427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266f8c1-0234-40b8-9f65-6b912813edb8 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3733ac5b0e8f40989353cedac81004e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd0581b732e004d1daa7fc194eb2fd645', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:32.523404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f8c1-0234-40b8-9f65-6b912813edb8 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:32.523891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f8c1-0234-40b8-9f65-6b912813edb8 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:32.524446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266f8c1-0234-40b8-9f65-6b912813edb8 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7/password` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.553535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] PATH_INFO: `/v3/users/83202230617944d7bba522a80bf6f6be` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:32.557789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83202230617944d7bba522a80bf6f6be)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:32.569840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:32.726291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1266f8c1-0234-40b8-9f65-6b912813edb8 tempest-IdentityV3UsersTest-1221656051 tempest-IdentityV3UsersTest-1221656051-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:32.763053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:32.839526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3271/6573] 10.222.0.64 () {60 vars in 1269 bytes} [Wed Nov 2 12:53:32 2022] POST /identity/v3/users/3733ac5b0e8f40989353cedac81004e7/password => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:32.899508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83202230617944d7bba522a80bf6f6be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.047593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83202230617944d7bba522a80bf6f6be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.073810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83202230617944d7bba522a80bf6f6be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.093109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83202230617944d7bba522a80bf6f6be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.095351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83202230617944d7bba522a80bf6f6be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:33.128640 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3303/6574] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:32 2022] DELETE /identity/v3/users/83202230617944d7bba522a80bf6f6be => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:33.134053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150cac-4aee-46ad-a993-d8c12bddbefa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.134339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150cac-4aee-46ad-a993-d8c12bddbefa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.134819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17150cac-4aee-46ad-a993-d8c12bddbefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.176281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17150cac-4aee-46ad-a993-d8c12bddbefa None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:33.179205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17150cac-4aee-46ad-a993-d8c12bddbefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.302002 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3272/6575] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:33.313761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:33.315439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.541840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22d3ab-6dc0-4c7e-a67e-cc64156e64a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:33.555851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:33.556115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.556340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.556718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.584261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:33.587385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:33.621518 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3304/6576] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:33.841565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd61c-5a1c-4b66-9c1a-0af09f7b898d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:33.842495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd61c-5a1c-4b66-9c1a-0af09f7b898d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:33.843560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecd61c-5a1c-4b66-9c1a-0af09f7b898d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:33.915397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a9ecd61c-5a1c-4b66-9c1a-0af09f7b898d None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:33.916979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a9ecd61c-5a1c-4b66-9c1a-0af09f7b898d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:33.938625 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3273/6577] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:33 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Nov 02 12:53:34.593184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:34.595991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:34.611907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a4ed6-b265-488b-b9e6-9b9d531b6f75 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:34.618300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:34.621128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.621758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.622199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] PATH_INFO: `/v3/users/fc8b7e0dc65040c69e379f8df2f3443a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:34.625171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8b7e0dc65040c69e379f8df2f3443a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:34.629806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:34.943855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:34.944357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:34.944624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.010769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8b7e0dc65040c69e379f8df2f3443a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.023477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] MFA Rules not processed for user `3733ac5b0e8f40989353cedac81004e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:35.026830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.148416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8b7e0dc65040c69e379f8df2f3443a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.204345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8b7e0dc65040c69e379f8df2f3443a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.222610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3274/6578] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:35.224970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.233222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.242685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8b7e0dc65040c69e379f8df2f3443a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.253979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8b7e0dc65040c69e379f8df2f3443a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.279444 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3305/6579] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:34 2022] DELETE /identity/v3/users/fc8b7e0dc65040c69e379f8df2f3443a => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:35.280572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:35.284039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:35.285784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea5ebf-eb87-45a9-8d39-42ffb1eed305 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.452393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08ce61-6936-48b2-b161-a988cb940d0d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:35.471237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.471237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.471237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.471237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] PATH_INFO: `/v3/users/3733ac5b0e8f40989353cedac81004e7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.471631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3733ac5b0e8f40989353cedac81004e7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.471631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.480027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:35.481112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:35.481621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:35.484773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] PATH_INFO: `/v3/projects/22939b0c49eb42bb8fb863e736016d2e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:35.489866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22939b0c49eb42bb8fb863e736016d2e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:35.495860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:35.844601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.848282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22939b0c49eb42bb8fb863e736016d2e', 'request_id': 'req-f219935e-8b20-4027-a153-443c1d4a0727'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.871456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22939b0c49eb42bb8fb863e736016d2e', 'request_id': 'req-f219935e-8b20-4027-a153-443c1d4a0727'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:35.978861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.022735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.061556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.063185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02a905f0-21c1-4f22-8fde-5161980ae10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3733ac5b0e8f40989353cedac81004e7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.084851 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3306/6580] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:35 2022] DELETE /identity/v3/users/3733ac5b0e8f40989353cedac81004e7 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:36.086905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:36.087453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:36.088015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.091701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22939b0c49eb42bb8fb863e736016d2e', 'request_id': 'req-f219935e-8b20-4027-a153-443c1d4a0727'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.131368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] The token cache is being invalidate because project 22939b0c49eb42bb8fb863e736016d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:36.133515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.136638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f219935e-8b20-4027-a153-443c1d4a0727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.139934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:36.141639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:36.141778 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3275/6581] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:35 2022] DELETE /identity/v3/projects/22939b0c49eb42bb8fb863e736016d2e => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:36.150811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:36.150811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:36.150811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.198392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:36.200926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:36.277032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3307/6582] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:36.278267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:36.279707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:36.324255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059bf0de-ba66-4ef8-9dde-88c421d27d0e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:36.335057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:36.335713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:36.335990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:36.336262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] PATH_INFO: `/v3/users/14898c88285e45aaacb11d56210aa8f9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.339725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14898c88285e45aaacb11d56210aa8f9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:36.339725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:36.367667 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3276/6583] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:36.369233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:36.371001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:36.498400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed447b-9ffa-4015-a129-6cdd52a81550 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:36.503269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:36.503905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:36.504180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:36.504450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.522516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:36.524245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:36.538880 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3277/6584] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:36.539844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:36.556157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdbe9a-578b-4623-8b73-0d593f2bb6cf service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:36.561770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:36.562586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:36.562865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:36.563153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:36.585371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:36.587079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:36.631169 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3278/6585] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:36.729274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14898c88285e45aaacb11d56210aa8f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.855725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14898c88285e45aaacb11d56210aa8f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.877035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14898c88285e45aaacb11d56210aa8f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.902320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14898c88285e45aaacb11d56210aa8f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.903633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14898c88285e45aaacb11d56210aa8f9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:36.911051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3308/6586] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:36 2022] DELETE /identity/v3/users/14898c88285e45aaacb11d56210aa8f9 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:37.071358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:37.169522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:37.896650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:37.899031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:37.922981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fbbd7-618f-4b96-a21f-acf3cb65679e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.104968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.105530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.105840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.106065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] PATH_INFO: `/v3/projects/e2dcb849fb9446298147ae4926d38cd6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.109375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dcb849fb9446298147ae4926d38cd6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.111463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.132457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.135704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.160254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244b6a0-0d08-4325-86bc-6fd0eca3264c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.188833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.189947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.190411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.190866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] PATH_INFO: `/v3/projects/2e89b1f11ca14f25869236cd308963d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.196423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e89b1f11ca14f25869236cd308963d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.200929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.393125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dcb849fb9446298147ae4926d38cd6', 'request_id': 'req-d1791e3e-2e0c-4738-a748-762df23c4d32'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.413039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dcb849fb9446298147ae4926d38cd6', 'request_id': 'req-d1791e3e-2e0c-4738-a748-762df23c4d32'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.479630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e89b1f11ca14f25869236cd308963d2', 'request_id': 'req-21eb81de-4aaa-4189-a8fe-997083069150'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.492869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e89b1f11ca14f25869236cd308963d2', 'request_id': 'req-21eb81de-4aaa-4189-a8fe-997083069150'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.508997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e89b1f11ca14f25869236cd308963d2', 'request_id': 'req-21eb81de-4aaa-4189-a8fe-997083069150'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.537726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dcb849fb9446298147ae4926d38cd6', 'request_id': 'req-d1791e3e-2e0c-4738-a748-762df23c4d32'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.556748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] The token cache is being invalidate because project e2dcb849fb9446298147ae4926d38cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:38.557078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.557807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.561123 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3279/6587] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:37 2022] DELETE /identity/v3/projects/e2dcb849fb9446298147ae4926d38cd6 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:38.561722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.569728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.672082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] The token cache is being invalidate because project 2e89b1f11ca14f25869236cd308963d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:38.672379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.676339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:38.680417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3309/6588] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:38 2022] DELETE /identity/v3/projects/2e89b1f11ca14f25869236cd308963d2 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:38.681692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:38.687722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:38.756785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1791e3e-2e0c-4738-a748-762df23c4d32 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.866769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb81de-4aaa-4189-a8fe-997083069150 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:38.881002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.882609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.883286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.885595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] PATH_INFO: `/v3/users/81696424d578469bad0d8131d7eee315` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.887815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81696424d578469bad0d8131d7eee315)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.891312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:38.907835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:38.909026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:38.909307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:38.909624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] PATH_INFO: `/v3/projects/d0581b732e004d1daa7fc194eb2fd645` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:38.911024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0581b732e004d1daa7fc194eb2fd645)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:38.913361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:39.091096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0581b732e004d1daa7fc194eb2fd645', 'request_id': 'req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.099591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0581b732e004d1daa7fc194eb2fd645', 'request_id': 'req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.179791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0581b732e004d1daa7fc194eb2fd645', 'request_id': 'req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.202913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] The token cache is being invalidate because project d0581b732e004d1daa7fc194eb2fd645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:39.203489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.204360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4a36dfd0-2ab6-49a6-ab6b-a17c01a0ddc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.206437 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3280/6589] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:38 2022] DELETE /identity/v3/projects/d0581b732e004d1daa7fc194eb2fd645 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:39.208012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.210458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.211122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.223232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81696424d578469bad0d8131d7eee315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.235538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:39.237092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:39.316109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3281/6590] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:39.317080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:39.320274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:39.335613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b012359-0584-484b-be3b-b390c8a5b8c2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:39.340152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:39.341821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.341821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.341966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] PATH_INFO: `/v3/users/06300598c538413db596c1bb7a112a6c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.343138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06300598c538413db596c1bb7a112a6c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:39.345291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:39.360547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:39.432271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81696424d578469bad0d8131d7eee315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.450299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81696424d578469bad0d8131d7eee315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.458262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81696424d578469bad0d8131d7eee315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.460051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3405e153-0218-4605-b966-1eb30c4b9c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81696424d578469bad0d8131d7eee315'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.477705 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3310/6591] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:38 2022] DELETE /identity/v3/users/81696424d578469bad0d8131d7eee315 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:39.479311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816326-4a7c-4304-901d-a1088aa30d7a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.479599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816326-4a7c-4304-901d-a1088aa30d7a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.479868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816326-4a7c-4304-901d-a1088aa30d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.506262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c5816326-4a7c-4304-901d-a1088aa30d7a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:39.508007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c5816326-4a7c-4304-901d-a1088aa30d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:39.625458 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3311/6592] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:39.627394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce990d-5b44-47f1-992c-e3c902a51a50 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.627987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce990d-5b44-47f1-992c-e3c902a51a50 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.628673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce990d-5b44-47f1-992c-e3c902a51a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.697133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-79ce990d-5b44-47f1-992c-e3c902a51a50 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:39.698768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-79ce990d-5b44-47f1-992c-e3c902a51a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:39.706069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06300598c538413db596c1bb7a112a6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.716853 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3312/6593] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:39.718001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.718468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.719685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.747579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:39.763529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:39.786128 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3313/6594] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:39.788590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:39.805119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec35ac2-2852-4cf7-98f1-4d07fa1230bf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:39.810441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:39.811124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.811407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.811679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.812335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:39.812851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:39.814523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:39.830293 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3314/6595] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:39.830741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:39.844398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3637f-1ef0-406b-b935-9094683a31ea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:39.854370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:39.854370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.854370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.854370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.854670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:39.854670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:39.855299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:39.886544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06300598c538413db596c1bb7a112a6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.908149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3315/6596] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:39.914365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:39.923189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06300598c538413db596c1bb7a112a6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.925155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06300598c538413db596c1bb7a112a6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.927656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06300598c538413db596c1bb7a112a6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:39.960143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80bb729-5563-42ee-8df8-f700380129da admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:39.973188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:39.973188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:39.974440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:39.975389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3282/6597] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:39 2022] DELETE /identity/v3/users/06300598c538413db596c1bb7a112a6c => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:39.976565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:39.977294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:39.977565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:39.981159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026089ea-31cc-4a26-85aa-58dd56010a61 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:39.985018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:40.155146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a358fe-ecc3-4918-87b4-4c747fba6892 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.166530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.167182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.171343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.171707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.172431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.178982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.196552 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3316/6598] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:40.198182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.198452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.202775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.256675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:40.258874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:40.385208 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3317/6599] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:40.386042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.387409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:40.401385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d3f48-aee9-4f09-8cda-3097f4ddc634 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.413512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.413512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.413512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.413512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.414314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.414314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.414451 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3283/6600] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:39 2022] POST /identity/v3/projects => generated 397 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:40.414451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.416442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:40.493863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229481e2-090e-442d-8049-a796a5233998 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.498130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.498832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.499115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.501432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.577297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.578932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.589977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3284/6601] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:40.593494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.595716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:40.628436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074072b-af66-4b94-ab93-33768b8c789d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.634352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.635358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.636329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.636329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] PATH_INFO: `/v3/projects/de5a4d4fb188466baba441083b0ddd31` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.641797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5a4d4fb188466baba441083b0ddd31)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.645005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.667816 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3318/6602] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:40 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:40.667816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.686285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94af30d-1830-4f37-8de8-4f4ee3e09ac6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.696581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.698445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.698954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.701171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.701171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.702601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.821996 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3319/6603] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:40 2022] POST /identity/v3/users => generated 305 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:40.823036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.834542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd9a3c-b3b7-4a1f-abd3-7d5dffd9f9bb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:40.843336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5a4d4fb188466baba441083b0ddd31', 'request_id': 'req-19307f09-9489-4296-910a-cbce9a6d0541'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:40.854832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5a4d4fb188466baba441083b0ddd31', 'request_id': 'req-19307f09-9489-4296-910a-cbce9a6d0541'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:40.953630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:40.954403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:40.954684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:40.955105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:40.955995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:40.957969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:40.963380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5a4d4fb188466baba441083b0ddd31', 'request_id': 'req-19307f09-9489-4296-910a-cbce9a6d0541'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:40.976543 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3320/6604] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:40.977690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.983399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] The token cache is being invalidate because project de5a4d4fb188466baba441083b0ddd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:40.984003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:40.984885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:40.992206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3285/6605] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:40 2022] DELETE /identity/v3/projects/de5a4d4fb188466baba441083b0ddd31 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:40.992206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:40.993087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.004337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2415b62-313c-4df6-8ac9-92fb9f449ef8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.004337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:41.009164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.010626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.011904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.012263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.014402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.015124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19307f09-9489-4296-910a-cbce9a6d0541 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.016801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743dc9a-3a3e-4aef-83c8-4c6093da7583 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.022913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.024098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.024653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.025133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.026084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.028989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.033773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3321/6606] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:41.035887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.036190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.036573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.044425 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3286/6607] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:41.045867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.048225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.063468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562ec3-bf91-422f-8890-dbda21373c91 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.069575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.069764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:41.070492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.070823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.070924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.071097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] PATH_INFO: `/v3/projects/6c6332695ad1466688e0e25550f37c84/users/0a0681252b8e484eae9a83b434a48896/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.086233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3322/6608] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:41.087217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.102041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6332695ad1466688e0e25550f37c84, user_id=0a0681252b8e484eae9a83b434a48896, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.103845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490704a0-6a54-4c58-a0e6-a62411ec7d22 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.106923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.109891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.110584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.110852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.111124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] PATH_INFO: `/v3/projects/14b95955f0504596993e441d78bb5636/users/d08361c8a21041fba5ee30ec490adab4/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.129231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b95955f0504596993e441d78bb5636, user_id=d08361c8a21041fba5ee30ec490adab4, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.132611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea75f0-6f30-452c-96fe-9422006d2b02 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.275078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3323/6609] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:41 2022] PUT /identity/v3/projects/14b95955f0504596993e441d78bb5636/users/d08361c8a21041fba5ee30ec490adab4/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:41.275709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3287/6610] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:41 2022] PUT /identity/v3/projects/6c6332695ad1466688e0e25550f37c84/users/0a0681252b8e484eae9a83b434a48896/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:41.276080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.278378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.283262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.284271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.284769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.313887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:41.314865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.362161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe97d5-f05a-493e-afd7-90a066275e24 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.373754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.375023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.375429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.375714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] PATH_INFO: `/v3/projects/5b059fc7270c4c7c857733dc9c7c5b1f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.377015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b059fc7270c4c7c857733dc9c7c5b1f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.380779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.415368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3324/6611] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:41.419043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.449016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a28e3-3b31-49a9-9772-614bc978ec6c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.466144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.468602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.468962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.469480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.472401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.481089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e87317-f2de-45f1-90a0-60e579c58a95 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.504645 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3325/6612] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:41.504645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424688-568d-439a-90be-ce9762ef022f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.504645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424688-568d-439a-90be-ce9762ef022f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.504904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17424688-568d-439a-90be-ce9762ef022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.540991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-17424688-568d-439a-90be-ce9762ef022f None None] MFA Rules not processed for user `d08361c8a21041fba5ee30ec490adab4`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:41.543319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17424688-568d-439a-90be-ce9762ef022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.618385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b059fc7270c4c7c857733dc9c7c5b1f', 'request_id': 'req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:41.625999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b059fc7270c4c7c857733dc9c7c5b1f', 'request_id': 'req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:41.656807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3326/6613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:41.656807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424688-568d-439a-90be-ce9762ef022f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.675805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17424688-568d-439a-90be-ce9762ef022f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.757523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.773386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.774727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3327/6614] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:41.775725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.786201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49098f4-a0f2-4631-914d-16106964449d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.791315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.791979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.792255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.792555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] PATH_INFO: `/v3/projects/6c6332695ad1466688e0e25550f37c84/users/0a0681252b8e484eae9a83b434a48896/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.794580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c6332695ad1466688e0e25550f37c84, user_id=0a0681252b8e484eae9a83b434a48896, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.797402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.815850 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3328/6615] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:41 2022] PUT /identity/v3/projects/6c6332695ad1466688e0e25550f37c84/users/0a0681252b8e484eae9a83b434a48896/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:41.816938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.819477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.835497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b059fc7270c4c7c857733dc9c7c5b1f', 'request_id': 'req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:41.848870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] The token cache is being invalidate because project 5b059fc7270c4c7c857733dc9c7c5b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:41.849393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:41.850158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:41.856732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3288/6616] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:41 2022] DELETE /identity/v3/projects/5b059fc7270c4c7c857733dc9c7c5b1f => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:41.857878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:41.859755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.878929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789070c9-f8b2-4ef0-b1ac-3d83c92d6ac1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.957777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fa39c-71ae-4d1f-8124-312998035394 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:41.965403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.966299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.966840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.967298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.970192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:41.970944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:41.972755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:41.973106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:41.974356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:41.974789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:41.977393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:41.983834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:42.082561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:42.084391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d407cb-616f-4a81-8c87-d6b4dfd6ea2e service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:42.097462 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3329/6617] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:42.110655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e1df-8462-497a-8860-7f587e145917 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:42.110976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e1df-8462-497a-8860-7f587e145917 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:42.111249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937e1df-8462-497a-8860-7f587e145917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:42.144281 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3289/6618] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:41 2022] POST /identity/v3/projects => generated 409 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:42.148867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:42.149454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b937e1df-8462-497a-8860-7f587e145917 None None] MFA Rules not processed for user `0a0681252b8e484eae9a83b434a48896`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:42.150754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:42.152222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b937e1df-8462-497a-8860-7f587e145917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:42.301932 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3330/6619] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:42.309832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e1df-8462-497a-8860-7f587e145917 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:42.329685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078fe7f-2196-44f0-b84c-c88631b6fbe3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:42.344453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:42.345085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:42.345366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:42.346444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] PATH_INFO: `/v3/users/6ecb5583b7e6475ba0cbd26e33ced6a5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:42.347645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ecb5583b7e6475ba0cbd26e33ced6a5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:42.356429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:42.444393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937e1df-8462-497a-8860-7f587e145917 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:42.451747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:42.453160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:42.453512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:42.453850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:42.454572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:42.457255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:42.583172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3331/6620] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:42 2022] POST /identity/v3/users => generated 305 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:42.594225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:42.594225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:42.644355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658f822-7d51-48c6-8f40-a0297ef84ef7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:42.649488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ecb5583b7e6475ba0cbd26e33ced6a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:42.659143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:42.660057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:42.660531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:42.662334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:42.664907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:42.669360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfb3af-feaa-457b-8d3e-f570435f9d7d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:42.742700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ecb5583b7e6475ba0cbd26e33ced6a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:42.758307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ecb5583b7e6475ba0cbd26e33ced6a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:42.759042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ecb5583b7e6475ba0cbd26e33ced6a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:42.759659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ecb5583b7e6475ba0cbd26e33ced6a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:42.773308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3290/6621] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:42 2022] DELETE /identity/v3/users/6ecb5583b7e6475ba0cbd26e33ced6a5 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:42.774284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:42.775651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:42.878497 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3332/6622] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:42 2022] POST /identity/v3/projects => generated 395 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:42.880781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:42.882415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:42.883257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:42.908628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:42.910479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:42.928530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a9b40-4a3f-4fb2-bab6-4a94b02fbfb8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.015516 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3333/6623] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:43.016720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.018262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:43.072861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.074237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.074797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.075441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.076339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.078444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.090495 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3291/6624] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:43.095167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.109355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5e5b-1a3a-497e-b8ce-3fe32fc1d9d9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.125858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.129444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.130141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.130576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.131690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.133571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.152134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3292/6625] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:43.157270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.157370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976a863-1a97-4a5b-bba1-0d57f81a9e55 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.166898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.167631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.167982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.168360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.169088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.170559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32311bfe-7df0-4fa1-bbe5-a409be51cdf3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.171635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.176323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.177400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.177883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.178445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] PATH_INFO: `/v3/projects/7ff448019d6c4cb2bd17d8481e467562/users/3f44cc9e2d654c91978cbafd87a323bb/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.197427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff448019d6c4cb2bd17d8481e467562, user_id=3f44cc9e2d654c91978cbafd87a323bb, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.200876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.316408 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3334/6626] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:43 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:43.318291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.319892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3293/6627] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:43 2022] PUT /identity/v3/projects/7ff448019d6c4cb2bd17d8481e467562/users/3f44cc9e2d654c91978cbafd87a323bb/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:43.321733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.332616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:43.427556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52452ceb-213b-4b9e-a1de-f98a9f04fe39 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.435475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.436221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.436530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.436815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.437525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.439304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3918c-1ee8-4294-b5db-634f1ef7b9af admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.456157 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3294/6628] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:43.456157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.456157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.456157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.489106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ec09-d20c-4c1c-8b21-3e30da9eb184 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.494565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] MFA Rules not processed for user `3f44cc9e2d654c91978cbafd87a323bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:43.498032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:43.575641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.576613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.577114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.577453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.588355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3295/6629] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:43.589312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.611072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a8960-75da-4cba-ad61-121410e73802 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.627286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.627926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.628206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.628481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.629169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.631449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.648789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3296/6630] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:43.650297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.652996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:43.670955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b205d9-a358-4f11-88bf-74127444f015 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.683855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.683855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.684081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.684081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.684081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.684081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] PATH_INFO: `/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.684387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2fde523165c477bbc9af94a9ee9f6ec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.684387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.686502 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3335/6631] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:43.687260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.699384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060775c-0078-415c-ad7f-83190d3028fe service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:43.707714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:43.708344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:43.708831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:43.709151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:43.709792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:43.712480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:43.941954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3336/6632] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:43 2022] POST /identity/v3/projects => generated 409 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:43.943022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:43.960041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fde523165c477bbc9af94a9ee9f6ec', 'request_id': 'req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:43.970043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fde523165c477bbc9af94a9ee9f6ec', 'request_id': 'req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:44.062276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ccb9f-e0f5-456c-b108-04759c1c2646 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.082048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.085472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.086700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.086700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] PATH_INFO: `/v3/projects/b65e647e443e43ca86b782706b34f5b7/users/0fa37dfe56f840e29dcd8b4a4d6753b5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.113115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65e647e443e43ca86b782706b34f5b7, user_id=0fa37dfe56f840e29dcd8b4a4d6753b5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.121364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01cf5d-32f5-4d51-8089-e341f1439f10 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.131526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fde523165c477bbc9af94a9ee9f6ec', 'request_id': 'req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:44.163224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] The token cache is being invalidate because project f2fde523165c477bbc9af94a9ee9f6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:44.163526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:44.165320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:44.168816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3297/6633] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:43 2022] DELETE /identity/v3/projects/f2fde523165c477bbc9af94a9ee9f6ec => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:44.173252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.177708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.301125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3337/6634] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:43 2022] PUT /identity/v3/projects/b65e647e443e43ca86b782706b34f5b7/users/0fa37dfe56f840e29dcd8b4a4d6753b5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:44.301125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42891c-1333-499c-adc9-fe0e42285bda None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.301125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42891c-1333-499c-adc9-fe0e42285bda None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.301125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42891c-1333-499c-adc9-fe0e42285bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.364761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8b42891c-1333-499c-adc9-fe0e42285bda None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:44.370078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8b42891c-1333-499c-adc9-fe0e42285bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.569378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24d8df-2d81-4a0c-8f22-c2fb8d75a392 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.569978 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3338/6635] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:44.569978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6d19-29e9-44b1-b304-87bbab7a328d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.569978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6d19-29e9-44b1-b304-87bbab7a328d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.569978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d6d19-29e9-44b1-b304-87bbab7a328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.569978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b03d6d19-29e9-44b1-b304-87bbab7a328d None None] MFA Rules not processed for user `0fa37dfe56f840e29dcd8b4a4d6753b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:44.570327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.570421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b03d6d19-29e9-44b1-b304-87bbab7a328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.570503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.570503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.570503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.570503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.570503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.621575 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3339/6636] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:44.623288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.633793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.633793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.656216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:44.657499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.669985 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3340/6637] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:44.669985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.672650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.742926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a4ae4-c09b-4c3c-b3a9-303aebc438a6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.746908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.747522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.747796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.748455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.750324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:44.818523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.819890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.830099 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3341/6638] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:44 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:44.830937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.845138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be16a4-fd72-431c-8305-93da3d8cb79d service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.853113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.853813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.854161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.854501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.855440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:44.855814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.857519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.874874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3342/6639] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:44.877400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.900822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714476f7-cd9e-42d0-8f61-4ea98044f710 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.902077 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3298/6640] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:44 2022] POST /identity/v3/users => generated 311 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:44.902988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.907273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.910064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.910690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.911765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.912765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.913414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbd5ad-af4a-412b-b6b1-34402e4c2b18 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.916961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.919053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.919794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.920146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.920898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.921627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.923401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:44.942732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3299/6641] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:44.943760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:44.954214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed75ad6-efcb-4ef6-a1f9-2c99cb0face1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:44.959844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:44.960626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:44.961008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:44.961350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] PATH_INFO: `/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279/users/0ef734d9571b49b389e9543bab14b442/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:44.983515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abfb0e6a32c47d38a8dbcf23f051279, user_id=0ef734d9571b49b389e9543bab14b442, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:44.986776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:45.133076 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3343/6642] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:44 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:45.134101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.155620 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3300/6643] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:44 2022] PUT /identity/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279/users/0ef734d9571b49b389e9543bab14b442/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:45.158438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.323888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43cc2b-909b-4cb6-923a-2c03ad585647 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:45.324254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbf4fb-6d11-43ee-a309-3a3f4e3ac924 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:45.362071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:45.362071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.362071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.362071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.363450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:45.363450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.363450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.363450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.364066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:45.364172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:45.364260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd43b94-3a46-4593-b810-443339046bf9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:45.365613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca480-323d-499f-92d0-0808cc7bdfb9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:45.397431 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3301/6644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:53:45.400651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.400933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.401390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.431795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:45.436297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:45.498345 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3302/6645] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:45.499229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.514107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaabdf-0685-4b2c-8713-28208bc3ace6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:45.519812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:45.521032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.521439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.521815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] PATH_INFO: `/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279/users/0ef734d9571b49b389e9543bab14b442/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.525477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abfb0e6a32c47d38a8dbcf23f051279, user_id=0ef734d9571b49b389e9543bab14b442, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:45.537365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:45.555417 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3303/6646] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:45 2022] PUT /identity/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279/users/0ef734d9571b49b389e9543bab14b442/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:45.556385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.559005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:45.663294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dbfd2-c209-404c-8e27-0a8debbce7dd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:45.668512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:45.670911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.670911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.670911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.674552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:45.689255 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3344/6647] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:45 2022] POST /identity/v3/users => generated 292 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:45.690419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.690704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.690976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.753041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] MFA Rules not processed for user `0ef734d9571b49b389e9543bab14b442`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:45.757607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:45.841194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:45.842843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:45.858731 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3304/6648] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:45.859676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.944220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3345/6649] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:45 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:45.958495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:45.960360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:45.985685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d53ded-8eee-4498-96c8-ded08d6a499b service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:45.993816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:45.994950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:45.995413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:45.995899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:45.996788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.000191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.019626 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3305/6650] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:46.022455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.044037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28972e3e-3583-448a-a7ed-8c08482c54dd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.055965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.057137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.057602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.058642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.059491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.082530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.120919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f81c6-a171-4fa1-9453-e74b3053b254 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.130592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.131374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.131813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.132184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.137745 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3306/6651] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:46.139053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.155673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.158446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a43fe1-d992-451c-9c4e-ea974c9b20aa service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.173903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7768254-13e6-4e15-845c-23cb2d9136e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.185210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3346/6652] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:46.185799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.186930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.187376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.187662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] PATH_INFO: `/v3/projects/04b83725669342508fa2c92a958621f2/users/d3c91e835d3d46978812ddefd5bd1c05/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.211509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b83725669342508fa2c92a958621f2, user_id=d3c91e835d3d46978812ddefd5bd1c05, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.214729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.312033 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3307/6653] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:46 2022] PUT /identity/v3/projects/04b83725669342508fa2c92a958621f2/users/d3c91e835d3d46978812ddefd5bd1c05/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:46.326621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.326621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.326621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.368609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] MFA Rules not processed for user `d3c91e835d3d46978812ddefd5bd1c05`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:46.372701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:46.401156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:46.481546 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3347/6654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:46.486453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.573377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8ef5-6518-443d-ba03-af33334bda7e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.578443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.579048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.579322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.579603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.580236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.582380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.697308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.699267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:46.719249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a3c5a-aeff-432c-b8b0-711bee86cacd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.731720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.733215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.733215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.733454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] PATH_INFO: `/v3/users/0a0681252b8e484eae9a83b434a48896` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.734816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0681252b8e484eae9a83b434a48896)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.735834 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3308/6655] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:46 2022] POST /identity/v3/projects => generated 383 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:46.741849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.743674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.870435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7fe50-1fd1-4506-82f4-feade7a4838c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:46.878568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:46.878568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:46.879231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:46.880277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:46.881821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:46.891492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:46.981389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3309/6656] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:46 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:46.982599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:46.984903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.035017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0681252b8e484eae9a83b434a48896'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:47.077889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf24501-1d78-44a7-92eb-03fdc3f1e551 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:47.083546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:47.084210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.084603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.084796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.087821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.167216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:47.168559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:47.180650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3310/6657] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:46 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:47.200928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:47.200928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a97af4-29e0-494b-9f36-fce6db62e93d service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:47.203604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:47.204477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.204720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.204970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.205630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:47.207416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970d0f2-b6a0-483f-a010-0e466d898ec9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:47.220188 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3311/6658] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:47.221573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea045b-655d-417a-ac1f-7f82ba249565 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.222692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea045b-655d-417a-ac1f-7f82ba249565 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.222692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea045b-655d-417a-ac1f-7f82ba249565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.228792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0681252b8e484eae9a83b434a48896'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:47.256262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0681252b8e484eae9a83b434a48896'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:47.266325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0681252b8e484eae9a83b434a48896'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:47.268816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0681252b8e484eae9a83b434a48896'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:47.274780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7aea045b-655d-417a-ac1f-7f82ba249565 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:47.276185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7aea045b-655d-417a-ac1f-7f82ba249565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.285461 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3348/6659] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:46 2022] DELETE /identity/v3/users/0a0681252b8e484eae9a83b434a48896 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:47.290241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:47.291596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.382725 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3312/6660] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:47.385002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.385413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.385682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.425531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:47.429173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.521101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc868f1d-010b-487d-b937-a45173c3ae3b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:47.535456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:47.541179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.541179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.541179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] PATH_INFO: `/v3/projects/15e494289a324de09042dbd29c3a6464/users/7eeaf35bb9694377ae00a836cadb0760/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.560583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e494289a324de09042dbd29c3a6464, user_id=7eeaf35bb9694377ae00a836cadb0760, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:47.567005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:47.572006 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3313/6661] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:47.580895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:47.580895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.681702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bbd8a-0f91-463f-bb38-e66526c8b2ae None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:47.690717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:47.691340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:47.691673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:47.691953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:47.775803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:47.777916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:47.793888 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3314/6662] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:47.795062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:47.797631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:47.840431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3349/6663] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:47 2022] PUT /identity/v3/projects/15e494289a324de09042dbd29c3a6464/users/7eeaf35bb9694377ae00a836cadb0760/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:47.845199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:47.971511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f274722-2573-4bd5-a550-397f2874a982 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.017337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232468b-1c8b-45aa-82fe-3b44338a3798 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.053616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.057945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.061455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.061898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.063775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:48.076438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:48.101763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.102671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.103144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.103577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.126734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:48.129329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:48.130484 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3350/6664] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:48.134345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:48.140329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:48.161460 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3315/6665] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:48.162383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:48.184723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b36c5-9596-4971-8bb4-68a029f0ef27 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.210607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.211309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.211672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.211876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] PATH_INFO: `/v3/projects/15e494289a324de09042dbd29c3a6464/users/7eeaf35bb9694377ae00a836cadb0760/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.216782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e494289a324de09042dbd29c3a6464, user_id=7eeaf35bb9694377ae00a836cadb0760, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:48.219413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b6a99-5572-468e-84bf-13bd263b1f91 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:48.258296 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3316/6666] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:48 2022] PUT /identity/v3/projects/15e494289a324de09042dbd29c3a6464/users/7eeaf35bb9694377ae00a836cadb0760/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:48.262402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.262833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.263269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.267736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62548a62-84ca-41d5-9c08-06200398119f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.312732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] MFA Rules not processed for user `7eeaf35bb9694377ae00a836cadb0760`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:48.319344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:48.403486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.404433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.404739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.405055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.407879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:48.431309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:48.445268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:48.445405 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3317/6667] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:48.454506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:48.456450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:48.483942 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3351/6668] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:48.614962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c9fdc-728d-4c13-aade-c55c5d7338fa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.627193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.628081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.628464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.628921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.653092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:48.654769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995e9c-8dc7-47e4-9a18-f20f2d5671ef service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:48.677815 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3318/6669] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:53:48.917922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:48.952593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c9ecd-7bcf-4bdc-a158-5f3e3884f115 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:48.972589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:48.973828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:48.974306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:48.974725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:48.976813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:49.073900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:49.075596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:49.088895 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3352/6670] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:49.221172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:49.221762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:49.222106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:49.262521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:49.269372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:49.273225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:49.429360 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3319/6671] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:49.444403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:49.625076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa988d0a-8f23-4863-aa21-1d266aea14c6 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:49.634829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:49.634829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:49.634829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:49.634829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:49.646279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:49.649485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:49.664821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:49.691041 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3353/6672] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:50.548730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:50.550790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:50.717140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bb0a0-6997-420d-a862-bce81968e5ba None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:50.731911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:50.732878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:50.737432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:50.737432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] PATH_INFO: `/v3/projects/6c6332695ad1466688e0e25550f37c84` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:50.740508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c6332695ad1466688e0e25550f37c84)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:50.743316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:50.955985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c6332695ad1466688e0e25550f37c84', 'request_id': 'req-4f7749ae-99f7-4d81-b35f-9a80d0484824'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:50.971429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c6332695ad1466688e0e25550f37c84', 'request_id': 'req-4f7749ae-99f7-4d81-b35f-9a80d0484824'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.094959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c6332695ad1466688e0e25550f37c84', 'request_id': 'req-4f7749ae-99f7-4d81-b35f-9a80d0484824'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.118755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] The token cache is being invalidate because project 6c6332695ad1466688e0e25550f37c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:51.119189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.120901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f7749ae-99f7-4d81-b35f-9a80d0484824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.154659 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3320/6673] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:50 2022] DELETE /identity/v3/projects/6c6332695ad1466688e0e25550f37c84 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:51.159328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:51.199582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719c05-1e4c-4431-bf2f-1d9bc68bebb5 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:51.237158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:51.237949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:51.238650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:51.334421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:51.338711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:51.456978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:51.458648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:51.461135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:51.462457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] PATH_INFO: `/v3/users/0fa37dfe56f840e29dcd8b4a4d6753b5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:51.466087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fa37dfe56f840e29dcd8b4a4d6753b5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:51.477396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:51.482605 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3321/6674] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:51.501161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:51.502640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:51.550551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:51.701044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78dd02-67be-4547-89f1-c29bbc321aaa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:51.728453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:51.729525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:51.730029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:51.731357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:51.752162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:51.756713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:51.779052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3322/6675] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:53:51.810048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fa37dfe56f840e29dcd8b4a4d6753b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.936671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fa37dfe56f840e29dcd8b4a4d6753b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.976298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fa37dfe56f840e29dcd8b4a4d6753b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.989757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fa37dfe56f840e29dcd8b4a4d6753b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:51.990720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-277f1b76-0260-489b-953f-2d69fd01d43c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fa37dfe56f840e29dcd8b4a4d6753b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:52.005881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3354/6676] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:51 2022] DELETE /identity/v3/users/0fa37dfe56f840e29dcd8b4a4d6753b5 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.125210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:53.143667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.145978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.189664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.189985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.190399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9936f-71d2-409b-b062-4b80a448971d service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.190674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.233484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:53.241462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.323189 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3355/6677] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:53.340179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:53.342081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:53.387938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.389034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.389610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.390102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] PATH_INFO: `/v3/projects/b65e647e443e43ca86b782706b34f5b7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.392601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65e647e443e43ca86b782706b34f5b7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.396884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.573162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9b1ee-65e6-4c88-8733-666ce75edbd2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:53.634485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:53.635931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.639851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.640183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.663515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65e647e443e43ca86b782706b34f5b7', 'request_id': 'req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.689988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:53.692166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710b9a0-b782-4363-9774-0ecdc1a9bfb2 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:53.701053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65e647e443e43ca86b782706b34f5b7', 'request_id': 'req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.793848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3356/6678] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:53:53.863909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65e647e443e43ca86b782706b34f5b7', 'request_id': 'req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.900829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] The token cache is being invalidate because project b65e647e443e43ca86b782706b34f5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:53.901179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.901919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-db00c055-3c9e-4525-a8f0-d7a298d1e5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:53.908024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3323/6679] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:53 2022] DELETE /identity/v3/projects/b65e647e443e43ca86b782706b34f5b7 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:53.910450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:53.910963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:53.911601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:53.967098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:53.968582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.155839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3357/6680] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:54.160578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.161358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.161552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.193144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:54.195758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:54.216640 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3324/6681] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:54.220725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.235894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae37f-2963-4b59-ada3-61bb4994855d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.249891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.250897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.251302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.251691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.252844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:54.254044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.256382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.302291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.309126 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3358/6682] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:54.327361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce4052-374b-437d-8970-78ce360fdea0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.332590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.333221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.333504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.333776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.334454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.336536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.497691 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3325/6683] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:54.498320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.537900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5f2f2-2458-49a7-96e3-b65ac5b39e26 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.670836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.671735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.672206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.672917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.673709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.677879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.807413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.820385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3359/6684] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:54 2022] POST /identity/v3/users => generated 306 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:53:54.823952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1174a-374f-4e40-bae7-cd10518b655c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.831695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.833457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.834365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.836481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.837322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.843441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:54.880922 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3326/6685] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:54.885577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:54.908573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675719fa-ab0b-4a9e-940a-25af4193237d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:54.924415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:54.925211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:54.925557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:54.926969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] PATH_INFO: `/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b/users/652b2f3d78b6425ab17a5449944ba285/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:54.985661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd17e46e19e24e3baa1d1ecc4125b81b, user_id=652b2f3d78b6425ab17a5449944ba285, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:54.996857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.159111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3360/6686] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:54 2022] PUT /identity/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b/users/652b2f3d78b6425ab17a5449944ba285/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:55.162932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.179758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54249137-1b2c-43e9-bea3-696bae50c80b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.357464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.358386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.358935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.359362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.360169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.362583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166929b-3423-4e92-ac2c-de7c824ab803 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.380733 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3327/6687] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:55.384954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.400975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2e40-e824-4eb9-82d9-31b0168d42d5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.414420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.418067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.418467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.421823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] PATH_INFO: `/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b/users/652b2f3d78b6425ab17a5449944ba285/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.427865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd17e46e19e24e3baa1d1ecc4125b81b, user_id=652b2f3d78b6425ab17a5449944ba285, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.445982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:55.466323 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3361/6688] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:55 2022] PUT /identity/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b/users/652b2f3d78b6425ab17a5449944ba285/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:55.478576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.478860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.479328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.528181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] MFA Rules not processed for user `652b2f3d78b6425ab17a5449944ba285`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:55.529559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:55.590214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:55.593398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.595138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:55.826033 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3328/6689] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:55.827293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:55.882228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5f32-47b6-49aa-9ba0-af7a69fc361b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:55.918962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:55.925782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:55.925782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:55.925782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] PATH_INFO: `/v3/users/6f74ffe9261d401f843a9e6486000eff` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:55.929840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f74ffe9261d401f843a9e6486000eff)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:55.934067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:56.085369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717dfd-4f07-4355-a0c6-7ccb0e9aaa44 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:56.105252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:56.107377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:56.115358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:56.115358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:56.115358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:56.121621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:56.331232 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3329/6690] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:55 2022] POST /identity/v3/projects => generated 397 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:56.339799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:56.390116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f74ffe9261d401f843a9e6486000eff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:56.503488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f74ffe9261d401f843a9e6486000eff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:56.553806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2209f-b114-46b8-8dd0-af50348d131a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:56.556324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f74ffe9261d401f843a9e6486000eff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:56.563862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:56.565301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:56.565840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:56.566379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:56.567716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:56.572857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c64b7-984c-45c5-965e-9def85d3087b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:56.614400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f74ffe9261d401f843a9e6486000eff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:56.620632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6b5888fa-4334-4652-a0fb-badb2345ef08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f74ffe9261d401f843a9e6486000eff'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:56.646368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3362/6691] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:55 2022] DELETE /identity/v3/users/6f74ffe9261d401f843a9e6486000eff => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:56.647877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:56.649424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:56.649424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:56.731329 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3330/6692] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:56 2022] POST /identity/v3/users => generated 299 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:56.731329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:56.731329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:56.731329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:56.749575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:56.750892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:56.795122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:56.800469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:56.910400 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3363/6693] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:56.911697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:56.913381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:56.998266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:57.041166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a047400-80c0-4346-8263-a81d5916d03d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:57.045455 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3331/6694] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:57.046465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:57.047359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:57.047999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.052417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.052770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.055120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:57.057626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:57.059941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:57.081499 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3364/6695] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:57.085650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:57.120994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90c7ed-2b69-430a-b9ee-85d303289afa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:57.137418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:57.138054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.138336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.138614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.139263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:57.140978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:57.188433 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3365/6696] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:53:57.194493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:57.195113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:57.297398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586cffc-4851-4551-ab40-bbb405dbd0b0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:57.318876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:57.319520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.319811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.320182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.342695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:57.349792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:57.364425 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3332/6697] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:53:57.365266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d85b5b-be26-43df-9c64-1710edcfed01 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:57.366561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:57.381029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:57.381675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.381956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.382233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.386474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd76e36-3c87-4a91-8059-ea375f344ab8 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:57.398872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:57.400853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.403057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.403743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] PATH_INFO: `/v3/projects/59b7f62b316c48698934c1f557e6b15c/users/9a6ced30a837436c860644b95748e988/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.409805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:57.416937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea72d0-c71b-4abe-9ece-b2b2e815fdb5 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:57.444163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3366/6698] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:57.445937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b7f62b316c48698934c1f557e6b15c, user_id=9a6ced30a837436c860644b95748e988, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:57.449053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:57.574250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3333/6699] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:53:57 2022] PUT /identity/v3/projects/59b7f62b316c48698934c1f557e6b15c/users/9a6ced30a837436c860644b95748e988/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:53:57.585390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:57.585928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:57.586903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:57.654541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] MFA Rules not processed for user `9a6ced30a837436c860644b95748e988`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:57.661085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:57.841170 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3367/6700] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:57.858601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:57.860896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:57.895191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:53:58.025052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae082a97-ca4e-4f1e-9e63-75a19fde0850 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:58.030571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:58.031413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.031755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.032102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.038573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:58.090824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:58.095277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:58.222249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:58.223849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed1412-154e-44f6-95a8-9a81f5fb0576 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:58.256788 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3334/6701] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:53:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:53:58.258425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.259607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.261474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.309025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:58.311494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:58.325059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a685ff-f1e6-485c-b8f6-3ba5d5a28b93 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:58.338954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:58.339686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.339978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.340244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] PATH_INFO: `/v3/projects/2d7834e545604dfcab709c3662801725` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.341921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7834e545604dfcab709c3662801725)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:58.343607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:58.499951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3335/6702] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:58.511194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:58.651296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7834e545604dfcab709c3662801725', 'request_id': 'req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:58.666485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7834e545604dfcab709c3662801725', 'request_id': 'req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:58.679807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7834e545604dfcab709c3662801725', 'request_id': 'req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:58.709851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ff52c-d8e0-4dfb-9d00-4455cd6ae60d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:58.786117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] The token cache is being invalidate because project 2d7834e545604dfcab709c3662801725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:53:58.786117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:58.786684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2eaa5ab8-c776-44ff-96f8-b1a09ed8e7a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:53:58.789795 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3368/6703] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:53:58 2022] DELETE /identity/v3/projects/2d7834e545604dfcab709c3662801725 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:53:58.795050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8029a-2b44-4e41-ad28-b2058955443d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.795516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8029a-2b44-4e41-ad28-b2058955443d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.795792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8029a-2b44-4e41-ad28-b2058955443d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.841348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-33b8029a-2b44-4e41-ad28-b2058955443d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:58.842836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-33b8029a-2b44-4e41-ad28-b2058955443d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:58.873447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:58.874186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:58.874530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:58.874808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:58.893366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:59.044095 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3369/6704] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:53:59.054091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:59.054990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:59.055554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:59.109380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:53:59.110039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:59.111790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:59.113465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:59.133618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3370/6705] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:53:59.135481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3336/6706] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:53:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:53:59.138398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:59.158184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75226868-94b0-4563-879c-93b5cfa0f1e9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:59.172767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:59.176922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:59.177273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:59.181090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:59.181090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:53:59.181090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:59.181754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:59.210728 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3371/6707] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:53:59.214624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:59.234002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ffe97-9525-404d-a211-589b7da0ff51 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:59.263482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:59.264122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:59.265675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:59.265964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:59.268125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:59.273894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:59.518796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:59.526168 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3337/6708] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:53:59 2022] POST /identity/v3/projects => generated 353 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:59.531239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbfa6d-f400-4cda-9375-cb15bb4a6bcd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:59.765613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:59.766584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:59.766869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:59.767287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:59.769385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:59.773260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:53:59.941102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:53:59.943480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:53:59.967610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee50fbe-a195-46c3-8991-89eda14cb444 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:53:59.980890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:53:59.981666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:53:59.982387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3372/6709] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:53:59 2022] POST /identity/v3/users => generated 277 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:53:59.985001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:53:59.985366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] PATH_INFO: `/v3/users/652b2f3d78b6425ab17a5449944ba285` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:53:59.988653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=652b2f3d78b6425ab17a5449944ba285)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:53:59.993223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:00.002393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:00.027253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256be2da-3ef7-47eb-9894-a93ffee284cf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:00.052037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:00.053213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:00.056982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:00.057476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:00.058400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:00.063746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fa1f-9fbc-4fda-b438-1b8facb41246 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:00.068005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:00.117695 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3373/6710] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:00.120912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:00.121403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:00.123211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:00.172131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:00.177754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:00.341023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652b2f3d78b6425ab17a5449944ba285'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:00.385560 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3374/6711] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:00.386603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:00.390301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:00.458773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f2042-c9ea-4d18-8c09-c6ce95c247b5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:00.465832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:00.466644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:00.466932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:00.467350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] PATH_INFO: `/v3/users/d3c91e835d3d46978812ddefd5bd1c05` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:00.469228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c91e835d3d46978812ddefd5bd1c05)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:00.471601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:00.495447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652b2f3d78b6425ab17a5449944ba285'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:00.524933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652b2f3d78b6425ab17a5449944ba285'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:00.526277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652b2f3d78b6425ab17a5449944ba285'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:00.527868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652b2f3d78b6425ab17a5449944ba285'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:00.567473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3338/6712] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:53:59 2022] DELETE /identity/v3/users/652b2f3d78b6425ab17a5449944ba285 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:00.591283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:00.595657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:00.764687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a8535-ae32-4530-9830-0cbeaf28e609 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:00.767972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:00.781151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:00.785886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:00.787379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:00.787730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:00.788502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:00.793236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:00.817959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3339/6713] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:00.822792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:00.822792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:00.874622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c91e835d3d46978812ddefd5bd1c05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:01.005252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c91e835d3d46978812ddefd5bd1c05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:01.026569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c32795-d9d1-42f0-9bf1-16f0f16f34ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:01.032385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c91e835d3d46978812ddefd5bd1c05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:01.033226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:01.033978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.034366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.035981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:01.037617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:01.062531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c91e835d3d46978812ddefd5bd1c05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:01.064370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-153078af-499b-4ffd-858e-41ef42ced5ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c91e835d3d46978812ddefd5bd1c05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:01.087507 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3375/6714] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:00 2022] DELETE /identity/v3/users/d3c91e835d3d46978812ddefd5bd1c05 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:01.091022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec1c5-8efe-4b12-9e77-90a8da23c0a0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.091435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec1c5-8efe-4b12-9e77-90a8da23c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.091828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bec1c5-8efe-4b12-9e77-90a8da23c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:01.141944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-25bec1c5-8efe-4b12-9e77-90a8da23c0a0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:01.147028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-25bec1c5-8efe-4b12-9e77-90a8da23c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:01.260351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:01.265910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:01.279418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3340/6715] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:54:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:01.286846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:01.302684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5f34e-59bc-428f-865f-1eae6e896858 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:01.385435 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3376/6716] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:01.387385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.387677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.387956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:01.420665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:01.422185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:01.435117 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3377/6717] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:01.437010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:01.438989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:01.452345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:01.454230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.455911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.456367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] PATH_INFO: `/v3/projects/761364b811194a01b444e3a9816111f7/users/1d2cabf7a2444134bf60bf76034c034b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:01.485290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761364b811194a01b444e3a9816111f7, user_id=1d2cabf7a2444134bf60bf76034c034b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:01.489469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:01.632958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1427338-cef0-4b13-9f94-25e8923096da None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:01.654683 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3341/6718] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:01 2022] PUT /identity/v3/projects/761364b811194a01b444e3a9816111f7/users/1d2cabf7a2444134bf60bf76034c034b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:01.655908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:01.818219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:01.819054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.819341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.819763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:01.873973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa535266-8071-4ec8-b28c-0275e19c5ce2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:01.898260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:01.898632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:01.898917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:01.899191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:02.038352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:02.042811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033966b7-7b8a-4115-80e9-aecaa69641e7 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:02.102565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3378/6719] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:02.103898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:02.104183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:02.104457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:02.158404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:02.174608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:02.183322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058bf79-4769-4105-b86e-f35666f71f3b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:02.220736 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3342/6720] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:02.222866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:02.223151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:02.223430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:02.255981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] MFA Rules not processed for user `1d2cabf7a2444134bf60bf76034c034b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:02.261123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:02.303843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:02.308598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:02.427452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3379/6721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:02.438796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:02.440243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:02.475991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb886ac1-cbb4-4c51-844e-612b95a47e73 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:02.484929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:02.485565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:02.485897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:02.486169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:02.505047 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3343/6722] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:54:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:02.521786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:02.525807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4970f-554f-4145-a2b8-97468162bf10 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:02.531847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:02.540591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:02.579274 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3380/6723] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:02.713777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b1a1b6-83c7-4b68-a3fa-d14f2a3711bc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:02.722586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:02.723818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:02.724131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:02.724466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:02.740774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:02.743299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:02.756007 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3344/6724] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:54:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:03.439109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:03.453208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:03.454157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:03.454453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:03.483243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:03.484792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:03.498807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3381/6725] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:54:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:03.513415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:03.531812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68e3af-0143-4bad-aa0d-8bfe0212c837 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:03.539761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:03.540403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:03.540907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:03.541185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:03.556706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:03.559524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:03.573925 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3345/6726] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:04.383775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:04.386475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:04.393642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:04.407990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cfdaa-b911-4cb4-ba28-f30c7ae2c701 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:04.419253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:04.420407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:04.420952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:04.421480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] PATH_INFO: `/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:04.427002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd17e46e19e24e3baa1d1ecc4125b81b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:04.430160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:04.513337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:04.515711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:04.568254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7a7fb-b5ba-4cb8-a540-a5ab8e409634 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:04.597471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:04.598158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:04.598422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:04.600420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] PATH_INFO: `/v3/projects/04b83725669342508fa2c92a958621f2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:04.603084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b83725669342508fa2c92a958621f2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:04.606803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:04.743352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd17e46e19e24e3baa1d1ecc4125b81b', 'request_id': 'req-cdd11286-5cfc-4609-8955-87e414dff955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.758256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd17e46e19e24e3baa1d1ecc4125b81b', 'request_id': 'req-cdd11286-5cfc-4609-8955-87e414dff955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.780268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd17e46e19e24e3baa1d1ecc4125b81b', 'request_id': 'req-cdd11286-5cfc-4609-8955-87e414dff955'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.877315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b83725669342508fa2c92a958621f2', 'request_id': 'req-803d2f8c-dab7-44a5-b414-541300953e71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.890907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] The token cache is being invalidate because project dd17e46e19e24e3baa1d1ecc4125b81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:04.894442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.894442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cdd11286-5cfc-4609-8955-87e414dff955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.895457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b83725669342508fa2c92a958621f2', 'request_id': 'req-803d2f8c-dab7-44a5-b414-541300953e71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:04.897007 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3382/6727] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:04 2022] DELETE /identity/v3/projects/dd17e46e19e24e3baa1d1ecc4125b81b => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:04.902428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:04.903968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:04.904458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:04.970057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:04.974065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:04.986657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b83725669342508fa2c92a958621f2', 'request_id': 'req-803d2f8c-dab7-44a5-b414-541300953e71'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.011960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] The token cache is being invalidate because project 04b83725669342508fa2c92a958621f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:05.012252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.015300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.019680 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3346/6728] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:04 2022] DELETE /identity/v3/projects/04b83725669342508fa2c92a958621f2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:05.026354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:05.028128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:05.067654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3383/6729] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 12:54:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:05.068767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:05.071701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:05.171365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff3114-3938-40af-ad71-4c601a7f139b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:05.171540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2f8c-dab7-44a5-b414-541300953e71 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:05.179751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:05.180675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:05.181059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:05.181429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] PATH_INFO: `/v3/users/7eeaf35bb9694377ae00a836cadb0760` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:05.182725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eeaf35bb9694377ae00a836cadb0760)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:05.184407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:05.186265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:05.196856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:05.196856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:05.203201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] PATH_INFO: `/v3/users/9a6ced30a837436c860644b95748e988` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:05.206162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6ced30a837436c860644b95748e988)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:05.210289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:05.460423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eeaf35bb9694377ae00a836cadb0760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.529024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6ced30a837436c860644b95748e988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.579302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eeaf35bb9694377ae00a836cadb0760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.626658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eeaf35bb9694377ae00a836cadb0760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.649872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eeaf35bb9694377ae00a836cadb0760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.653217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eeaf35bb9694377ae00a836cadb0760'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.668343 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3384/6730] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:05 2022] DELETE /identity/v3/users/7eeaf35bb9694377ae00a836cadb0760 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:05.674058 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:05.676819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:05.711396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6ced30a837436c860644b95748e988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.735037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6ced30a837436c860644b95748e988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.735790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6ced30a837436c860644b95748e988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.736418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6ced30a837436c860644b95748e988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:05.767702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3347/6731] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:05 2022] DELETE /identity/v3/users/9a6ced30a837436c860644b95748e988 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:05.828985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feffa1d-f9e9-45d3-b915-7f0a60d9a13d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:05.936438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:05.937536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:05.938032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:05.938514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:05.941147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:06.063985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:06.070364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:06.092975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3385/6732] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:06.156044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:06.536816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:06.947328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:06.949020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:07.054065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507075-21f2-47ff-b458-fa2181d7dda3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:07.060117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:07.061436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:07.061901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:07.062334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] PATH_INFO: `/v3/users/d08361c8a21041fba5ee30ec490adab4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:07.064044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08361c8a21041fba5ee30ec490adab4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:07.066396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:07.558312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08361c8a21041fba5ee30ec490adab4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.660193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:07.662620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:07.678056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53ede4-3327-4c0f-a73f-2ddc21b10da6 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:07.683786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:07.684779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:07.685674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:07.686221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] PATH_INFO: `/v3/projects/15e494289a324de09042dbd29c3a6464` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:07.687797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e494289a324de09042dbd29c3a6464)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:07.690182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:07.850601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08361c8a21041fba5ee30ec490adab4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.869610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08361c8a21041fba5ee30ec490adab4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.870537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08361c8a21041fba5ee30ec490adab4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.871716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-33344b02-085d-433f-a70f-083078cbacf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08361c8a21041fba5ee30ec490adab4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.915759 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3348/6733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:06 2022] DELETE /identity/v3/users/d08361c8a21041fba5ee30ec490adab4 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:07.920284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:07.920996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:07.921515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:07.941855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e494289a324de09042dbd29c3a6464', 'request_id': 'req-d0718431-68b5-4845-98ba-a81f744d8a24'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.964840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e494289a324de09042dbd29c3a6464', 'request_id': 'req-d0718431-68b5-4845-98ba-a81f744d8a24'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.979728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:07.979945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e494289a324de09042dbd29c3a6464', 'request_id': 'req-d0718431-68b5-4845-98ba-a81f744d8a24'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:07.984238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.126231 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3349/6734] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:08.127499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.130028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.147119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] The token cache is being invalidate because project 15e494289a324de09042dbd29c3a6464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:08.151342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.151342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.156578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3386/6735] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:07 2022] DELETE /identity/v3/projects/15e494289a324de09042dbd29c3a6464 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:08.157760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.161401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.164585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243e57d-f0e6-4dac-ab6a-714d955de0ab None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.181515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.182269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.182636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.183665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] PATH_INFO: `/v3/projects/59b7f62b316c48698934c1f557e6b15c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.185855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b7f62b316c48698934c1f557e6b15c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:08.191884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:08.299924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0718431-68b5-4845-98ba-a81f744d8a24 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.386133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b7f62b316c48698934c1f557e6b15c', 'request_id': 'req-7f91a831-0e35-4377-906c-3bd3aa81eeab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.403782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b7f62b316c48698934c1f557e6b15c', 'request_id': 'req-7f91a831-0e35-4377-906c-3bd3aa81eeab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.405843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.406485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.406765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.407039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.411061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.446201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:08.460503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb9c4-893a-4abc-af42-1bd5d4e1ed5f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:08.495524 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3387/6736] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:08.499963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ca06-77e7-485a-bfd4-f0241c0faef4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.500278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ca06-77e7-485a-bfd4-f0241c0faef4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.500655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82ca06-77e7-485a-bfd4-f0241c0faef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.575074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3f82ca06-77e7-485a-bfd4-f0241c0faef4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:08.579137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f82ca06-77e7-485a-bfd4-f0241c0faef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.580548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b7f62b316c48698934c1f557e6b15c', 'request_id': 'req-7f91a831-0e35-4377-906c-3bd3aa81eeab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.601206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] The token cache is being invalidate because project 59b7f62b316c48698934c1f557e6b15c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:08.601803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.604008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7f91a831-0e35-4377-906c-3bd3aa81eeab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:08.611372 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3350/6737] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:08 2022] DELETE /identity/v3/projects/59b7f62b316c48698934c1f557e6b15c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:08.614257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a43cd-15e9-4832-b759-c7064dfb2b8a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.616234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a43cd-15e9-4832-b759-c7064dfb2b8a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.616742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a43cd-15e9-4832-b759-c7064dfb2b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.668006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6f0a43cd-15e9-4832-b759-c7064dfb2b8a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:08.671659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f0a43cd-15e9-4832-b759-c7064dfb2b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.767790 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3388/6738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:08.769751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.770090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.771033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.812970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:08.814238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.829259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3351/6739] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:08.838068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.838594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.839059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.842622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3389/6740] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:08.846344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.872467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc52dc1-539d-40be-8d40-6ac4fe68b77b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.883882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:08.885406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.886145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.886443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.886780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.887441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:08.887706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:08.891858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:08.893813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:08.912466 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3352/6741] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:08.913593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.926781 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3390/6742] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:08.928005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.934903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11b8b-f641-4315-ac4f-b4477df21763 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.946847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.947526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.948027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.948149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.948862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:08.949263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:08.950973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:08.953480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32866c-7626-43ff-9e22-41d2328e7de1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.966020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.966732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.967021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.967293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.968818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:08.970955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:08.974599 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3353/6743] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:08.979182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:08.991058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae71b5-3231-4da3-9fd2-cae09379e096 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:08.996295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:08.997010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:08.997289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:08.997566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:08.998218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:09.000634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:09.199624 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3391/6744] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:09.200995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:09.271262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3354/6745] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:08 2022] POST /identity/v3/projects => generated 365 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:09.275762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:09.404712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db67cb-c72b-413f-9805-1ceae9565d74 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:09.439707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991bdd6-e081-4f39-9ede-dd2cfae3531f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:09.447949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:09.448707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:09.448997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:09.449275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:09.449942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:09.452060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:09.614205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:09.617818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:09.618355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:09.623040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:09.623750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:09.625833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:09.734101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3355/6746] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:09 2022] POST /identity/v3/users => generated 283 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:09.734789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:09.739510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:09.765944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6e21-2662-414e-a2bf-6f7ad8061677 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:09.785279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:09.786077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:09.786460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:09.786836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] PATH_INFO: `/v3/users/1d2cabf7a2444134bf60bf76034c034b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:09.789488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2cabf7a2444134bf60bf76034c034b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:09.790622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3392/6747] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:09 2022] POST /identity/v3/users => generated 294 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:09.792085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:09.796362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:09.856769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc1136-4033-4049-a864-6cef40a028c8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:09.890332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:09.891232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:09.891925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:09.894368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:09.896459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:09.910544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:09.945296 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3393/6748] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:09.947774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:09.982739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1edf8-8fa8-4628-94d7-7c3cd5713982 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:09.999030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:09.999669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:09.999946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.000362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.001092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.005829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:10.035411 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3394/6749] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:10.039209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:10.044107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.084189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff148-7e49-4dd4-8696-ef59cbd42e97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:10.099100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:10.102241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.102431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.102716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] PATH_INFO: `/v3/users/3f44cc9e2d654c91978cbafd87a323bb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.106326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f44cc9e2d654c91978cbafd87a323bb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.112604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:10.293910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2cabf7a2444134bf60bf76034c034b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.379645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:10.452722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2cabf7a2444134bf60bf76034c034b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.477187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2cabf7a2444134bf60bf76034c034b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.481097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2cabf7a2444134bf60bf76034c034b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.482197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2cabf7a2444134bf60bf76034c034b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.529543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3356/6750] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:09 2022] DELETE /identity/v3/users/1d2cabf7a2444134bf60bf76034c034b => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:10.532353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:10.535277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.549616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f44cc9e2d654c91978cbafd87a323bb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.661768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c6701-cc78-44cd-a292-df3b87abd822 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:10.678105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:10.681623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.681938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.682223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.683087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.683974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f44cc9e2d654c91978cbafd87a323bb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.685010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:10.699253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3357/6751] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:10.700306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:10.702305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.706861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f44cc9e2d654c91978cbafd87a323bb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.716189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f44cc9e2d654c91978cbafd87a323bb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.717085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f44cc9e2d654c91978cbafd87a323bb'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:10.725237 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3395/6752] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:10 2022] DELETE /identity/v3/users/3f44cc9e2d654c91978cbafd87a323bb => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:10.726985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684af214-bcc1-42af-99e5-be3987b708ed admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:10.729358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:10.731273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.831987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b05df-850f-43d4-b28c-eea0e72b41c1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:10.834645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:10.835868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.836729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.837147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.837911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.838929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:10.839569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.840104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.840386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] PATH_INFO: `/v3/projects/14b95955f0504596993e441d78bb5636` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.840561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7a1ae-097b-4a07-9eb1-9afdd1ba0470 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:10.842154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b95955f0504596993e441d78bb5636)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.844604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:10.858073 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3358/6753] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:10.859047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.859794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.859794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.886456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:10.888646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.903044 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3359/6754] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:10.904084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:10.906138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:10.929016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed1faf-8c5f-414f-958b-9c2fd134146c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:10.933407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:10.934981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:10.934981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:10.934981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] PATH_INFO: `/v3/projects/4173186541fb4cf0a2aa4548c70b8afa/users/0de9c35f4d6740a0ab8dd2a46f7c632a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:10.951660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4173186541fb4cf0a2aa4548c70b8afa, user_id=0de9c35f4d6740a0ab8dd2a46f7c632a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:10.953725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:10.957268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce595fc-3ec4-4205-bde8-622a7dfeef51 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:11.079551 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3360/6755] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:10 2022] PUT /identity/v3/projects/4173186541fb4cf0a2aa4548c70b8afa/users/0de9c35f4d6740a0ab8dd2a46f7c632a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:11.079551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.079551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.079551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.082567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b95955f0504596993e441d78bb5636', 'request_id': 'req-ec3db467-b7dd-4ab2-b064-c1702babba95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:11.090339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b95955f0504596993e441d78bb5636', 'request_id': 'req-ec3db467-b7dd-4ab2-b064-c1702babba95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:11.106578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b95955f0504596993e441d78bb5636', 'request_id': 'req-ec3db467-b7dd-4ab2-b064-c1702babba95'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:11.118018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:11.119285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.254968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] The token cache is being invalidate because project 14b95955f0504596993e441d78bb5636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:11.255722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:11.256984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:11.259376 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3396/6756] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:10 2022] DELETE /identity/v3/projects/14b95955f0504596993e441d78bb5636 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:11.261043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:11.262892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.280065 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3361/6757] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:11.280701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:11.285143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.310650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3db467-b7dd-4ab2-b064-c1702babba95 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:11.325269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:11.326420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.327455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.327812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] PATH_INFO: `/v3/projects/fa4adf1e6c344a1394ff522880c3f5d3/users/7f57978d661e4b379409a710b3c063e5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.359067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa4adf1e6c344a1394ff522880c3f5d3, user_id=7f57978d661e4b379409a710b3c063e5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:11.362185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2fc95-f78f-4d84-bdb8-beaed18fbf48 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:11.445710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ac6f0-7736-4fe4-a915-d57f11cc9c08 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:11.463518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:11.464191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.464473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.464772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.472267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.499888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:11.505333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c8753-26b2-4ee8-9a75-8f2bbc225b71 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:11.534196 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3397/6758] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:11 2022] PUT /identity/v3/projects/fa4adf1e6c344a1394ff522880c3f5d3/users/7f57978d661e4b379409a710b3c063e5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:11.537272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aab56-9116-4812-8142-48116273bd79 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.537272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aab56-9116-4812-8142-48116273bd79 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.537272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837aab56-9116-4812-8142-48116273bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.552086 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3362/6759] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:11.553492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19a54-695a-4cc8-a3de-a86d64c98b80 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.553775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19a54-695a-4cc8-a3de-a86d64c98b80 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.554067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec19a54-695a-4cc8-a3de-a86d64c98b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.608859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dec19a54-695a-4cc8-a3de-a86d64c98b80 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:11.610155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dec19a54-695a-4cc8-a3de-a86d64c98b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.626719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-837aab56-9116-4812-8142-48116273bd79 None None] MFA Rules not processed for user `0de9c35f4d6740a0ab8dd2a46f7c632a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:11.631105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-837aab56-9116-4812-8142-48116273bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.821753 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3398/6760] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:11.822650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aab56-9116-4812-8142-48116273bd79 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:11.849640 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3363/6761] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:11.853663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46fc2-43c5-43c5-87d2-006db63daa05 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.858092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:11.865176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46fc2-43c5-43c5-87d2-006db63daa05 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.865508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db46fc2-43c5-43c5-87d2-006db63daa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:11.939422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0db46fc2-43c5-43c5-87d2-006db63daa05 None None] MFA Rules not processed for user `7f57978d661e4b379409a710b3c063e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:11.942908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0db46fc2-43c5-43c5-87d2-006db63daa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:11.973666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837aab56-9116-4812-8142-48116273bd79 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:11.981734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:11.982779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:11.983164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:11.983548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.002226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.005991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.035021 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3399/6762] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:12.037260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.040272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.070847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3364/6763] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:12.079243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.079538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.080886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.145496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:12.146766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.173133 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3365/6764] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:12.173133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.190048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1cc87-14bc-4bfa-9899-61d36d5a2e29 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.195470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9a74-1047-407f-b66a-cdb240cee6e8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.204626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.207830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.208474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.208788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.209066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.209746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.209932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.210227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.210516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.211806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.229907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.234937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.253897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3400/6765] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:12.255581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.257301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.286340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93420c-2c51-4cbe-984c-c8d32ca78c66 service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.300616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.303632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.303918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.304201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] PATH_INFO: `/v3/projects/761364b811194a01b444e3a9816111f7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.308398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] RBAC: Authorizing `identity:delete_project(project_id=761364b811194a01b444e3a9816111f7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.315275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.362546 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3366/6766] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:12.364309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.459763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f609d6b-95bd-4fdc-8cda-62a4636e30e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.466052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.467552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.467984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.468410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.469523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:12.469992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.472884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.491442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3367/6767] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:12.492837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.517696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ade5fc-a158-48d8-b8da-a5cd4a41e1b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.550466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761364b811194a01b444e3a9816111f7', 'request_id': 'req-859f6c72-160f-4266-9c20-8cd39f53900f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:12.573800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761364b811194a01b444e3a9816111f7', 'request_id': 'req-859f6c72-160f-4266-9c20-8cd39f53900f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:12.588558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761364b811194a01b444e3a9816111f7', 'request_id': 'req-859f6c72-160f-4266-9c20-8cd39f53900f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:12.642046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.652244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.652244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.652244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.652244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.652244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdc5e5-ca2b-4be5-adf3-477d558f7caa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.745386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] The token cache is being invalidate because project 761364b811194a01b444e3a9816111f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:12.756270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:12.756270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:12.756270 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3401/6768] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:12 2022] DELETE /identity/v3/projects/761364b811194a01b444e3a9816111f7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:12.756270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.757013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.790342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f6c72-160f-4266-9c20-8cd39f53900f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.802378 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3368/6769] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/users => generated 300 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:12.802378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.802378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.802378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.803332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.804328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.804633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.804913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.805561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.807602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.843086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:12.847666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.862981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3369/6770] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:12.880376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:12.882967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:12.899377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584d177-50f3-460e-9f23-c1a7db9b245c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:12.933175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:12.934389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.934715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.934994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.935746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:12.937944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2122cfe-5815-4700-9732-e3c403669eb1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:12.954218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3370/6771] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:12.954218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:12.954218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:12.954218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:12.985959 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3402/6772] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/projects => generated 409 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:12.987486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.000380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:13.001691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:13.140869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:13.162846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f021-03a2-47e1-9ef8-29f6d23a0a81 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.170115 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3371/6773] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:13.171486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.178280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.187016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.187016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.187016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] PATH_INFO: `/v3/projects/3ca023efb346407785d2bc1fa7c20a22/users/746f1cc5e3cb4459a04aa880792abe2f/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.197313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a516-046e-44ed-9d58-3c18761b8e80 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.201609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca023efb346407785d2bc1fa7c20a22, user_id=746f1cc5e3cb4459a04aa880792abe2f, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.204389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.212702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.213388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.213669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.213943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.215380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.217432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.339668 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3403/6774] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:12 2022] PUT /identity/v3/projects/3ca023efb346407785d2bc1fa7c20a22/users/746f1cc5e3cb4459a04aa880792abe2f/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:13.342692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.345625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:13.447742 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3372/6775] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:13 2022] POST /identity/v3/users => generated 305 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:13.449638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.471587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4ac6c-98e2-408d-9e1d-f3ec628fc1aa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.477118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.478815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.479167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.480279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.485812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94c0ea-d34f-49ee-8b10-3588d2502b90 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.488798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:13.489583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.497750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.505742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.506921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.507734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.508253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] PATH_INFO: `/v3/projects/7ff448019d6c4cb2bd17d8481e467562` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.509874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff448019d6c4cb2bd17d8481e467562)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.518749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:13.542860 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3373/6776] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:13.543745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.550335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.571004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def63dd8-cd9c-478e-b5ba-0e0965aa18fb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.581931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.582602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.582962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.583167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.583985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.585612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.607058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3374/6777] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:13.607058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.613927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace82c94-4998-4a63-9494-d2e9a7f30c32 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.619593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.620239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.620577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.620845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.621491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.623111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.634967 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3375/6778] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:13.639006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.649950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda64ab8-9b6e-4cf4-b0fb-4fdcbca44cb5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.655136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.655883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.656043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.656283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.656972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.659193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.787906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff448019d6c4cb2bd17d8481e467562', 'request_id': 'req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:13.788818 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3376/6779] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:13 2022] POST /identity/v3/projects => generated 405 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:13.789906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.796583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff448019d6c4cb2bd17d8481e467562', 'request_id': 'req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:13.813715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff448019d6c4cb2bd17d8481e467562', 'request_id': 'req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:13.912741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4e09f-e671-4291-858e-d6c16e13b967 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:13.919645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:13.920396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:13.920721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:13.920997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] PATH_INFO: `/v3/projects/3ca023efb346407785d2bc1fa7c20a22/users/746f1cc5e3cb4459a04aa880792abe2f/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:13.923710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca023efb346407785d2bc1fa7c20a22, user_id=746f1cc5e3cb4459a04aa880792abe2f, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:13.928424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] The token cache is being invalidate because project 7ff448019d6c4cb2bd17d8481e467562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:13.929005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:13.931116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:13.932153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:13.933008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3404/6780] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:13 2022] DELETE /identity/v3/projects/7ff448019d6c4cb2bd17d8481e467562 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:13.934044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.938179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:13.950247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3377/6781] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:13 2022] PUT /identity/v3/projects/3ca023efb346407785d2bc1fa7c20a22/users/746f1cc5e3cb4459a04aa880792abe2f/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:13.951117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:13.954331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.078300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae04eaa-e465-4d14-9f7d-e75b4b9dcc15 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:14.085228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:14.085933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4dd052-5181-4537-a9fa-9f60e8d8dbdf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:14.086066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.086370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.087000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.087826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:14.090274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:14.093841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:14.095900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.097054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.097495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.098360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:14.101405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:14.107365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3405/6782] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:14.109214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:14.111681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.131846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d760dfd-3269-401c-aba1-963a37b03062 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:14.140397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:14.140397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.140397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.140397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] PATH_INFO: `/v3/users/0de9c35f4d6740a0ab8dd2a46f7c632a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.142660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de9c35f4d6740a0ab8dd2a46f7c632a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:14.145553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:14.222103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3378/6783] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:13 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:14.223379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:14.226693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.243378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386af5db-e8e6-464d-a646-9d991810ea84 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:14.248936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:14.249575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.249851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.250120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] PATH_INFO: `/v3/users/0ef734d9571b49b389e9543bab14b442` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.255148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef734d9571b49b389e9543bab14b442)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:14.255148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:14.496289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de9c35f4d6740a0ab8dd2a46f7c632a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.554020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef734d9571b49b389e9543bab14b442'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.592031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de9c35f4d6740a0ab8dd2a46f7c632a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.609154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de9c35f4d6740a0ab8dd2a46f7c632a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.624779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de9c35f4d6740a0ab8dd2a46f7c632a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.626754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5db6bf72-aa3a-4208-b6d2-f12f9acf01b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de9c35f4d6740a0ab8dd2a46f7c632a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.639130 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3406/6784] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:14 2022] DELETE /identity/v3/users/0de9c35f4d6740a0ab8dd2a46f7c632a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:14.640819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.641358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.641775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.679722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] MFA Rules not processed for user `746f1cc5e3cb4459a04aa880792abe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:14.681306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.689025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef734d9571b49b389e9543bab14b442'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.715059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef734d9571b49b389e9543bab14b442'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.719904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef734d9571b49b389e9543bab14b442'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.721820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef734d9571b49b389e9543bab14b442'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:14.752969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3379/6785] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:14 2022] DELETE /identity/v3/users/0ef734d9571b49b389e9543bab14b442 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:14.754980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:14.761319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.839431 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3407/6786] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:14.841652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:14.843883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:14.938926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c85a8-7dd2-4a41-b26a-1fedcfea6e6b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:14.952666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:14.954025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:14.954400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:14.955442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] PATH_INFO: `/v3/projects/93d474c8008742c39d946d5a80466162/users/52ef63a2282f4e80a9f13ace213ddc91/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:14.992895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c9a1a-93f8-4f33-b09f-2992d2421e19 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:15.008933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93d474c8008742c39d946d5a80466162, user_id=52ef63a2282f4e80a9f13ace213ddc91, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:15.009276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:15.009916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.010195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.010468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.011116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:15.013511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bad19f-82f8-4b87-bba2-143b0f57f848 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:15.016412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:15.037543 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3408/6787] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:15.039074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.039377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.039649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.064724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:15.066195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:15.075160 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3409/6788] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:15.076211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:15.082171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:15.163358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3380/6789] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:14 2022] PUT /identity/v3/projects/93d474c8008742c39d946d5a80466162/users/52ef63a2282f4e80a9f13ace213ddc91/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:15.164481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:15.247999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0c152-694e-415c-a3dd-a8862e649180 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:15.373133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bae43-223d-40ab-9364-ad67c49fcc36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:15.397918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:15.399071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.404460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.406294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.408602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:15.418901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:15.423953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:15.428433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.428977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.429400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.436128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:15.471732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3381/6790] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:15.473355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:15.492350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:15.617008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:15.618048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa30109-871c-41d5-8ae6-5981ac1ff299 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:15.645711 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3410/6791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:15.647529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.648905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.649978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.725913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] MFA Rules not processed for user `52ef63a2282f4e80a9f13ace213ddc91`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:15.729496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:15.908752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b7bf9-cbe3-4bf8-bf43-64613eaa581b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:15.920643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:15.922039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:15.937357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:15.956806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:15.976930 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3411/6792] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:15 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:15.978089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:15.998783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b17a5-06d0-447d-9a70-9cb7f1127a94 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.010695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.013093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.014028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:16.017117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.017670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.024860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] PATH_INFO: `/v3/projects/f5d1895796ac47f99a74ac65f7a6e400/users/a9966c28533f473abd36fb8381fc1b0f/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.025064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.057353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d1895796ac47f99a74ac65f7a6e400, user_id=a9966c28533f473abd36fb8381fc1b0f, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.065791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3382/6793] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:16.066907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d496c4-d8c1-4a7d-989f-86acfdbeedfd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.072935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.118537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74eb28a-28e6-404c-8e3e-829750e1695b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.133399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.133399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.133399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.133399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.134105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.135923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.181247 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3412/6794] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:15 2022] PUT /identity/v3/projects/f5d1895796ac47f99a74ac65f7a6e400/users/a9966c28533f473abd36fb8381fc1b0f/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:16.183132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.183395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.183623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.246622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:16.248237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:16.356310 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3383/6795] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:16 2022] POST /identity/v3/projects => generated 411 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:16.363475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.441709 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3413/6796] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:16.507080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.610905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb0384-f3d9-4a31-a144-6388c0b9ec64 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.623019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.624219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.624947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.625551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.626878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.632241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.681312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ebcc3-a500-44c5-92d9-edae6416e41a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.759604 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3384/6797] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:16 2022] POST /identity/v3/users => generated 312 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:16.761880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.766502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:16.781688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.783545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.783854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.786529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.804622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ce05-52b2-4eef-bfe8-8e766416a210 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.814568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.822451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.822574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.825084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.825467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.825745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] PATH_INFO: `/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.830207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abfb0e6a32c47d38a8dbcf23f051279)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.832211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.847872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3414/6798] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:16.850491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.872584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1b880-24cf-43ee-bd1c-266367751d35 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.894120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:16.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:16.901309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:16.919459 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3415/6799] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:16.938540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:16.959356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd3ab7-75b5-4565-8671-9fbcf225c88c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:16.968047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:16.969010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:16.969598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:16.969756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] PATH_INFO: `/v3/projects/2fde1d2f7f3e4d5da243efca67d47565/users/fb7e5beaa61d4a0fb3bcf9dd369b1924/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.010381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fde1d2f7f3e4d5da243efca67d47565, user_id=fb7e5beaa61d4a0fb3bcf9dd369b1924, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:17.014844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:17.034690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abfb0e6a32c47d38a8dbcf23f051279', 'request_id': 'req-754424c4-5d8a-40da-affc-55510a471683'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:17.044694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abfb0e6a32c47d38a8dbcf23f051279', 'request_id': 'req-754424c4-5d8a-40da-affc-55510a471683'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:17.128913 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3416/6800] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:16 2022] PUT /identity/v3/projects/2fde1d2f7f3e4d5da243efca67d47565/users/fb7e5beaa61d4a0fb3bcf9dd369b1924/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:17.133411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:17.179714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abfb0e6a32c47d38a8dbcf23f051279', 'request_id': 'req-754424c4-5d8a-40da-affc-55510a471683'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:17.219362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] The token cache is being invalidate because project 1abfb0e6a32c47d38a8dbcf23f051279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:17.219362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:17.219362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-754424c4-5d8a-40da-affc-55510a471683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:17.222285 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3385/6801] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:16 2022] DELETE /identity/v3/projects/1abfb0e6a32c47d38a8dbcf23f051279 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:17.228973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273e09-8a06-4131-b893-b2f983a2e878 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.237850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273e09-8a06-4131-b893-b2f983a2e878 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.238076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0273e09-8a06-4131-b893-b2f983a2e878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.303254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e0273e09-8a06-4131-b893-b2f983a2e878 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:17.309389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0273e09-8a06-4131-b893-b2f983a2e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:17.338725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675473d-d26d-405b-90c5-55b04bcf477e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:17.352216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:17.352216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.352604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.354472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.355209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:17.360018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:17.383069 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3417/6802] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:17.388109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:17.393897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:17.451168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e0ae5-141d-4479-b97f-fefb9529e4ba admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:17.459336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:17.460178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.460929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.461454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] PATH_INFO: `/v3/projects/2fde1d2f7f3e4d5da243efca67d47565/users/fb7e5beaa61d4a0fb3bcf9dd369b1924/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.464732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fde1d2f7f3e4d5da243efca67d47565, user_id=fb7e5beaa61d4a0fb3bcf9dd369b1924, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:17.468257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67731f-d106-423b-93d8-9e88a52bd58d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:17.484726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3386/6803] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:17.486249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.487086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.487369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.489736 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3418/6804] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:17 2022] PUT /identity/v3/projects/2fde1d2f7f3e4d5da243efca67d47565/users/fb7e5beaa61d4a0fb3bcf9dd369b1924/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:17.503698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.504166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.505258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.543314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:17.544633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:17.604849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] MFA Rules not processed for user `fb7e5beaa61d4a0fb3bcf9dd369b1924`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:17.606606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:17.729308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3387/6805] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:17.730443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:17.757669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f460a19-199b-4a07-a61a-f5bc2e973502 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:17.776982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:17.777987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.778432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.778801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.779720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:17.780163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:17.783217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:17.809948 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3419/6806] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:17.822479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:17.824630 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3388/6807] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:17.829587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:17.836758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:17.853798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c11034-6a6b-41dd-9f0c-c00952a436eb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:17.873673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:17.874477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.874874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.875784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:17.887763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:17.893175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:17.976000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61891cb-5cd0-44c8-a231-cf4000f27053 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:17.981635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:17.982290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:17.982543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:17.982867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.007071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.007071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.019744 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3389/6808] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:18.020731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.022514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:18.043101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15df53-59e9-406b-b883-339fab2b1c41 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.076683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.077926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.078732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.078732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] PATH_INFO: `/v3/projects/4173186541fb4cf0a2aa4548c70b8afa` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.080361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4173186541fb4cf0a2aa4548c70b8afa)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.083599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.121720 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3420/6809] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:17 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:18.125705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.241732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6dfea-6563-4aee-b814-0fae6d1f2b0e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.250910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.252049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.252560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.257019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.257019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.258492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.367550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4173186541fb4cf0a2aa4548c70b8afa', 'request_id': 'req-e744f933-e364-4520-a115-d00134757bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:18.382724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4173186541fb4cf0a2aa4548c70b8afa', 'request_id': 'req-e744f933-e364-4520-a115-d00134757bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:18.459764 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3421/6810] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:18 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:18.460653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.469842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:18.496032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a721-c671-400f-a2f9-d41d4bd1fa2f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.529413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4173186541fb4cf0a2aa4548c70b8afa', 'request_id': 'req-e744f933-e364-4520-a115-d00134757bb7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:18.552432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] The token cache is being invalidate because project 4173186541fb4cf0a2aa4548c70b8afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:18.552723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:18.553512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:18.556066 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3390/6811] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:18 2022] DELETE /identity/v3/projects/4173186541fb4cf0a2aa4548c70b8afa => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:18.558342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.561328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:18.623964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.625174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.625704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.626199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] PATH_INFO: `/v3/users/7f57978d661e4b379409a710b3c063e5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.627834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f57978d661e4b379409a710b3c063e5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.630203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.666409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f933-e364-4520-a115-d00134757bb7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.674842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.675805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.676237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.676967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.678710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.682371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482b075-0f1b-4c0d-ac63-0b32c8c4aae6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.697241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3391/6812] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:18.699389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.699848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.700521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.731735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:18.733187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:18.747269 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3392/6813] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:18.748828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.781608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9c289-4ea9-48bb-a0e6-09b355f578df None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.788824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.789811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.790242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.790580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.791447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.793187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37baca-359b-4f90-b8dc-8a38ca5be8fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:18.810673 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3393/6814] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:18.815790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.816774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.817675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.857802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:18.859515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:18.878978 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3394/6815] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:18.880278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:18.892303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcb350-b486-41f0-96dc-176618755ea5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:18.899688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:18.900408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:18.900723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:18.900997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] PATH_INFO: `/v3/projects/8103042f79b745beaed82231ddc7416f/users/1f5b4ad019ea45c2962ecaa99dde33da/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:18.931819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8103042f79b745beaed82231ddc7416f, user_id=1f5b4ad019ea45c2962ecaa99dde33da, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:18.936610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.004267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f57978d661e4b379409a710b3c063e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:19.097024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3395/6816] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:18 2022] PUT /identity/v3/projects/8103042f79b745beaed82231ddc7416f/users/1f5b4ad019ea45c2962ecaa99dde33da/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:19.098742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.119858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f57978d661e4b379409a710b3c063e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:19.146675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f57978d661e4b379409a710b3c063e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:19.165623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f57978d661e4b379409a710b3c063e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:19.171850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-af9cd209-e676-4019-9f42-09df3bcdae12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f57978d661e4b379409a710b3c063e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:19.183179 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3422/6817] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:18 2022] DELETE /identity/v3/users/7f57978d661e4b379409a710b3c063e5 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:19.188343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87941d-184a-440e-8b5d-9602b3697f18 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.189323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87941d-184a-440e-8b5d-9602b3697f18 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.190120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87941d-184a-440e-8b5d-9602b3697f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.239192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28694-bd7f-4513-a922-15f11fd212c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.264332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ec87941d-184a-440e-8b5d-9602b3697f18 None None] MFA Rules not processed for user `1f5b4ad019ea45c2962ecaa99dde33da`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:19.265998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec87941d-184a-440e-8b5d-9602b3697f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:19.398097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3423/6818] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:19.401902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.402420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.402795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.407619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.409845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.410328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.412572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.413629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:19.415490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.417832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.437507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:19.437507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:19.459109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3396/6819] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:19.460218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.461207 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3424/6820] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:19.463943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:19.467211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.477054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:19.496040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092946a-2858-4b84-88bf-1e6f61a1bd20 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.514153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe15192-28ec-4737-a9af-0b5eeb3c8032 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.514434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.515041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.515359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.515794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.516470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.520121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.547977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.548975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.555177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.556920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.561392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.577412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.643578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3397/6821] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:19.645556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.647493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:19.715528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:19.731675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ea091-98b8-4b14-8a9e-973b64133e68 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.737466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.738118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.738403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.738679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.768046 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3425/6822] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/projects => generated 361 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:19.768780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.867826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.873090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.882704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5361fb4c-2409-4baf-92f5-9e9b6729e909 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.890637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.891518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.891842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.892438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.893018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.895990 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3398/6823] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:19.896283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:19.898552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:19.916548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c65d8-c03d-4127-885f-ee8be4b3f31d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:19.925734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:19.926899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:19.930063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:19.930063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:19.930063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:19.931993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.046517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3426/6824] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/users => generated 296 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:20.051566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.071036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9f772-4c03-4067-a57d-23038b25572b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.074903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3399/6825] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:19 2022] POST /identity/v3/users => generated 281 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:20.080834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.089327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.090335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.090760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.091062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.095203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.106220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.110737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a82f9-bbcc-4120-8a68-f15d0418957d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.125155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.126372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.126372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.126372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.127635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.129355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.142249 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3427/6826] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:20.147220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.157726 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3400/6827] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:20.167049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.185525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ebe7-26a7-4468-805c-dc227e1583fb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.187286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be74d-9af0-4348-847a-ae0c90077e89 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.197080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.197846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.198226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.198564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.199522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.200864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.207723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.208418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.212208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.214347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] PATH_INFO: `/v3/projects/9d59594133b04cbea92f5705ac13ad5b/users/b7f5d7cb1d1f48b09845d56e56ff3bce/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.224690 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3401/6828] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:20.230596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.234649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:20.251606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1020a8f-dc46-480e-a4aa-42d388563303 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.262796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d59594133b04cbea92f5705ac13ad5b, user_id=b7f5d7cb1d1f48b09845d56e56ff3bce, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.267383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.269003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.269425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.269649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.270131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] PATH_INFO: `/v3/projects/3b7e804f6e3d4e44b934232478043da3/users/7d8fa38cb93e4abb9688b8c076b45e95/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.290337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7e804f6e3d4e44b934232478043da3, user_id=7d8fa38cb93e4abb9688b8c076b45e95, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.293936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca72c70-11fa-41d7-afa6-6e3129628e7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.428644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3402/6829] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:20 2022] PUT /identity/v3/projects/3b7e804f6e3d4e44b934232478043da3/users/7d8fa38cb93e4abb9688b8c076b45e95/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:20.431313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.431868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.432447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.446018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3428/6830] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:20 2022] PUT /identity/v3/projects/9d59594133b04cbea92f5705ac13ad5b/users/b7f5d7cb1d1f48b09845d56e56ff3bce/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:20.453517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.472127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] MFA Rules not processed for user `7d8fa38cb93e4abb9688b8c076b45e95`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:20.473927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:20.634382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3403/6831] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:20.649194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.740172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6b59f-8034-46dd-b98e-19f7a7f370f2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.804651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60694adb-2785-4463-ab8e-9e17659b1fd8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.820451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.834382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.834876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.839890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] PATH_INFO: `/v3/users/7d8fa38cb93e4abb9688b8c076b45e95` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.844339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8fa38cb93e4abb9688b8c076b45e95)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.859492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.933965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.934639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.934915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.935188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.936022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.940008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:20.961087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3429/6832] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:20.962522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:20.980882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787607fd-4831-4d54-8aa7-efc478832f12 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:20.986962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:20.987656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:20.987989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:20.988645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] PATH_INFO: `/v3/projects/9d59594133b04cbea92f5705ac13ad5b/users/b7f5d7cb1d1f48b09845d56e56ff3bce/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:20.992220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d59594133b04cbea92f5705ac13ad5b, user_id=b7f5d7cb1d1f48b09845d56e56ff3bce, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:20.996585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960fa49-d564-4b5f-bac9-0a9d96f888ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:21.030598 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3430/6833] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:20 2022] PUT /identity/v3/projects/9d59594133b04cbea92f5705ac13ad5b/users/b7f5d7cb1d1f48b09845d56e56ff3bce/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:21.032524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7d2f-86ae-401a-b7e7-75a919127143 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:21.036702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7d2f-86ae-401a-b7e7-75a919127143 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:21.037186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec7d2f-86ae-401a-b7e7-75a919127143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:21.164995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-caec7d2f-86ae-401a-b7e7-75a919127143 None None] MFA Rules not processed for user `a9966c28533f473abd36fb8381fc1b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:21.169380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-caec7d2f-86ae-401a-b7e7-75a919127143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:21.253770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8fa38cb93e4abb9688b8c076b45e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.319241 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3431/6834] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:21.320804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:21.321096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:21.321372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:21.363210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] MFA Rules not processed for user `b7f5d7cb1d1f48b09845d56e56ff3bce`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:21.363732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8fa38cb93e4abb9688b8c076b45e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.365099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:21.388680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8fa38cb93e4abb9688b8c076b45e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.390084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8fa38cb93e4abb9688b8c076b45e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.391176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8fa38cb93e4abb9688b8c076b45e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.417838 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3404/6835] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:20 2022] DELETE /identity/v3/users/7d8fa38cb93e4abb9688b8c076b45e95 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:21.418726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:21.420187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:21.547689 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3432/6836] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:21.548799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:21.550359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:21.643565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d209ff-3d39-4ab5-83d3-1a2306e8bc8c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:21.680935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:21.682440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:21.682440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:21.682856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:21.683892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:21.694702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eeda14-4e45-4e42-bdb3-a4043e077603 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:21.702073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818aa7d1-ed47-40e8-85a0-fcbf4b04ff56 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:21.709033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:21.716925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:21.716925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:21.716925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] PATH_INFO: `/v3/projects/fa4adf1e6c344a1394ff522880c3f5d3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:21.716925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa4adf1e6c344a1394ff522880c3f5d3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:21.716925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:21.931461 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3405/6837] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:21 2022] POST /identity/v3/projects => generated 405 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:21.931461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:21.931461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:21.931461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:21.951255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa4adf1e6c344a1394ff522880c3f5d3', 'request_id': 'req-1dcf2ba7-c287-4beb-8269-819b5ea418fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.964077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa4adf1e6c344a1394ff522880c3f5d3', 'request_id': 'req-1dcf2ba7-c287-4beb-8269-819b5ea418fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:21.967575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:21.970608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:21.974664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa4adf1e6c344a1394ff522880c3f5d3', 'request_id': 'req-1dcf2ba7-c287-4beb-8269-819b5ea418fe'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.005524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:22.061781 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3406/6838] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:22.062929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.068889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.106340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] The token cache is being invalidate because project fa4adf1e6c344a1394ff522880c3f5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:22.106656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.107348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.113022 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3433/6839] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:21 2022] DELETE /identity/v3/projects/fa4adf1e6c344a1394ff522880c3f5d3 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:22.113022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.115155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.158779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf2ba7-c287-4beb-8269-819b5ea418fe admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.171921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.172745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.174870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.175268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.175997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.179664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.241362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db47002-af2a-4185-aae3-40322c3a0da5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.250700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.252904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.252904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.252904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.254756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.357297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3434/6840] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:22 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:22.358679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.367584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.425007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.427885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.457950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3407/6841] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:22.464087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.465054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.498569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196ae10-5675-4269-a4fd-65bea07b0858 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.516257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.517036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.517855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.518318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] PATH_INFO: `/v3/users/746f1cc5e3cb4459a04aa880792abe2f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.521785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=746f1cc5e3cb4459a04aa880792abe2f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.538083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.554858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ab0c3-34a5-41a3-9af0-d6896633d891 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.561841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.562829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.563329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.563821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.567043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:22.598841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.602826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.637567 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3435/6842] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:22.638533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.659713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486bb5-d9b0-4774-a062-9cc3ede3a6e0 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.675219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.675924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.676206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.676589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.677261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.678949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.704430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3436/6843] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:22.706944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.755295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c547ce-19eb-4727-a6b4-f40ff33e2d03 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:22.773340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:22.778902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:22.778902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:22.778902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] PATH_INFO: `/v3/projects/7ce41b65c4ff4b298048562c1adf0695/users/254c3aca03be4d3bbee466a13f6dd427/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:22.828841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce41b65c4ff4b298048562c1adf0695, user_id=254c3aca03be4d3bbee466a13f6dd427, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:22.838078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:22.844693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '746f1cc5e3cb4459a04aa880792abe2f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.932203 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3437/6844] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:22 2022] PUT /identity/v3/projects/7ce41b65c4ff4b298048562c1adf0695/users/254c3aca03be4d3bbee466a13f6dd427/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:22.936643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:22.963762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '746f1cc5e3cb4459a04aa880792abe2f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.990898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '746f1cc5e3cb4459a04aa880792abe2f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.994097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '746f1cc5e3cb4459a04aa880792abe2f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:22.994542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '746f1cc5e3cb4459a04aa880792abe2f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:23.049098 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3408/6845] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:22 2022] DELETE /identity/v3/users/746f1cc5e3cb4459a04aa880792abe2f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:23.139450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef420808-d1bd-4f9c-8324-7f7e268413bd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:23.314914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:23.319952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:23.320712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:23.321369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:23.326200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:23.328462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:23.349479 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3438/6846] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:23.351117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:23.353190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:23.371002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbfc7-7293-4317-92c3-ecabd7b961eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:23.378465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:23.379342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:23.379923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:23.380391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] PATH_INFO: `/v3/projects/7ce41b65c4ff4b298048562c1adf0695/users/254c3aca03be4d3bbee466a13f6dd427/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:23.383859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce41b65c4ff4b298048562c1adf0695, user_id=254c3aca03be4d3bbee466a13f6dd427, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:23.398370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:23.443348 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3409/6847] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:23 2022] PUT /identity/v3/projects/7ce41b65c4ff4b298048562c1adf0695/users/254c3aca03be4d3bbee466a13f6dd427/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:23.443348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:23.536108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:23.538262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:23.559885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506811f4-f51a-4fca-9ae2-344823f31709 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:23.741454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:23.742368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:23.742802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:23.746745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] PATH_INFO: `/v3/users/1f5b4ad019ea45c2962ecaa99dde33da` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:23.749896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5b4ad019ea45c2962ecaa99dde33da)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:23.754141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:23.770089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:23.774822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:23.815593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d5d46-482d-4722-9c6b-29bd06d227a8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:23.842340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:23.845167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:23.845928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:23.849572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] PATH_INFO: `/v3/users/52ef63a2282f4e80a9f13ace213ddc91` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:23.852936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef63a2282f4e80a9f13ace213ddc91)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:23.858554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:24.107107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5b4ad019ea45c2962ecaa99dde33da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.253583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef63a2282f4e80a9f13ace213ddc91'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.262978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5b4ad019ea45c2962ecaa99dde33da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.294533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5b4ad019ea45c2962ecaa99dde33da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.309789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5b4ad019ea45c2962ecaa99dde33da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.312162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8c4e883a-1281-4089-a1ed-3ab040559fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5b4ad019ea45c2962ecaa99dde33da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.327013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3439/6848] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:23 2022] DELETE /identity/v3/users/1f5b4ad019ea45c2962ecaa99dde33da => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:24.332778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:24.333077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:24.333462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:24.374223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:24.379946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:24.437155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef63a2282f4e80a9f13ace213ddc91'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.528369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef63a2282f4e80a9f13ace213ddc91'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.534027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef63a2282f4e80a9f13ace213ddc91'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.534889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ef4767d5-1a4d-40c9-9fa1-4aac62c99cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef63a2282f4e80a9f13ace213ddc91'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:24.571702 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3440/6849] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:24.574738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3410/6850] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:23 2022] DELETE /identity/v3/users/52ef63a2282f4e80a9f13ace213ddc91 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:24.580015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:24.581538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:24.582024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:24.582704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:24.583717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:24.619454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:24.623558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:24.746888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d421-5b8e-4e99-a549-2d1c2d637c99 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:24.784677 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3411/6851] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:24.786337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:24.793253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:24.819196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ae4cc-b203-4787-86e5-8c3629300d24 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:24.832972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:24.835508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:24.836093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:24.836599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:24.837835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:24.838510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:24.839605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:24.840219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] PATH_INFO: `/v3/projects/3b7e804f6e3d4e44b934232478043da3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:24.843634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7e804f6e3d4e44b934232478043da3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:24.849142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:24.860244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:24.865306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:24.898541 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3441/6852] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:24.902110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:24.912041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:24.969063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d09c9-ae77-4782-9f20-512f6619b06d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:24.978461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:24.979576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:24.980095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:24.980744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] PATH_INFO: `/v3/projects/3ca023efb346407785d2bc1fa7c20a22` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:24.982732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca023efb346407785d2bc1fa7c20a22)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:24.988116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:25.006106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:25.129670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7e804f6e3d4e44b934232478043da3', 'request_id': 'req-8a1bac60-8bf8-457e-8b96-f35273e7b652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.151404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7e804f6e3d4e44b934232478043da3', 'request_id': 'req-8a1bac60-8bf8-457e-8b96-f35273e7b652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.271474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7e804f6e3d4e44b934232478043da3', 'request_id': 'req-8a1bac60-8bf8-457e-8b96-f35273e7b652'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.281547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca023efb346407785d2bc1fa7c20a22', 'request_id': 'req-931b0619-f486-4038-a36c-4e643a2092a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.303557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca023efb346407785d2bc1fa7c20a22', 'request_id': 'req-931b0619-f486-4038-a36c-4e643a2092a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.305244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] The token cache is being invalidate because project 3b7e804f6e3d4e44b934232478043da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:25.305711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.306607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.308442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3412/6853] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:24 2022] DELETE /identity/v3/projects/3b7e804f6e3d4e44b934232478043da3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:25.309647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:25.316452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.332167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca023efb346407785d2bc1fa7c20a22', 'request_id': 'req-931b0619-f486-4038-a36c-4e643a2092a6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.469229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] The token cache is being invalidate because project 3ca023efb346407785d2bc1fa7c20a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:25.469694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.471451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-931b0619-f486-4038-a36c-4e643a2092a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:25.475992 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3442/6854] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:24 2022] DELETE /identity/v3/projects/3ca023efb346407785d2bc1fa7c20a22 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:25.478541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b917-0a63-4bec-b9da-09cd052f4566 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.479172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b917-0a63-4bec-b9da-09cd052f4566 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.479735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b917-0a63-4bec-b9da-09cd052f4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.502932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bac60-8bf8-457e-8b96-f35273e7b652 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:25.522482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ae21b917-0a63-4bec-b9da-09cd052f4566 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:25.525015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae21b917-0a63-4bec-b9da-09cd052f4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.602845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:25.622706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:25.623610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.624051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.624476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.632758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.653153 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3443/6855] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:25.659967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8492a0-fa5e-471b-9fb3-d603bf01e48f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.661404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8492a0-fa5e-471b-9fb3-d603bf01e48f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.661706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8492a0-fa5e-471b-9fb3-d603bf01e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.698599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fc8492a0-fa5e-471b-9fb3-d603bf01e48f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:25.700026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fc8492a0-fa5e-471b-9fb3-d603bf01e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.718720 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3444/6856] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:25.721934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4cd6-9be3-413b-b7cd-bd6e100025d9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.722322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4cd6-9be3-413b-b7cd-bd6e100025d9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.722663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e4cd6-9be3-413b-b7cd-bd6e100025d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.766157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-355e4cd6-9be3-413b-b7cd-bd6e100025d9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:25.768172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-355e4cd6-9be3-413b-b7cd-bd6e100025d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.784117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:25.786202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:25.803131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3445/6857] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:25.806492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.806492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.806492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.813869 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3413/6858] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:25.815397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:25.847976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ea14-5ff3-448a-a4a4-258f6968f508 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:25.855625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:25.856910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:25.870044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:25.870684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.870964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.871237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.871921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:25.872228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:25.882227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:25.891001 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3446/6859] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:25.898119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:25.925735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3414/6860] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:25.929829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520f7ed-3a01-4d31-84d8-9c26f1fa652f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:25.938304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:25.949259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:25.949870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:25.955813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:25.955813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:25.955813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:25.955813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:25.955813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:25.988188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3447/6861] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:54:25.994330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1cea-4cd1-4cbd-a51e-72c688dcc38f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.002905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.018755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.022129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.024240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.026406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.030298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.035792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.044734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c7d19-1e1c-48c0-8cbd-7b0a5a70174e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.066113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.066757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.067045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.067323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.067970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.071994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.226696 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3448/6863] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/projects => generated 383 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:26.227981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3415/6863] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:25 2022] POST /identity/v3/projects => generated 389 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:26.233492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.239131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.341626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ba0-04c6-4d3e-8566-5f6cd2899795 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.348740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.348993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.349710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.350143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.351446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.354120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.354821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c82e7-f08c-4753-bb19-3a332c4a2b63 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.362848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.366214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.366473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.366855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.367634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.371112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.543459 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3416/6864] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:26 2022] POST /identity/v3/users => generated 295 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:26.547646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.559222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c7f4f-57e0-47d2-9044-f27efec1f161 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.564670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.565974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.566867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.567198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.567861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.569887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.582513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3417/6865] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:26.586339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.597155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159690b-77be-4045-96ae-8f1c07d2d5a7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.610509 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3449/6866] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:26 2022] POST /identity/v3/users => generated 292 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:54:26.615757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.623635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.625325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.625325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.627318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.628134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.633818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.641364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8162-a8dc-4a0e-94ef-26d55855ef00 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.658610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.659253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.659548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.660961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.661632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.666473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3418/6867] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:26.667827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.668546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.676416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:26.706124 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3450/6868] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:26.706362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.711134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a35125-0fc0-4c60-b927-1b35ee354de9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.728750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.729454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.730274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.730547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] PATH_INFO: `/v3/projects/8103042f79b745beaed82231ddc7416f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.732775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8103042f79b745beaed82231ddc7416f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.736200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf9289-31b5-4026-a47f-733b06636236 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:26.742060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.753236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:26.754039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:26.754316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:26.754585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] PATH_INFO: `/v3/projects/4dd0ba2781b444bfa96a5c7141ed3671/users/aae5e6dae6dc4ca4a1f156c32a3d7b4a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:26.788283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd0ba2781b444bfa96a5c7141ed3671, user_id=aae5e6dae6dc4ca4a1f156c32a3d7b4a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:26.792076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:26.892775 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3451/6869] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:26 2022] PUT /identity/v3/projects/4dd0ba2781b444bfa96a5c7141ed3671/users/aae5e6dae6dc4ca4a1f156c32a3d7b4a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:26.893635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:26.918857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8103042f79b745beaed82231ddc7416f', 'request_id': 'req-8d0ccd86-30c7-4666-ae09-31e29585eabf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:26.933889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8103042f79b745beaed82231ddc7416f', 'request_id': 'req-8d0ccd86-30c7-4666-ae09-31e29585eabf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.031430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76b5a-44e3-442d-8454-fcfc3b852194 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:27.066388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8103042f79b745beaed82231ddc7416f', 'request_id': 'req-8d0ccd86-30c7-4666-ae09-31e29585eabf'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.094795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] The token cache is being invalidate because project 8103042f79b745beaed82231ddc7416f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:27.095703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.096424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d0ccd86-30c7-4666-ae09-31e29585eabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.099512 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3419/6870] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:26 2022] DELETE /identity/v3/projects/8103042f79b745beaed82231ddc7416f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:27.101021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:27.101306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:27.102380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:27.151465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] MFA Rules not processed for user `aae5e6dae6dc4ca4a1f156c32a3d7b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:27.153023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:27.157662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:27.161154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:27.161154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:27.161154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:27.161154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:27.162511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:27.179351 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3452/6871] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:27.179351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:27.181195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:27.201581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff33a91-d683-4d4a-bd71-b9e14508ed97 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:27.214245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:27.214930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:27.215220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:27.215495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] PATH_INFO: `/v3/projects/93d474c8008742c39d946d5a80466162` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:27.217965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93d474c8008742c39d946d5a80466162)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:27.220423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:27.270082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:27.323559 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3420/6872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:27.324594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:27.326290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:27.351670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f120b4-6b46-4ab2-b475-51f163bd54d8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:27.363012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:27.364233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:27.364537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:27.364818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] PATH_INFO: `/v3/users/b7f5d7cb1d1f48b09845d56e56ff3bce` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:27.369181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f5d7cb1d1f48b09845d56e56ff3bce)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:27.371870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:27.423336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93d474c8008742c39d946d5a80466162', 'request_id': 'req-6d296c4c-6c70-496b-822a-26c87f6f6a55'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.437064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93d474c8008742c39d946d5a80466162', 'request_id': 'req-6d296c4c-6c70-496b-822a-26c87f6f6a55'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.446530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93d474c8008742c39d946d5a80466162', 'request_id': 'req-6d296c4c-6c70-496b-822a-26c87f6f6a55'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.548715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] The token cache is being invalidate because project 93d474c8008742c39d946d5a80466162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:27.548715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.550103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.556102 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3453/6873] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:27 2022] DELETE /identity/v3/projects/93d474c8008742c39d946d5a80466162 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:27.557233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:27.560689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:27.671193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d296c4c-6c70-496b-822a-26c87f6f6a55 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:27.678152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:27.679099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:27.679375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:27.687819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] PATH_INFO: `/v3/projects/84c6e219ae45464bbd62598e997ebbd7/users/21b3db1875d34bdab006e56bc58bc055/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:27.702371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c6e219ae45464bbd62598e997ebbd7, user_id=21b3db1875d34bdab006e56bc58bc055, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:27.705535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:27.829731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:27.874470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f5d7cb1d1f48b09845d56e56ff3bce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.945070 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3454/6874] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:27 2022] PUT /identity/v3/projects/84c6e219ae45464bbd62598e997ebbd7/users/21b3db1875d34bdab006e56bc58bc055/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:27.947010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:27.951369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:27.968567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f5d7cb1d1f48b09845d56e56ff3bce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:27.996743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f5d7cb1d1f48b09845d56e56ff3bce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.003135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f5d7cb1d1f48b09845d56e56ff3bce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.007126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f5d7cb1d1f48b09845d56e56ff3bce'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.040770 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3421/6875] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:27 2022] DELETE /identity/v3/users/b7f5d7cb1d1f48b09845d56e56ff3bce => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:28.041762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:28.049831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:28.128580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ce534-63de-4911-91ba-67fac76cd563 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:28.246999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e75ccc-ca9d-4a21-9b73-7101bf4b0e5e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:28.262932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:28.262932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:28.263547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:28.264725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] PATH_INFO: `/v3/users/fb7e5beaa61d4a0fb3bcf9dd369b1924` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:28.266819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7e5beaa61d4a0fb3bcf9dd369b1924)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:28.271222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:28.311350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:28.312097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:28.312254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:28.312542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:28.322359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:28.323430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091302e-25dd-42bf-998e-21fdbe13440f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:28.522593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3455/6876] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:27 2022] POST /identity/v3/projects => generated 391 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:28.528527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a1244-7dc6-46f7-85a1-3f9cbc5bf03a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:28.528527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a1244-7dc6-46f7-85a1-3f9cbc5bf03a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:28.528527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a1244-7dc6-46f7-85a1-3f9cbc5bf03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:28.593469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-311a1244-7dc6-46f7-85a1-3f9cbc5bf03a None None] MFA Rules not processed for user `21b3db1875d34bdab006e56bc58bc055`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:28.594799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-311a1244-7dc6-46f7-85a1-3f9cbc5bf03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:28.622180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7e5beaa61d4a0fb3bcf9dd369b1924'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.677271 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3456/6877] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:28.678973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:28.679554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:28.680042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:28.733643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] MFA Rules not processed for user `254c3aca03be4d3bbee466a13f6dd427`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:28.736022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:28.819304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7e5beaa61d4a0fb3bcf9dd369b1924'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.840952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7e5beaa61d4a0fb3bcf9dd369b1924'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.843452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7e5beaa61d4a0fb3bcf9dd369b1924'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.846995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7e5beaa61d4a0fb3bcf9dd369b1924'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:28.868013 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3457/6878] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:28.870120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:28.876727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:28.881893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3422/6879] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:28 2022] DELETE /identity/v3/users/fb7e5beaa61d4a0fb3bcf9dd369b1924 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:28.884383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:28.889404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:29.010711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abab22-f4bb-4ccf-85c0-9f6a1df827e7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.016289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.018181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.018632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.019051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.019855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.022600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.046703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7c0e7-84a7-4dcc-9691-beb6f86a635e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.058567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.059335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.059682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.060018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.060823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.063071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.176558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3458/6880] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:28 2022] POST /identity/v3/users => generated 302 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:29.177433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.180316 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3423/6881] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:28 2022] POST /identity/v3/projects => generated 383 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:29.181339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.184322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:29.187534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:29.213738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24297f3a-d4ac-4c00-be17-7d4a5a5fb6a5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.330854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6b5a-88e3-4fb2-a210-9911843b931d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.342105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.342737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.343013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.343318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.343927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.347224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.347876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.348143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.348444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] PATH_INFO: `/v3/projects/9d59594133b04cbea92f5705ac13ad5b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.349538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.351654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d59594133b04cbea92f5705ac13ad5b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.353614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.373523 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3424/6882] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:29.375780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.399396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa978e-9a92-413b-9b50-7aa01e81b505 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.426109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.426741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.427024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.427295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.427928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.430050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.585124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d59594133b04cbea92f5705ac13ad5b', 'request_id': 'req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:29.592867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d59594133b04cbea92f5705ac13ad5b', 'request_id': 'req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:29.593597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3425/6883] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:29 2022] POST /identity/v3/users => generated 298 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:29.594592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.601233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d59594133b04cbea92f5705ac13ad5b', 'request_id': 'req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:29.630838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263f88-bd1e-44ab-9c57-daecde25ac87 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.701070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] The token cache is being invalidate because project 9d59594133b04cbea92f5705ac13ad5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:29.702174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:29.702628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:29.706940 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3459/6884] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:29 2022] DELETE /identity/v3/projects/9d59594133b04cbea92f5705ac13ad5b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:29.708310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.712089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:29.786949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.787883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.788342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.788816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] PATH_INFO: `/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0/users/1eb137143c7f4991a72727319a0020a1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.823221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfb7e3e5f5445eaa5ebb7688390c7b0, user_id=1eb137143c7f4991a72727319a0020a1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.823588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:29.826844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0def5-08c7-4a70-aeff-0127a95f8ef1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.859600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:29.868790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf638b3-b224-4ded-9c1a-90a8df0d72e3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.874866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:29.875589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.879134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.879134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.879134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:29.880701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:29.896836 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3460/6885] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:29.898507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:29.901487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:29.922964 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3426/6886] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:29 2022] PUT /identity/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0/users/1eb137143c7f4991a72727319a0020a1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:29.928137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:29.928812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:29.930319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:29.939246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edc919-986d-4940-a3d1-4e5ea8c174dd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:29.978003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:29.983078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.128034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.129516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.129811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.131908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] PATH_INFO: `/v3/projects/2fde1d2f7f3e4d5da243efca67d47565` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.133950 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3427/6887] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:30.135053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.143858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fde1d2f7f3e4d5da243efca67d47565)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.148904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.159026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3913ba-7d74-43ec-a4aa-888de5ea662d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.164061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.164978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.171744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.171744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] PATH_INFO: `/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a/users/242ed94f903646ff89e0b92e457111c7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.187155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0bdd6dece34045bf63bd4b2c93c59a, user_id=242ed94f903646ff89e0b92e457111c7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.193676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.276537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3428/6888] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:30 2022] PUT /identity/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a/users/242ed94f903646ff89e0b92e457111c7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:30.277535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.283739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.362482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fde1d2f7f3e4d5da243efca67d47565', 'request_id': 'req-f3031843-01a1-4fc6-ba5c-70317e6056d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:30.375435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fde1d2f7f3e4d5da243efca67d47565', 'request_id': 'req-f3031843-01a1-4fc6-ba5c-70317e6056d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:30.384742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d7d2f-453e-4584-b2e8-fea2ed3563c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.388202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fde1d2f7f3e4d5da243efca67d47565', 'request_id': 'req-f3031843-01a1-4fc6-ba5c-70317e6056d1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:30.495293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.497062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.497587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.498490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.499431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.504003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.529330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] The token cache is being invalidate because project 2fde1d2f7f3e4d5da243efca67d47565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-f3031843-01a1-4fc6-ba5c-70317e6056d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3461/6889] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:29 2022] DELETE /identity/v3/projects/2fde1d2f7f3e4d5da243efca67d47565 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292d58-9c5a-4ceb-b6a4-66c3d0def95e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292d58-9c5a-4ceb-b6a4-66c3d0def95e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.538577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292d58-9c5a-4ceb-b6a4-66c3d0def95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.549208 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3429/6890] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:30.556520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.562523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.568830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-73292d58-9c5a-4ceb-b6a4-66c3d0def95e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:30.570215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-73292d58-9c5a-4ceb-b6a4-66c3d0def95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.580812 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3462/6891] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:30.581892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.582103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.582270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.587892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48068932-edab-42d3-afe0-de6d63e9f62b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.593287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.594021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.594577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.595879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.596734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.598583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.611264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3430/6892] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:30.612391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.614587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.621637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:30.625601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.641793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb322b07-1f1e-40e5-b426-181f1eef2436 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.648952 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3463/6893] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:30.649895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.667577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.668361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.668736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.669224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] PATH_INFO: `/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0/users/1eb137143c7f4991a72727319a0020a1/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.671506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdfb7e3e5f5445eaa5ebb7688390c7b0, user_id=1eb137143c7f4991a72727319a0020a1, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.671660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ecef-1d62-4594-bced-2c1d63d03f25 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.675471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.694246 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3431/6894] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:30 2022] PUT /identity/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0/users/1eb137143c7f4991a72727319a0020a1/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:30.695309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.711835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.712577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.712923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.713258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.713912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:30.714220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.717055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730fcbf-03f0-4787-a838-03a05c968fad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.740033 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3464/6895] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:30.742574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622d83-a37e-4bda-bf01-35187dfffa00 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.742761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622d83-a37e-4bda-bf01-35187dfffa00 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.743053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622d83-a37e-4bda-bf01-35187dfffa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.775221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-84622d83-a37e-4bda-bf01-35187dfffa00 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:30.777128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-84622d83-a37e-4bda-bf01-35187dfffa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:30.850449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306dea-1dbb-473a-ab63-d017829a59b0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:30.866684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:30.867703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.868390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.868798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] PATH_INFO: `/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a/users/242ed94f903646ff89e0b92e457111c7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.871360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0bdd6dece34045bf63bd4b2c93c59a, user_id=242ed94f903646ff89e0b92e457111c7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:30.874465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:30.883610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3465/6896] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:30.889070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:30.889638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:30.890034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:30.890427 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3432/6897] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:30 2022] PUT /identity/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a/users/242ed94f903646ff89e0b92e457111c7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:30.892564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:30.938702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] MFA Rules not processed for user `1eb137143c7f4991a72727319a0020a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:30.941179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.018052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795285-6efe-4fd8-aac0-93d34d6890e0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.026958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:31.027796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.028085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.028363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.029119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:31.031460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca911187-1c73-4e66-87af-0abaeabfa964 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:31.076421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3466/6898] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:31.078560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.101382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651da-f4d1-4dca-9af2-6271858bb4d7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.107131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:31.108532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.108834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.109114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.110436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:31.110436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:31.127739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:31.131782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3433/6899] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:30 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:31.133021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.133312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.133590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.177529 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3467/6900] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:31.186641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.186641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.218438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] MFA Rules not processed for user `242ed94f903646ff89e0b92e457111c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:31.220284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.320177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:31.353065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2f2a4-995d-436a-90ff-1f33bf57b431 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.389512 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3434/6901] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:31.390347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.469078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:31.470551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.471057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.471653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.487702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.581378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a64d1-8f03-4a84-bf57-ad1d79e5b7d4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.593087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:31.595937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.595937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.595937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.596795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:31.598698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:31.635143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:31.636520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:31.651813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3468/6902] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:31.652764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.664882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5d7e6-47a0-4476-9f13-42ca3ab9ff41 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.670761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:31.671627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:31.671841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:31.672125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:31.673353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:31.675851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:31.763882 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3435/6903] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:31 2022] POST /identity/v3/users => generated 292 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:31.765065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.768276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.820262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3469/6904] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:31 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:31.820262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:31.820262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:31.958929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:31.970351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee1dd1-d398-4097-bfa2-d21de9c617dd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:31.982200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a976e8e-a2ec-4ae5-9342-44bf5168422b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.006700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.007390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.009645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.009947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] PATH_INFO: `/v3/users/a9966c28533f473abd36fb8381fc1b0f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.012802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9966c28533f473abd36fb8381fc1b0f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.014841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.115984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.116676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.116961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.117250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.122297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:32.277145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.279822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.322627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3436/6905] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:32.323556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.366795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41492a-7b39-4682-946a-562c1c807d96 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.379959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.380841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.381279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.381694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.382371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.389238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.407485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9966c28533f473abd36fb8381fc1b0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:32.420568 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3437/6906] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:32.420568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.450387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca717df8-8d24-42e8-b2a6-b50a8a4cb8bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.464999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.465718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.466146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.466503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.467523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.480937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.546462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9966c28533f473abd36fb8381fc1b0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:32.586909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9966c28533f473abd36fb8381fc1b0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:32.609797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9966c28533f473abd36fb8381fc1b0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:32.610696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9966c28533f473abd36fb8381fc1b0f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:32.633832 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3470/6907] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:31 2022] DELETE /identity/v3/users/a9966c28533f473abd36fb8381fc1b0f => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:32.635185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.639234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:32.640875 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3438/6908] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:32 2022] POST /identity/v3/users => generated 281 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:32.641221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.649187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:32.684019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f83ced-6f26-4eef-8735-6158a97cb5ea admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.762889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b59aa-f4fa-4bc7-9a32-798f254ddad6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.769969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.770742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.771097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.772136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.772136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.774102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.788046 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3471/6909] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:32.792161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.808199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8b834-6bfd-4a1e-bbc6-22d4387171be admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.816353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.817602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.818320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.818716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.818836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.819639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.819901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.820235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.822163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] PATH_INFO: `/v3/projects/6b50a796601a4dd7a314e515e19dd8cb/users/6aa5e1fc1ae44c2d85a9f8b274bbae4e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.834712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.847434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b50a796601a4dd7a314e515e19dd8cb, user_id=6aa5e1fc1ae44c2d85a9f8b274bbae4e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.851371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251fa4c-47e6-4cdd-972b-d1856e10dea6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.862265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3439/6910] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:32.866802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.892951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6619e-00df-442f-a8b6-6cd2b5a094ae admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.899490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.900132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.900411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.900863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.901536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:32.903315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:32.917085 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3440/6911] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:54:32.921545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:32.934486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7094-e5ff-40e3-b76f-9c6c9eff4aaa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:32.950369 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3472/6912] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:32 2022] PUT /identity/v3/projects/6b50a796601a4dd7a314e515e19dd8cb/users/6aa5e1fc1ae44c2d85a9f8b274bbae4e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:32.954995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:32.955780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.956063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.956341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] PATH_INFO: `/v3/projects/d4052ea9dbe5435fad182eb586fcfe76/users/fdb20e9133bd4f919466f12f8076a988/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.964427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:32.964811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:32.965090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:32.997740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4052ea9dbe5435fad182eb586fcfe76, user_id=fdb20e9133bd4f919466f12f8076a988, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:33.011954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] MFA Rules not processed for user `6aa5e1fc1ae44c2d85a9f8b274bbae4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:33.017337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:33.021513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d93c5f-977b-4c5f-8e71-7be75bacfd01 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:33.127567 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3441/6913] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:32 2022] PUT /identity/v3/projects/d4052ea9dbe5435fad182eb586fcfe76/users/fdb20e9133bd4f919466f12f8076a988/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:33.141972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:33.142702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:33.142997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:33.154551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3473/6914] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:33.162845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:33.193489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] MFA Rules not processed for user `fdb20e9133bd4f919466f12f8076a988`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:33.195347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:33.248286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:33.396896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772ef4f-c391-41a6-b78d-ef09c9220bd3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:33.431874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3442/6915] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:33.450201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:33.452082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:33.529995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:33.530669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:33.530959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:33.532049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:33.532816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:33.540399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:33.647615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1b5b3-252c-4d57-9ce5-fbeac9513564 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:33.652346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:33.654332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:33.654978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:33.655284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:33.655562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:33.679126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:33.680681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:33.704216 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3443/6916] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:33.792259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3474/6917] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:33 2022] POST /identity/v3/projects => generated 383 bytes in 630 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:33.796018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:33.814821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0b849-f4b7-44ed-a515-87aac9b53032 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:33.960199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:33.961074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:33.961459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:33.961815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:33.962472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:33.964433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.089747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3444/6918] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:33 2022] POST /identity/v3/users => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:34.093777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.108906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e46750-d8eb-4272-a846-bca4b063171a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.117578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:34.118666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.119166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.119819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.120815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:34.122924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.131874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.133750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:34.152480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2029055-c151-4ba5-b806-7050a58d3485 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.158497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:34.159153 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3475/6919] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:34.159293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.159493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.159773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] PATH_INFO: `/v3/projects/f5d1895796ac47f99a74ac65f7a6e400` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.162799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.179128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d1895796ac47f99a74ac65f7a6e400)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:34.183803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.192356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bad43-ec8a-4910-8c79-d684d8bb9bbe admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.206953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:34.208959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.211293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.212404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] PATH_INFO: `/v3/projects/585cd942a62049b2b42a54db568118c1/users/8ea6690199ae4200a8b87706a06197fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.257798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=585cd942a62049b2b42a54db568118c1, user_id=8ea6690199ae4200a8b87706a06197fd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:34.284587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.473140 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3476/6920] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:34 2022] PUT /identity/v3/projects/585cd942a62049b2b42a54db568118c1/users/8ea6690199ae4200a8b87706a06197fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:34.494515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.542827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d1895796ac47f99a74ac65f7a6e400', 'request_id': 'req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:34.565833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d1895796ac47f99a74ac65f7a6e400', 'request_id': 'req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:34.643211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf17acb-3fd0-428c-81ff-8caf1832cb3c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.655782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d1895796ac47f99a74ac65f7a6e400', 'request_id': 'req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:34.687505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] The token cache is being invalidate because project f5d1895796ac47f99a74ac65f7a6e400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:34.690328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:34.696023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:34.718682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3445/6921] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:34 2022] DELETE /identity/v3/projects/f5d1895796ac47f99a74ac65f7a6e400 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:34.720562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.723265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:34.775759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:34.776407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.776692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.776966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.777862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:34.779413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.815098 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3477/6922] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:34.816295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:34.818099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:34.857245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f216e-7abb-450c-804f-9c7124a748b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.873442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:34.874252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.874545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.874820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] PATH_INFO: `/v3/projects/585cd942a62049b2b42a54db568118c1/users/8ea6690199ae4200a8b87706a06197fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.877663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585cd942a62049b2b42a54db568118c1, user_id=8ea6690199ae4200a8b87706a06197fd, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:34.882298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c993c19-266e-4109-a7d9-f35f8522b6e2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:34.900008 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3478/6923] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:34 2022] PUT /identity/v3/projects/585cd942a62049b2b42a54db568118c1/users/8ea6690199ae4200a8b87706a06197fd/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:34.919027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:34.919027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:34.919027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:34.923576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3b7e8-ffa9-4f33-8106-142ddb0b12fb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:34.966013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] MFA Rules not processed for user `8ea6690199ae4200a8b87706a06197fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:34.967812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:35.046989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:35.050989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:35.050989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:35.050989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] PATH_INFO: `/v3/users/254c3aca03be4d3bbee466a13f6dd427` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:35.050989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=254c3aca03be4d3bbee466a13f6dd427)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:35.054188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:35.116594 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3479/6924] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:35.126957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:35.129029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:35.216476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:35.311258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58d3ca-a77e-489d-a1ec-2b93be8b630b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:35.313682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254c3aca03be4d3bbee466a13f6dd427'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:35.326257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:35.327451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:35.328094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:35.328701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:35.342625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:35.345502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:35.402109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3480/6925] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:35.441505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254c3aca03be4d3bbee466a13f6dd427'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:35.493168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254c3aca03be4d3bbee466a13f6dd427'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:35.494299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254c3aca03be4d3bbee466a13f6dd427'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:35.496706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254c3aca03be4d3bbee466a13f6dd427'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:35.527270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:35.566149 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3446/6926] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:34 2022] DELETE /identity/v3/users/254c3aca03be4d3bbee466a13f6dd427 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:35.841842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:35.843490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:35.868387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6b9d-4f9a-4e19-8ac8-609d827266dc service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:36.060946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:36.062375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:36.068983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:36.068983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:36.068983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:36.214729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:36.233963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:36.289079 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3481/6927] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:36.690355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:36.697659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:36.702492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:36.866119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d3c07-891a-4dd7-91a2-b1da218dddb6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:36.874920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:36.876438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:36.879113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:36.879720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] PATH_INFO: `/v3/projects/7ce41b65c4ff4b298048562c1adf0695` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:36.896865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce41b65c4ff4b298048562c1adf0695)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:36.904427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:37.193249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:37.216175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:37.219169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:37.228562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce41b65c4ff4b298048562c1adf0695', 'request_id': 'req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.239219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce41b65c4ff4b298048562c1adf0695', 'request_id': 'req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.247000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a026fe5-e9ce-4e4c-9430-38bf0fbdd52f service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:37.366883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:37.367859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:37.368233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:37.373106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce41b65c4ff4b298048562c1adf0695', 'request_id': 'req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.373676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] PATH_INFO: `/v3/users/6aa5e1fc1ae44c2d85a9f8b274bbae4e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:37.384640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa5e1fc1ae44c2d85a9f8b274bbae4e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:37.386976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:37.410806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] The token cache is being invalidate because project 7ce41b65c4ff4b298048562c1adf0695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:37.413806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.415957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1cb9cf3b-3517-441a-bfc6-32750bd9a41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.441059 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3447/6928] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:36 2022] DELETE /identity/v3/projects/7ce41b65c4ff4b298048562c1adf0695 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:37.450804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fd02-ff3b-4da1-ae3f-60a90f2f1f87 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:37.451363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fd02-ff3b-4da1-ae3f-60a90f2f1f87 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:37.452040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255fd02-ff3b-4da1-ae3f-60a90f2f1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:37.541606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b255fd02-ff3b-4da1-ae3f-60a90f2f1f87 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:37.542013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:37.543177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b255fd02-ff3b-4da1-ae3f-60a90f2f1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:37.569311 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3448/6929] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:37.579800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:37.580079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:37.580348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:37.610172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:37.611050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:37.623808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3449/6930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:37.629440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:37.673434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c3927-5bde-438f-a3e9-54e5ce6cce4a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:37.694479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:37.696043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:37.697056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:37.697534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:37.699358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:37.700353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:37.704759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:37.743079 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3450/6931] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:54:37.749993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:37.778879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd47cf-c7d5-460e-ba8b-3c8b0ec91e75 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:37.797609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:37.798507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:37.798888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:37.799350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:37.800317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:37.803501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:37.867021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa5e1fc1ae44c2d85a9f8b274bbae4e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:37.992099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa5e1fc1ae44c2d85a9f8b274bbae4e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:38.041230 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3451/6932] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:37 2022] POST /identity/v3/projects => generated 355 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:38.046997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:38.070250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa5e1fc1ae44c2d85a9f8b274bbae4e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:38.145307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa5e1fc1ae44c2d85a9f8b274bbae4e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:38.149459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-339277fa-0a9c-47b6-ad21-74a03a0ddf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa5e1fc1ae44c2d85a9f8b274bbae4e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:38.187784 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3482/6933] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:37 2022] DELETE /identity/v3/users/6aa5e1fc1ae44c2d85a9f8b274bbae4e => generated 0 bytes in 972 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:38.193268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:38.195030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:38.196232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:38.282895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:38.295600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:38.343858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff5d56-6403-4f64-a586-626a681858f9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:38.513261 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3483/6934] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:38.514909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:38.519525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:38.527237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:38.529181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:38.530019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:38.530822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:38.533050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:38.538916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:38.662045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba99ab8-bac1-4b7c-b57b-64d47bc7126c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:38.666487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:38.667121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:38.667284 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3452/6935] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:38 2022] POST /identity/v3/users => generated 278 bytes in 623 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:38.667792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:38.668296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:38.675064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:38.685407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:38.702681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:38.704837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:38.731676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3484/6936] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:38.753396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d3fce-df39-45b3-8c81-8bf42bac5aff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:38.789707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:38.811324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:38.812164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:38.813923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:38.816608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:38.822755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:38.858168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:38.873671 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3453/6937] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:38.878249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:38.910218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820a927-b539-435d-8d91-41efcfcd90df service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:38.929098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:38.930246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:38.930716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:38.931257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:38.932547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:38.938211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515e3f9-5a06-4a11-b8cf-6ce09d223e37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:38.960679 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3485/6938] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:38.965297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:38.987378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d0ec27-8cd5-4453-9d2c-f12c34a9bfb5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:39.008221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:39.011236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.012078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.014360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] PATH_INFO: `/v3/projects/90e57775e2724b8790628e65aa95d248/users/1529368b1a364825991e46ec9e0cb595/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.068761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e57775e2724b8790628e65aa95d248, user_id=1529368b1a364825991e46ec9e0cb595, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:39.072816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:39.079730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:39.246892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3454/6939] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:38 2022] PUT /identity/v3/projects/90e57775e2724b8790628e65aa95d248/users/1529368b1a364825991e46ec9e0cb595/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:39.257455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.258548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.259433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.340455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] MFA Rules not processed for user `1529368b1a364825991e46ec9e0cb595`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:39.345715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:39.483029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:39.487774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:39.635056 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3486/6940] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:39.637470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:39.742492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c0b03-5af1-4b39-8f08-9be6c7a53d25 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:39.756278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:39.757967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.759403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.760032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] PATH_INFO: `/v3/users/5f4ed4bdc1714e95aa941ef4a36fa381` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.767507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4ed4bdc1714e95aa941ef4a36fa381)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:39.777404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:39.826419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cdd8b-3da5-49c5-b4c1-a4ca5c3d9e16 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:39.833206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:39.834524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:39.834817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:39.835132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:39.835872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:39.838785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.007016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:40.034848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3487/6941] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:39 2022] POST /identity/v3/projects => generated 357 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:40.037128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.121701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4ed4bdc1714e95aa941ef4a36fa381'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.258111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5869093-40e7-4eec-9f9b-bcca590482df admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.258727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4ed4bdc1714e95aa941ef4a36fa381'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.321065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.321218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4ed4bdc1714e95aa941ef4a36fa381'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.326615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.326615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.326615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.326884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4ed4bdc1714e95aa941ef4a36fa381'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.327770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.331416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-becd2fae-3232-4ba0-98fa-82badfefe7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4ed4bdc1714e95aa941ef4a36fa381'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:40.339853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.370258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3455/6942] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:39 2022] DELETE /identity/v3/users/5f4ed4bdc1714e95aa941ef4a36fa381 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:40.375121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.378397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.378397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.453999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:40.457391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.489901 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3488/6943] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/users => generated 285 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:40.491931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.498474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.531330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec946-ba3c-4748-b8c3-391cddd709e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.673431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.674085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.674368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.674634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.675297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.681288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.715641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3489/6944] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:40.715641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.725400 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3456/6945] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:40.728955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:40.729130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:40.762968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6121ca-e3b2-422f-8def-20052037c45f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.767018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a2e84-1e9d-4f05-94e7-ed55e55e517f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:40.782390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.783886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.784163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.784446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] PATH_INFO: `/v3/projects/ce321885786e4f6aad62762aa05a9ae8/users/b5dbd67cbdad465098468a9c11007ad5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.785266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:40.786036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:40.786328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:40.786591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] PATH_INFO: `/v3/projects/6b50a796601a4dd7a314e515e19dd8cb` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:40.793950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b50a796601a4dd7a314e515e19dd8cb)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.795927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:40.812028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:40.812213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce321885786e4f6aad62762aa05a9ae8, user_id=b5dbd67cbdad465098468a9c11007ad5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:40.821458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:41.056058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3457/6946] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:40 2022] PUT /identity/v3/projects/ce321885786e4f6aad62762aa05a9ae8/users/b5dbd67cbdad465098468a9c11007ad5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:41.057148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:41.064455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:41.163434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b50a796601a4dd7a314e515e19dd8cb', 'request_id': 'req-353e146b-ab04-4e4e-93a4-ddeda3cb3110'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:41.184984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b50a796601a4dd7a314e515e19dd8cb', 'request_id': 'req-353e146b-ab04-4e4e-93a4-ddeda3cb3110'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:41.204859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b50a796601a4dd7a314e515e19dd8cb', 'request_id': 'req-353e146b-ab04-4e4e-93a4-ddeda3cb3110'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:41.303540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] The token cache is being invalidate because project 6b50a796601a4dd7a314e515e19dd8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:41.303808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:41.307703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:41.310783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3490/6947] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:40 2022] DELETE /identity/v3/projects/6b50a796601a4dd7a314e515e19dd8cb => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:41.310783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:41.319046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:41.337173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210cbf4-8bcf-4189-9e0a-0e3b4cca66bc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:41.338274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:41.461947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:41.462942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.463431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.463860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.466308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:41.570115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e146b-ab04-4e4e-93a4-ddeda3cb3110 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:41.584959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:41.585599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.585926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.586151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.586807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:41.588596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:41.601047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:41.606628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:41.627201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3491/6948] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:41.629080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:41.634917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:41.639394 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3458/6949] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:41.641446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:41.660438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:41.668924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b68cb-76c0-4ef2-84d6-393594bc05cc service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:41.673777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74633cc2-56e1-4d7f-8da3-90f7529d0b38 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:41.686895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:41.688542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.689206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.691362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] PATH_INFO: `/v3/projects/ce321885786e4f6aad62762aa05a9ae8/users/b5dbd67cbdad465098468a9c11007ad5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.695048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:41.695996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.696283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.696608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] PATH_INFO: `/v3/users/8ea6690199ae4200a8b87706a06197fd` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.697088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce321885786e4f6aad62762aa05a9ae8, user_id=b5dbd67cbdad465098468a9c11007ad5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:41.698263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea6690199ae4200a8b87706a06197fd)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:41.704472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:41.705899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd45c6-b4fe-48ec-bf5f-5f32eadb8008 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:41.734987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3459/6950] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:41 2022] PUT /identity/v3/projects/ce321885786e4f6aad62762aa05a9ae8/users/b5dbd67cbdad465098468a9c11007ad5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:41.736873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:41.737528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:41.737993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:41.774803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:41.804903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] MFA Rules not processed for user `b5dbd67cbdad465098468a9c11007ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:41.804903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.013091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3460/6951] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:42.029906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.033183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.053790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea6690199ae4200a8b87706a06197fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.135862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea6690199ae4200a8b87706a06197fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.161514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea6690199ae4200a8b87706a06197fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.181111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea6690199ae4200a8b87706a06197fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.183235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea6690199ae4200a8b87706a06197fd'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:42.201631 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3492/6952] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:41 2022] DELETE /identity/v3/users/8ea6690199ae4200a8b87706a06197fd => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:42.204879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67c956-fddc-4759-8e99-d0a83ba2afb5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.324685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.325188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.325644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.325966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.328515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.473041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:42.474123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:42.481717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:42.504970 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3461/6953] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:42.717777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.720035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.886137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657d39-b886-45e5-92b6-b265f55fb51c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.897133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.898373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.898930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.899075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.901617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.938201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:42.941011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:42.961466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a65b7-2692-4012-968d-29c80169ee9c service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:42.973408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:42.974188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:42.974594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:42.974972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:42.981539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:43.096622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.102675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.124221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3493/6954] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:43.157026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.162638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.176333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3462/6955] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:43.648627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:43.706926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.708645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:43.922301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:43.923946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:43.949375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68a719-fa52-4eda-9667-bd9624f87fbb service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.958242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.961662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.962173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.962597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] PATH_INFO: `/v3/projects/ec85550047b64522b160e22f69bdec50` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.964921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec85550047b64522b160e22f69bdec50)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.967624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:43.968172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fed1f-7c97-4a5b-8dd0-a2eb49751a7e service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:43.981028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:43.981809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:43.983565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:43.984103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] PATH_INFO: `/v3/projects/585cd942a62049b2b42a54db568118c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:43.990025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585cd942a62049b2b42a54db568118c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:43.999939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:44.059077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:44.205885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec85550047b64522b160e22f69bdec50', 'request_id': 'req-d8e787fa-07fa-480a-b184-6e6807a9ebd7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.235777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec85550047b64522b160e22f69bdec50', 'request_id': 'req-d8e787fa-07fa-480a-b184-6e6807a9ebd7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.245836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec85550047b64522b160e22f69bdec50', 'request_id': 'req-d8e787fa-07fa-480a-b184-6e6807a9ebd7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.286987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585cd942a62049b2b42a54db568118c1', 'request_id': 'req-a343a89a-b725-4ac6-8d7f-46c6e218c256'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.305185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585cd942a62049b2b42a54db568118c1', 'request_id': 'req-a343a89a-b725-4ac6-8d7f-46c6e218c256'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.382660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] The token cache is being invalidate because project ec85550047b64522b160e22f69bdec50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:44.382969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.383686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.388780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3494/6956] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:43 2022] DELETE /identity/v3/projects/ec85550047b64522b160e22f69bdec50 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:44.390715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:44.392480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:44.483960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585cd942a62049b2b42a54db568118c1', 'request_id': 'req-a343a89a-b725-4ac6-8d7f-46c6e218c256'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.510223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] The token cache is being invalidate because project 585cd942a62049b2b42a54db568118c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:44.510583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.513493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a343a89a-b725-4ac6-8d7f-46c6e218c256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:44.519089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3463/6957] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:43 2022] DELETE /identity/v3/projects/585cd942a62049b2b42a54db568118c1 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:44.521176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cd2d6-47f9-4ba7-bce3-57aa14afc279 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:44.521462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cd2d6-47f9-4ba7-bce3-57aa14afc279 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:44.521912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cd2d6-47f9-4ba7-bce3-57aa14afc279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:44.577697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-885cd2d6-47f9-4ba7-bce3-57aa14afc279 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:44.579964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-885cd2d6-47f9-4ba7-bce3-57aa14afc279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:44.616348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e787fa-07fa-480a-b184-6e6807a9ebd7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:44.728537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3464/6958] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:44.739173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:44.739173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:44.739173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:44.780137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:44.788169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:44.799448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:44.805799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:44.805799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:44.805799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] PATH_INFO: `/v3/users/7a35ba19f5b94741ba8d18ec292b65a8` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:44.805799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a35ba19f5b94741ba8d18ec292b65a8)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:44.807481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:44.808517 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3465/6959] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:44.813166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:44.832277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad755546-f36e-4ffb-98e4-0083ab8a7c5b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:44.850796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:44.851427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:44.851715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:44.863173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:44.863173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:44.863173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:44.863173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:44.880374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3466/6960] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:54:44.887995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:44.915721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d90aa-9bd0-4c95-a400-21d890876fe6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:44.937907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:44.937907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:44.937907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:44.937907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:44.938336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:44.938336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:45.116432 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3467/6961] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:44 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:45.120246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:45.178423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a35ba19f5b94741ba8d18ec292b65a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:45.249446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b524c-add4-41f0-8ca6-df83182c2471 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:45.264243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:45.267939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:45.272217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:45.272575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:45.273366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:45.278288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:45.284012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a35ba19f5b94741ba8d18ec292b65a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:45.314558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a35ba19f5b94741ba8d18ec292b65a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:45.344672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a35ba19f5b94741ba8d18ec292b65a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:45.347342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a35ba19f5b94741ba8d18ec292b65a8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:45.377802 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3495/6962] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:44 2022] DELETE /identity/v3/users/7a35ba19f5b94741ba8d18ec292b65a8 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:45.463029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3468/6963] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:45 2022] POST /identity/v3/users => generated 285 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:45.469646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:45.472071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:45.693973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:45.704519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250203-7527-4d9e-a64c-95bac886dc1a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:45.719970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:45.722231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:45.722947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:45.723528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:45.725579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:45.730849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:45.752010 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3496/6964] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:45.757877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:45.777390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be38d113-eb2e-48e1-be48-a40ed636c42d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:45.794824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:45.796219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:45.797566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:45.797905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:45.798662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:45.800941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163dd58-bd6c-422e-b8f7-2feeff071c6c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:45.830438 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3469/6965] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:45.842949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:45.859006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef56d78b-10da-4bbb-a40e-f939eef5cc44 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:45.880659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:45.881544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:45.882036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:45.882707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] PATH_INFO: `/v3/projects/945ec6b5f74544328179da5d27312b64/users/09d4d57d66904c348d42517555b48a22/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:45.903123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=945ec6b5f74544328179da5d27312b64, user_id=09d4d57d66904c348d42517555b48a22, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:45.907178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.003211 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3497/6966] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:45 2022] PUT /identity/v3/projects/945ec6b5f74544328179da5d27312b64/users/09d4d57d66904c348d42517555b48a22/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:46.037990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.038300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.041771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.150771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] MFA Rules not processed for user `09d4d57d66904c348d42517555b48a22`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:46.152303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:46.219133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:46.344719 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3470/6967] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:46.363206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.370040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:46.487995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.489856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:46.596418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9f658-faef-4665-8f82-a8279741b72d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.610122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.610765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.611048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.611328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.649141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.653811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.691517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029639e2-0c1d-42a7-bbc0-4805859eb1dd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.695139 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3498/6968] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:46.715693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.718998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.719485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.719904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] PATH_INFO: `/v3/projects/15be6aca034244cead8b2428c2d89391` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.721655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15be6aca034244cead8b2428c2d89391)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.723831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.725774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:46.747911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893c10b-9831-443d-8805-edd2e79917ee service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:46.772033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:46.775568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:46.775871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:46.776149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] PATH_INFO: `/v3/users/09d4d57d66904c348d42517555b48a22` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:46.778956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09d4d57d66904c348d42517555b48a22)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:46.787462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:46.969799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15be6aca034244cead8b2428c2d89391', 'request_id': 'req-ece79c3d-1ac0-48ad-8f13-ff025951b80f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:46.985999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15be6aca034244cead8b2428c2d89391', 'request_id': 'req-ece79c3d-1ac0-48ad-8f13-ff025951b80f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.106107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15be6aca034244cead8b2428c2d89391', 'request_id': 'req-ece79c3d-1ac0-48ad-8f13-ff025951b80f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.128315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] The token cache is being invalidate because project 15be6aca034244cead8b2428c2d89391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:47.129722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.131319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ece79c3d-1ac0-48ad-8f13-ff025951b80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.136833 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3471/6969] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:46 2022] DELETE /identity/v3/projects/15be6aca034244cead8b2428c2d89391 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:54:47.142979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09d4d57d66904c348d42517555b48a22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.153221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293e8c-8777-4286-a539-24ec65c30141 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.153221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293e8c-8777-4286-a539-24ec65c30141 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.153221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293e8c-8777-4286-a539-24ec65c30141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:47.190635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-43293e8c-8777-4286-a539-24ec65c30141 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:47.193452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-43293e8c-8777-4286-a539-24ec65c30141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:47.281911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09d4d57d66904c348d42517555b48a22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.306645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09d4d57d66904c348d42517555b48a22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.324410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09d4d57d66904c348d42517555b48a22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.325797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0f0f1672-6fe6-45c6-a287-f4fcbcc558d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09d4d57d66904c348d42517555b48a22'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:47.346599 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3499/6970] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:46 2022] DELETE /identity/v3/users/09d4d57d66904c348d42517555b48a22 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:47.353075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.353842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.354509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:47.410053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:47.411335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:47.411528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3472/6971] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:47.418107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.418565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.419059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:47.477113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:47.479179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:47.542483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3500/6972] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:47.601937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:47.604039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:47.645911 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3473/6973] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:47.651019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:47.695158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34ac0b-0440-475e-a0cf-09686154a6fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:47.704932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:47.724471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:47.725614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.726392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.726898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:47.727859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:47.728353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:47.730345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:47.766278 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3474/6974] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:47.771902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:47.819665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b14ad-d99b-439e-8c75-6d3ec1d4bb8f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:47.862895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:47.864730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.865016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.865286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:47.871981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:47.879169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:47.963174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bc31b-bf41-4d59-a4de-0f97884b3d0e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:47.982062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:47.984195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:47.985858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:47.988307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:48.024223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:48.029996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:48.101489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3501/6975] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:48.148113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3475/6976] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:47 2022] POST /identity/v3/projects => generated 365 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:48.153353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:48.170122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97231bb9-bb90-49be-b988-c0e6dd93f4b6 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:48.355718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:48.366502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:48.367627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:48.369703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:48.371085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:48.382271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:48.557578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3502/6977] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:48 2022] POST /identity/v3/users => generated 283 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:48.561903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:48.606446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a577ee4-db4d-4700-818c-68a3f118eb96 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:48.619854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:48.620409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:48.620715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:48.620986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:48.621677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:48.627928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:48.676841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3476/6978] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:48.681748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:48.699477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c838df-a138-4ef6-8c5d-c1ab5e8dc692 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:48.707199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:48.708099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:48.708530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:48.708870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:48.710014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:48.714118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2bb5d-263a-45d2-b22e-ad082991565b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:48.770893 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3503/6979] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:48.775151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:48.808895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34450a-3339-413f-921d-cb9d59b3cb2e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:48.833145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:48.835456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:48.835456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:48.835728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] PATH_INFO: `/v3/projects/849047dce5fd44518d789ccb81411f74/users/facf25da6b1b48fc8ca97a2514c3ffc1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:48.907015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=849047dce5fd44518d789ccb81411f74, user_id=facf25da6b1b48fc8ca97a2514c3ffc1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:48.910772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:49.133644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3477/6980] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:48 2022] PUT /identity/v3/projects/849047dce5fd44518d789ccb81411f74/users/facf25da6b1b48fc8ca97a2514c3ffc1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:49.144870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:49.145196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:49.145804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:49.275131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:49.295038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] MFA Rules not processed for user `facf25da6b1b48fc8ca97a2514c3ffc1`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:49.296665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:49.426566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:49.534874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3504/6981] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:49.535458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:49.748605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc1173-0377-4297-9e9c-10b741b7c64e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:49.768177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:49.769252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:49.769601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:49.770453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:49.773442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:49.779317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:49.978894 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3478/6982] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:49 2022] POST /identity/v3/projects => generated 365 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:49.979628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:49.979968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:49.980054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.017908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302d0eb-311b-49c7-8b40-7328f3587b7a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.154373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1148e-cc7d-462f-baf0-ac601f28178d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.157121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.158507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.159275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.159706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] PATH_INFO: `/v3/projects/945ec6b5f74544328179da5d27312b64` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.161792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=945ec6b5f74544328179da5d27312b64)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.165040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.181737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.182340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.182640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.182963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.183690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.190900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.288732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:50.372817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945ec6b5f74544328179da5d27312b64', 'request_id': 'req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:50.385621 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3479/6983] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:49 2022] POST /identity/v3/users => generated 289 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:50.404063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:50.410563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945ec6b5f74544328179da5d27312b64', 'request_id': 'req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:50.448576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629af283-bba9-4bbe-8878-caa3f4b7d159 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.451249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945ec6b5f74544328179da5d27312b64', 'request_id': 'req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:50.616371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] The token cache is being invalidate because project 945ec6b5f74544328179da5d27312b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:50.616371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:50.619477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4abe142d-423c-4d44-8ef5-2ba15b51c0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:50.621892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3505/6984] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:49 2022] DELETE /identity/v3/projects/945ec6b5f74544328179da5d27312b64 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:50.628331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034f14-1f67-4d2f-91a5-3dfa1414c53d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.628832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034f14-1f67-4d2f-91a5-3dfa1414c53d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.629410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48034f14-1f67-4d2f-91a5-3dfa1414c53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.645337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.646482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.646861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.647240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.648041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.649902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.670576 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3480/6985] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:50.677175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:50.683145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.712839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-48034f14-1f67-4d2f-91a5-3dfa1414c53d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:50.714939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-48034f14-1f67-4d2f-91a5-3dfa1414c53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.718313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235b3d-77e5-4263-a126-ebd270b490f2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.739388 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3506/6986] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:50.741839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.742740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.743120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.743489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] PATH_INFO: `/v3/projects/2495b69f457e4c6d890b6101266bb182/users/28d5bd6885c341a6b695816031461cbe/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.749230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.763881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.763881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.784061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:50.785708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:50.786648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2495b69f457e4c6d890b6101266bb182, user_id=28d5bd6885c341a6b695816031461cbe, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.795483 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3507/6987] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:50.797544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.800776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:50.832521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715e78a-283a-4000-9dc2-4fb7ee41b8cd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.842112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.843241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.843721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.844196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.845101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:54:50.845628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.847752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:50.877849 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3508/6988] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:54:50.882489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:50.893655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ce4fa-dab4-4634-bae5-823973abb2a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:50.901991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:50.902709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:50.903156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:50.903698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:50.904412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:50.907107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.151962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3481/6989] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:50 2022] PUT /identity/v3/projects/2495b69f457e4c6d890b6101266bb182/users/28d5bd6885c341a6b695816031461cbe/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:51.151962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.232521 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3509/6990] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:54:50 2022] POST /identity/v3/projects => generated 377 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:51.233681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.277760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5695e9-0c3c-4d6c-9753-2a7bb8336dac admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.446573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.447192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.447671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.448105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.449343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.449475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34ce76-d3da-4c6f-a73c-a9979e2cd05b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.451346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.462319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.464873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.465028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.465267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.466087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.472364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.479801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3482/6991] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:51.483434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.508520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81fb3a-84e8-4af3-8c18-66375ca1ef41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.526572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.527651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.528125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.528628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] PATH_INFO: `/v3/projects/2495b69f457e4c6d890b6101266bb182/users/28d5bd6885c341a6b695816031461cbe/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.533127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2495b69f457e4c6d890b6101266bb182, user_id=28d5bd6885c341a6b695816031461cbe, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.539645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5266a6aa-a2f2-45b2-87b5-e3ddc13358c5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.562188 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3483/6992] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:51 2022] PUT /identity/v3/projects/2495b69f457e4c6d890b6101266bb182/users/28d5bd6885c341a6b695816031461cbe/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:51.576393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.576703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.576978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.603010 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3510/6993] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:54:51 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:54:51.609954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.637300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fccc1-c24e-4347-b983-e468d4a27215 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.652880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] MFA Rules not processed for user `28d5bd6885c341a6b695816031461cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:51.657185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:51.787891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.788717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.788993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.789265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.790978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.795537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.819610 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3484/6994] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:51.832662 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3511/6995] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:51.836793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.837124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.839789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:51.852372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98825a30-528b-484d-8d7f-e2f9dcc5d099 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.865727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.870092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.870092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.870681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.871825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.878734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:51.912282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3485/6996] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:54:51.920641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:51.939053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20d5d-d2d0-4dc4-9589-0ae57493a040 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.954008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.957402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.957904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.959323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801daee-c8fc-4dd5-abee-621eae358161 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:51.959700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] PATH_INFO: `/v3/projects/ba5d685edb1c4561b8d519ed80128dba/users/d69a96c41e8044cbb4cc311c3d5732e0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.966153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:51.966773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:51.967049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:51.967319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:51.983969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:51.993037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff791-15aa-4bad-b5e0-a4c1b05fa2c1 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:52.009965 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3512/6997] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:52.017496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5d685edb1c4561b8d519ed80128dba, user_id=d69a96c41e8044cbb4cc311c3d5732e0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:52.025628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:52.143247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3486/6998] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:54:51 2022] PUT /identity/v3/projects/ba5d685edb1c4561b8d519ed80128dba/users/d69a96c41e8044cbb4cc311c3d5732e0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:52.160861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:52.164541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:52.164858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:52.165201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:52.233175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] MFA Rules not processed for user `d69a96c41e8044cbb4cc311c3d5732e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:52.236368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:52.316269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:52.416755 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3513/6999] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:54:52.497591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773556d1-ef22-406a-abc5-1936279ef920 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:52.509137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:52.509652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:52.509931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:52.510391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:52.518666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:52.556673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:52.558330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:52.584620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282692ad-3c17-437a-b3a2-cfff67b21d24 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:52.589856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:52.591461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:52.591851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:52.593492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:52.623314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:52.628123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:52.632673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:52.634521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:52.646385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3514/7000] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:52.678854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3487/7001] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:54:53.246960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:55.043879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:56.438217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:54:56.742020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:56.746266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:56.879636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:56.881815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:56.958803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359de36-d273-4da6-bb31-7585b025904a service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:56.993683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:56.995169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:56.995740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:56.996436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:57.006819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:57.132841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71144d2-2603-4476-b290-851e451d3a3b service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:57.159799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:57.160870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:57.161425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:57.161942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] PATH_INFO: `/v3/users/aae5e6dae6dc4ca4a1f156c32a3d7b4a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:57.164782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae5e6dae6dc4ca4a1f156c32a3d7b4a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:57.172726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:57.207963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:57.212537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc923b0-bb73-4453-bd9f-590ad1330b8a service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:57.237264 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3515/7002] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:54:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:54:57.832686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae5e6dae6dc4ca4a1f156c32a3d7b4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.117215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae5e6dae6dc4ca4a1f156c32a3d7b4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.153651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae5e6dae6dc4ca4a1f156c32a3d7b4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.154982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae5e6dae6dc4ca4a1f156c32a3d7b4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.155803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae5e6dae6dc4ca4a1f156c32a3d7b4a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:58.172457 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3488/7003] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:56 2022] DELETE /identity/v3/users/aae5e6dae6dc4ca4a1f156c32a3d7b4a => generated 0 bytes in 1293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:58.177271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.177742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.179323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.205253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:54:58.206502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.302006 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3516/7004] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:54:58.309924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:58.311559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:58.405924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e239c-2f89-4b37-aa5b-4eb01ccb21cd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:58.413486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:58.414164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:58.414540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:58.414905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:58.427572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:58.429140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:58.460789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3489/7005] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:54:59.023464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.025424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:54:59.065546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210de1f7-a2d7-4630-8176-a98bb7722773 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.099364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.099364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.099364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.099364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] PATH_INFO: `/v3/projects/4dd0ba2781b444bfa96a5c7141ed3671` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.102281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd0ba2781b444bfa96a5c7141ed3671)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.102281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:54:59.431491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd0ba2781b444bfa96a5c7141ed3671', 'request_id': 'req-16667660-354e-48e6-91f9-fc8e557a4420'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:59.439863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd0ba2781b444bfa96a5c7141ed3671', 'request_id': 'req-16667660-354e-48e6-91f9-fc8e557a4420'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:59.452679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd0ba2781b444bfa96a5c7141ed3671', 'request_id': 'req-16667660-354e-48e6-91f9-fc8e557a4420'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:59.676516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] The token cache is being invalidate because project 4dd0ba2781b444bfa96a5c7141ed3671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:54:59.678147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:59.678901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:54:59.683926 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3517/7006] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:54:59 2022] DELETE /identity/v3/projects/4dd0ba2781b444bfa96a5c7141ed3671 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:54:59.690269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:54:59.703649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4da259-9034-49c9-9e8f-0bfea67acefc service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:54:59.788557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:54:59.789681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:54:59.789962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:54:59.790243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] PATH_INFO: `/v3/users/1eb137143c7f4991a72727319a0020a1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:54:59.791530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb137143c7f4991a72727319a0020a1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:54:59.793553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:00.118696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:00.168161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb137143c7f4991a72727319a0020a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:00.283237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb137143c7f4991a72727319a0020a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:00.316369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb137143c7f4991a72727319a0020a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:00.318779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb137143c7f4991a72727319a0020a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:00.320835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42a8a9eb-2713-4391-8016-e2edca414651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb137143c7f4991a72727319a0020a1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:00.395989 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3490/7007] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:54:59 2022] DELETE /identity/v3/users/1eb137143c7f4991a72727319a0020a1 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:01.672356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:03.220767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:03.384176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:03.387275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:03.426100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16667660-354e-48e6-91f9-fc8e557a4420 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:03.776728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:03.778589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:03.779996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:03.782675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] PATH_INFO: `/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:03.787459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdfb7e3e5f5445eaa5ebb7688390c7b0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:03.800562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:03.854516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:04.198472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdfb7e3e5f5445eaa5ebb7688390c7b0', 'request_id': 'req-5ccad41a-610a-4b5e-8593-1ab0eea4e616'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.240953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdfb7e3e5f5445eaa5ebb7688390c7b0', 'request_id': 'req-5ccad41a-610a-4b5e-8593-1ab0eea4e616'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.256437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdfb7e3e5f5445eaa5ebb7688390c7b0', 'request_id': 'req-5ccad41a-610a-4b5e-8593-1ab0eea4e616'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.393587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] The token cache is being invalidate because project cdfb7e3e5f5445eaa5ebb7688390c7b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:04.394590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.400897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5ccad41a-610a-4b5e-8593-1ab0eea4e616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:04.416804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3518/7008] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:03 2022] DELETE /identity/v3/projects/cdfb7e3e5f5445eaa5ebb7688390c7b0 => generated 0 bytes in 1027 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:04.419485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:04.420365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:04.421106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:04.572004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:04.651905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:04.659464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.050673 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3491/7009] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:05.060004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.060286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.061440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.138082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:05.141863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:05.146936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:05.178064 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3519/7010] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:05.178995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.196467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d38018-41db-496c-ba41-4841aad2c59b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.228887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.230817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.234566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.235940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.238517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:05.244825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.247390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.294968 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3492/7011] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:05.299566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.314208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241990ae-4bd6-4324-9a5e-8822510a6def None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.353501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.354155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.354433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.354739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.355392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.357782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:05.569352 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3520/7012] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:05.574541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:05.596924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d04f00-bb78-4f80-b478-d0433a31bb36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:05.825919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:05.832097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:05.832673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:05.833801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:05.834683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:05.843126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.019639 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3493/7013] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:05 2022] POST /identity/v3/users => generated 288 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:06.039674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.064260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982dd4-a257-4307-ad91-d4e4e1460888 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.098284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.099826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.100295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.101169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.103725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.104741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.126545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:06.141299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3521/7014] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:06.143006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.157599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d4fedf-2004-4bdd-8557-a019f46cab46 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.188525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.190396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.190916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.192110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.193194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.203421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329b14b7-7376-4486-a706-a82b8f3bb810 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.220440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:06.329619 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3494/7015] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:06.332769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:06.363790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22ad73-be38-41b4-b41a-cb8b7af299b9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:06.403769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:06.416940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.420270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.421463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] PATH_INFO: `/v3/projects/5340fac0485940499d0a0e647871e557/users/2e68af718b814d97b55b8fff4daff325/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.561934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5340fac0485940499d0a0e647871e557, user_id=2e68af718b814d97b55b8fff4daff325, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:06.584343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:06.741328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:06.769820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:06.770433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:06.771058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:06.785173 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3522/7016] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:06 2022] PUT /identity/v3/projects/5340fac0485940499d0a0e647871e557/users/2e68af718b814d97b55b8fff4daff325/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:06.920024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] MFA Rules not processed for user `2e68af718b814d97b55b8fff4daff325`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:06.924549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:07.010869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:07.245070 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3495/7017] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:07.251855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:07.267692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.582336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2014b-4273-42d7-8791-cf9ea0c78d31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.612297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:07.619378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:07.620354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:07.620827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:07.631695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:07.636542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:07.805821 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3523/7018] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/projects => generated 377 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:07.808128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:07.825557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c4c68-22b1-4e69-a5ec-4e01beab534b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:07.951948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:08.041808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:08.042745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:08.043424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:08.043860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:08.044831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:08.047654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:08.191458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:08.191947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3496/7019] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:07 2022] POST /identity/v3/users => generated 295 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:08.231940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83f334-fe6e-45a0-836d-9edb2675ce6d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:08.269337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:08.271335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:08.278011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:08.278011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:08.279193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:08.282475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:08.367274 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3524/7020] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:08.368274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:08.416513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686bc4d-605a-4919-ac49-b58e6de643bd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:08.458172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:08.468411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:08.468411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:08.468411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] PATH_INFO: `/v3/projects/39f7d1d90b134583b6e57cb34b545b73/users/2b7034215fd1488a98150974d30926b5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:08.567106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f7d1d90b134583b6e57cb34b545b73, user_id=2b7034215fd1488a98150974d30926b5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:08.588906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:08.612419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:08.804581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3497/7021] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:08 2022] PUT /identity/v3/projects/39f7d1d90b134583b6e57cb34b545b73/users/2b7034215fd1488a98150974d30926b5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:08.809697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:08.887558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d631578-3cb4-468a-8608-8f92eb83c1b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:09.085177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:09.090121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.090702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.091201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.108959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:09.121945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062823e2-6ff7-4160-bc7e-8438bf577c8d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:09.178312 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3525/7022] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:09.179983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:09.252859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a1bff-e46f-4465-b28f-093de4f954b1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:09.291897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:09.302813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:09.304733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.305594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.306642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] PATH_INFO: `/v3/projects/39f7d1d90b134583b6e57cb34b545b73/users/2b7034215fd1488a98150974d30926b5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.318434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f7d1d90b134583b6e57cb34b545b73, user_id=2b7034215fd1488a98150974d30926b5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:09.347262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:09.391512 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3498/7023] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:09 2022] PUT /identity/v3/projects/39f7d1d90b134583b6e57cb34b545b73/users/2b7034215fd1488a98150974d30926b5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:09.419567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:09.422416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:09.423009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:09.604639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] MFA Rules not processed for user `2b7034215fd1488a98150974d30926b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:09.613845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:09.951812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:10.190382 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3526/7024] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 776 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:10.215854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:10.219171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:10.500279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b38ce7-c393-49d8-8e64-b26f3ba9946e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:10.511557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:10.514676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:10.514676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:10.515018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:10.550297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:10.561579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:10.603235 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3499/7025] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:10.726558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:11.709324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:12.692346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:13.299584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:14.179658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:15.160521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:15.430463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:16.019457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:16.107057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:16.456173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:16.970954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:18.064763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:19.630306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:19.864122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:19.872090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:20.085784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ee4cb-b481-4dfc-ba30-2a7689d6bc85 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:20.107028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:20.107674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:20.107950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:20.108216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:20.123454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:20.311117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:20.317800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb5204-a391-4b09-8d16-22e2eb6f8665 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:20.319861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:20.337348 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3527/7026] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 12:55:22.682351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:22.709541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:22.713937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:22.817177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f468d3-ea05-4617-9e59-0e6838e0b12c service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:22.822553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:22.823343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:22.824334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:22.824334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] PATH_INFO: `/v3/users/12e14ff08ea84c95bdafd89bd79083a0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:22.825604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e14ff08ea84c95bdafd89bd79083a0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:22.827679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:23.048332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:23.148923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e14ff08ea84c95bdafd89bd79083a0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:23.249253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e14ff08ea84c95bdafd89bd79083a0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:23.313231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e14ff08ea84c95bdafd89bd79083a0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:23.314282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e14ff08ea84c95bdafd89bd79083a0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:23.315103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e14ff08ea84c95bdafd89bd79083a0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:23.342180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3500/7027] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:22 2022] DELETE /identity/v3/users/12e14ff08ea84c95bdafd89bd79083a0 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:23.347137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:23.347499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:23.347797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:23.393928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:23.395746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:23.617827 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3528/7028] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:23.636251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:23.636251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:23.909745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf75d8-cafa-44b4-a403-37d8548dcaab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:23.929952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:23.933692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:23.935001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:23.935465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:23.974932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:23.979719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7427d5-6ad2-4d32-b35d-42418285760a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:24.030503 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3501/7029] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:24.819185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:24.821469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:24.860783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2790a5-c43f-47f2-84cf-70a2f29587bd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:24.916626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:24.921603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:24.927763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:24.927763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:24.927763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] PATH_INFO: `/v3/projects/7d3e207adaab4614babb8fb6e2c10f77` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:24.929024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3e207adaab4614babb8fb6e2c10f77)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:24.935102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:25.276820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3e207adaab4614babb8fb6e2c10f77', 'request_id': 'req-37b648e5-a2e4-4e4a-afc1-f8da09141288'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:25.289661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3e207adaab4614babb8fb6e2c10f77', 'request_id': 'req-37b648e5-a2e4-4e4a-afc1-f8da09141288'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:25.297778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3e207adaab4614babb8fb6e2c10f77', 'request_id': 'req-37b648e5-a2e4-4e4a-afc1-f8da09141288'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:25.523771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] The token cache is being invalidate because project 7d3e207adaab4614babb8fb6e2c10f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:25.524479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:25.525557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-37b648e5-a2e4-4e4a-afc1-f8da09141288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:25.537474 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3529/7030] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:24 2022] DELETE /identity/v3/projects/7d3e207adaab4614babb8fb6e2c10f77 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:25.539450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:25.540067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:25.541495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:25.622114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:25.622114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:25.802164 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3502/7031] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:25.815703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:25.815703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:25.815922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:25.881192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:25.884565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:25.924898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3530/7032] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:25.937412 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:25.955457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb84af-20db-4791-881b-fb2d5500c9f1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:25.961917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:25.962571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:25.962853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:25.963129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:25.963792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:25.964101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:25.982647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:26.011917 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3503/7033] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:26.020888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:26.038321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5a6fc-b236-4b68-ad29-baddf052f4d5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:26.085858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:26.087326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:26.092828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:26.093346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:26.095935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:26.098700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:26.239344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:26.387994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3531/7034] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:26 2022] POST /identity/v3/projects => generated 369 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:26.391796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:26.411673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f679539-9f27-4c3c-8501-d516caa79f1d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:26.630560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:26.630560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:26.630560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:26.630560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:26.631068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:26.634212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:26.861702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3504/7035] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:26 2022] POST /identity/v3/users => generated 285 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:26.866094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:26.886314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88651c-ed38-4a93-9a2a-0b39694e7d99 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:26.895372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:26.895852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:26.896136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:26.896451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:26.897155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:26.898834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:26.916250 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3532/7036] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:26.921968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:26.955558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5dcf6-5005-4141-bb05-862e0f8bc37c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:26.976062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:26.978273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:26.980046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:26.980433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:26.981506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:26.988532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9625d-e528-40fc-89d8-f50941ddf8e1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:27.017854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3505/7037] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:27.018391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:27.045334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c9c4-8b9d-4034-818d-5c519fa0e933 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:27.080018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:27.080984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:27.085218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:27.089602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] PATH_INFO: `/v3/projects/069498e1692a4682a013d9b732f3563a/users/a18f6ff73b524a6f86cf8a792ada2f7d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:27.153693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069498e1692a4682a013d9b732f3563a, user_id=a18f6ff73b524a6f86cf8a792ada2f7d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:27.155610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:27.167783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:27.335250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:27.335672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:27.335980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:27.341519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3533/7038] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:27 2022] PUT /identity/v3/projects/069498e1692a4682a013d9b732f3563a/users/a18f6ff73b524a6f86cf8a792ada2f7d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:27.424102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] MFA Rules not processed for user `a18f6ff73b524a6f86cf8a792ada2f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:27.428906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:27.632355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3506/7039] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:27.647096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:27.661752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:27.807142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de007977-cca1-40e9-9649-afd21011f729 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:27.818607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:27.819554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:27.820934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:27.821408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:27.857944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:27.862886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:27.879539 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3534/7040] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:31.123081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:31.863117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:33.050030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:33.052666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:33.369251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34476c7b-409d-4baa-98b9-801eeb8fbdc6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:33.392735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7034215fd1488a98150974d30926b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f7d1d90b134583b6e57cb34b545b73', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:33.397543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:33.401775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:33.403125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:33.406091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:33.412460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:33.415956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:33.485778 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3507/7041] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:33.486561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:33.542641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45640b-559e-4305-b7f5-bb9696e85379 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:33.559782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7034215fd1488a98150974d30926b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f7d1d90b134583b6e57cb34b545b73', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:33.560429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:33.560732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:33.561010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:33.561671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:33.563717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:33.815937 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3535/7042] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:33 2022] POST /identity/v3/projects => generated 349 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:33.821745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:33.883764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a37a5d-7d27-42b0-969c-7ad5747a2c38 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:34.101233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:34.150700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7034215fd1488a98150974d30926b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f7d1d90b134583b6e57cb34b545b73', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:34.151460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:34.151843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:34.152306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:34.153135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:34.153720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:34.157563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d4b75-f1ec-4096-b00d-cf501613fe3b tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:34.184723 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3508/7043] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:34.347830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:34.351175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:34.561799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef0e12-1d32-4670-8861-3c0403f24f9d tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:34.570655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:34.570655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:34.570655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:34.570655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] PATH_INFO: `/v3/users/1529368b1a364825991e46ec9e0cb595` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:34.573432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1529368b1a364825991e46ec9e0cb595)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:34.577024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:34.929253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:34.968300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1529368b1a364825991e46ec9e0cb595'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.069883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1529368b1a364825991e46ec9e0cb595'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.101829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1529368b1a364825991e46ec9e0cb595'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.144848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1529368b1a364825991e46ec9e0cb595'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.145836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1529368b1a364825991e46ec9e0cb595'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:35.162765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3536/7044] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:34 2022] DELETE /identity/v3/users/1529368b1a364825991e46ec9e0cb595 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:35.167784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:35.168885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:35.169024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:35.206673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:35.207879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:35.363932 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3509/7045] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:35.379483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:35.381781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:35.572142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b4adb-c866-4f3b-9a86-6e6dda761d96 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:35.592134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:35.593875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:35.594409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:35.594972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:35.618831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:35.674737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:35.734917 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3537/7046] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:36.154020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:36.161322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:36.201929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:36.345692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c32d3-e6ba-4db1-a2e7-78ae26b108b6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:36.360910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b7034215fd1488a98150974d30926b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39f7d1d90b134583b6e57cb34b545b73', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:36.361740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:36.362219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:36.364463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] PATH_INFO: `/v3/projects/ec3c8d0ff0c34f3ea9738b43196f1463` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:36.364643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ec3c8d0ff0c34f3ea9738b43196f1463)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:36.371464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:36.658101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3c8d0ff0c34f3ea9738b43196f1463', 'request_id': 'req-f00d6a7b-34a7-414c-8185-8968550b0aa3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.663188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:36.675028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3c8d0ff0c34f3ea9738b43196f1463', 'request_id': 'req-f00d6a7b-34a7-414c-8185-8968550b0aa3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.825714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3c8d0ff0c34f3ea9738b43196f1463', 'request_id': 'req-f00d6a7b-34a7-414c-8185-8968550b0aa3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.862365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] The token cache is being invalidate because project ec3c8d0ff0c34f3ea9738b43196f1463 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:36.863934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.867704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:36.867704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3510/7047] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:36 2022] DELETE /identity/v3/projects/ec3c8d0ff0c34f3ea9738b43196f1463 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:37.047842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.054612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.104929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdff0-92b0-498e-aff5-380dd6369840 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.299457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.300939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.301333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.301707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.306843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.544142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:37.547747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:37.555809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.561784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:37.577862 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3538/7048] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:37.786741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d6a7b-34a7-414c-8185-8968550b0aa3 tempest-RoutersIpV6AdminTest-1235591496 tempest-RoutersIpV6AdminTest-1235591496-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:37.814500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:37.819498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:37.819814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:37.820224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] PATH_INFO: `/v3/projects/90e57775e2724b8790628e65aa95d248` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:37.826831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e57775e2724b8790628e65aa95d248)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:37.828978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.041547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e57775e2724b8790628e65aa95d248', 'request_id': 'req-1ff64981-8418-4704-9bac-28c5386cd951'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.056154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e57775e2724b8790628e65aa95d248', 'request_id': 'req-1ff64981-8418-4704-9bac-28c5386cd951'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.228294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e57775e2724b8790628e65aa95d248', 'request_id': 'req-1ff64981-8418-4704-9bac-28c5386cd951'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.306606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] The token cache is being invalidate because project 90e57775e2724b8790628e65aa95d248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:38.307358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.315275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.319205 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3511/7049] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:37 2022] DELETE /identity/v3/projects/90e57775e2724b8790628e65aa95d248 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:38.335805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:38.351346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896aac0d-e88d-4db3-8294-2cac92c3de2e service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:38.456298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:38.457013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:38.457391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:38.457669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] PATH_INFO: `/v3/users/b5dbd67cbdad465098468a9c11007ad5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:38.459186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5dbd67cbdad465098468a9c11007ad5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:38.461798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:38.809894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5dbd67cbdad465098468a9c11007ad5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:38.903868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:38.973025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5dbd67cbdad465098468a9c11007ad5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:39.009359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5dbd67cbdad465098468a9c11007ad5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:39.023922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5dbd67cbdad465098468a9c11007ad5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:39.026107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a40bb373-9e51-4ab7-82a6-df3cfc2ecdb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5dbd67cbdad465098468a9c11007ad5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:39.065275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3539/7050] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:38 2022] DELETE /identity/v3/users/b5dbd67cbdad465098468a9c11007ad5 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:39.268781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:40.177860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:41.561187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:41.563972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:41.580392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff64981-8418-4704-9bac-28c5386cd951 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:41.631926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:41.686540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:41.687419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:41.687921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:41.688369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] PATH_INFO: `/v3/projects/ce321885786e4f6aad62762aa05a9ae8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:41.693756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce321885786e4f6aad62762aa05a9ae8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:41.704622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:41.996003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce321885786e4f6aad62762aa05a9ae8', 'request_id': 'req-e1bf0461-80c3-4e07-9678-e427cd20080f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:42.024677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce321885786e4f6aad62762aa05a9ae8', 'request_id': 'req-e1bf0461-80c3-4e07-9678-e427cd20080f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:42.148569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce321885786e4f6aad62762aa05a9ae8', 'request_id': 'req-e1bf0461-80c3-4e07-9678-e427cd20080f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:42.177493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] The token cache is being invalidate because project ce321885786e4f6aad62762aa05a9ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:42.177900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:42.181083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1bf0461-80c3-4e07-9678-e427cd20080f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:42.187271 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3512/7051] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:41 2022] DELETE /identity/v3/projects/ce321885786e4f6aad62762aa05a9ae8 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:42.194180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:42.194778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:42.194778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:42.245784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:42.249002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:42.336164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:42.418151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:42.418431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:42.418722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:42.427392 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3540/7052] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:42.461293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:42.470224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:42.483070 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3513/7053] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:42.487384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:42.503351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38a983-4c0f-4143-9917-0ac7af7198db None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:42.509845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:42.510750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:42.511877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:42.512294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:42.513252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:42.513711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:42.517432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:42.540843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:42.546345 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3541/7054] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:55:42.554357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d484d-9631-41f2-9600-53bfd4d62535 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:42.561936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:42.562636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:42.562898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:42.563220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:42.564248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:42.566778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:42.727007 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3514/7055] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:42 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:42.727266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:42.742083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9585c5a-7b7c-4a0e-8346-09f26be97ccf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:42.949375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:42.950023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:42.950498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:42.950781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:42.955941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:42.958116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:43.073863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3542/7056] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:42 2022] POST /identity/v3/users => generated 293 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:43.075476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:43.095746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571341-ba45-4962-a843-c9907ee659eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:43.109469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:43.113449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:43.114097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:43.114580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:43.116860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:43.125764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:43.154118 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3515/7057] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:43.158560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:43.179195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802ebd-3c2b-4014-8b1a-d9c5eded9c79 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:43.199867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:43.201510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:43.202110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:43.202705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:43.203978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:43.209828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a223b-1db5-4e3b-a29b-87c3f03887f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:43.211617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:43.239352 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3543/7058] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:43.241302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:43.258905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c5f6ab-05a4-4be9-ada5-cb969d8f6bfe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:43.278731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:43.279590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:43.282614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:43.283113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] PATH_INFO: `/v3/projects/bdf09670204e4ba785c97723cd11d800/users/9872f1098c244eda940f1dbc8f66d9cd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:43.329271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf09670204e4ba785c97723cd11d800, user_id=9872f1098c244eda940f1dbc8f66d9cd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:43.333137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:43.500008 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3516/7059] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:43 2022] PUT /identity/v3/projects/bdf09670204e4ba785c97723cd11d800/users/9872f1098c244eda940f1dbc8f66d9cd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:43.511557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:43.512593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:43.513351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:43.649658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] MFA Rules not processed for user `9872f1098c244eda940f1dbc8f66d9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:43.668699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:43.772381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:43.922280 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3544/7060] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:43.936242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:44.122844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a907-7170-4519-872e-94f3c2ae4b04 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:44.128989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:44.130082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:44.130421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:44.130748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:44.131643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:44.133798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:44.314465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3517/7061] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:43 2022] POST /identity/v3/projects => generated 385 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:44.319018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:44.407182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13535a-78d0-4daf-af58-f3af716f7c4f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:44.615071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:44.615810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:44.616179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:44.616580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:44.617338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:44.623082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:44.749897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3545/7062] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:44 2022] POST /identity/v3/users => generated 299 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:44.753842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:44.772840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fe37c-25cb-4b86-8c2a-68cdc930bcfc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:44.785702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:44.786650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:44.787087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:44.787513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:44.788363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:44.790431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:44.822779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:44.823776 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3518/7063] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:44.840083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:44.843382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dcd3d-11cf-4f1e-8026-7f6aec61501d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:44.867648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:44.875802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:44.876271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:44.876818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] PATH_INFO: `/v3/projects/6fe2888702f84bd3a1e8118e28c7413d/users/3361fd9ad2da449086c5be660456a883/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:44.939442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe2888702f84bd3a1e8118e28c7413d, user_id=3361fd9ad2da449086c5be660456a883, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:44.941607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:45.052061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:45.067160 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3546/7064] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:44 2022] PUT /identity/v3/projects/6fe2888702f84bd3a1e8118e28c7413d/users/3361fd9ad2da449086c5be660456a883/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:45.068349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:45.087759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96ed02-636e-46aa-9116-49bc63fb7c97 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:45.368723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:45.369854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:45.370946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:45.377522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:45.377522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:45.381820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ca487-c0b6-4e44-84ca-f9eb95f76357 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:45.445598 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3519/7065] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:55:45.455520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:45.480934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60610abf-be2f-4a2e-91ec-9af5f9a4e5d1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:45.499943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:45.503287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:45.503806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:45.504377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] PATH_INFO: `/v3/projects/6fe2888702f84bd3a1e8118e28c7413d/users/3361fd9ad2da449086c5be660456a883/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:45.510220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe2888702f84bd3a1e8118e28c7413d, user_id=3361fd9ad2da449086c5be660456a883, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:45.535675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:45.591558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3547/7066] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:45 2022] PUT /identity/v3/projects/6fe2888702f84bd3a1e8118e28c7413d/users/3361fd9ad2da449086c5be660456a883/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:45.608427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c759-edba-405c-904c-536dfd3f094b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:45.609053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c759-edba-405c-904c-536dfd3f094b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:45.609348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080c759-edba-405c-904c-536dfd3f094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:45.692515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1080c759-edba-405c-904c-536dfd3f094b None None] MFA Rules not processed for user `3361fd9ad2da449086c5be660456a883`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:45.694964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1080c759-edba-405c-904c-536dfd3f094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:45.975893 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3520/7067] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:46.002966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:46.005518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:46.270653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f48aa6-1101-4fcf-88a4-d9443e0ebd4d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:46.286027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:46.286685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:46.286955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:46.287411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:46.320711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:46.321450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f590c-73a4-4168-9d73-863df661b88a service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:46.345472 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3548/7068] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:46.495737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:46.508928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c759-edba-405c-904c-536dfd3f094b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:46.677754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:46.822333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080c759-edba-405c-904c-536dfd3f094b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:46.836144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:46.836144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:46.836144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:46.836144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] PATH_INFO: `/v3/users/9872f1098c244eda940f1dbc8f66d9cd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:46.844679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9872f1098c244eda940f1dbc8f66d9cd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:46.846804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:47.217148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9872f1098c244eda940f1dbc8f66d9cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:47.315389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9872f1098c244eda940f1dbc8f66d9cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:47.340413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9872f1098c244eda940f1dbc8f66d9cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:47.342198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9872f1098c244eda940f1dbc8f66d9cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:47.342948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9872f1098c244eda940f1dbc8f66d9cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:47.381578 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3521/7069] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:46 2022] DELETE /identity/v3/users/9872f1098c244eda940f1dbc8f66d9cd => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:47.387015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:47.387865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:47.388563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:47.428214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:47.431903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:47.614739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3549/7070] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:47.663147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:47.664653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:47.825849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582f1ca-d2f0-48b4-a690-555af7fd8488 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:47.859126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:47.859779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:47.860059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:47.860346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:47.973226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:47.983772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:48.054106 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3522/7071] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:48.073670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:48.109789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:48.788157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:49.356018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:50.314968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:50.316920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:50.333502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc350f-67f8-45a5-84da-f6a6373abed7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:50.339992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:50.340705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:50.340984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:50.341254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] PATH_INFO: `/v3/projects/bdf09670204e4ba785c97723cd11d800` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:50.342535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf09670204e4ba785c97723cd11d800)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:50.344632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:50.581207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf09670204e4ba785c97723cd11d800', 'request_id': 'req-b1be707c-042a-4332-932c-e1088fcdfacf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:50.604232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf09670204e4ba785c97723cd11d800', 'request_id': 'req-b1be707c-042a-4332-932c-e1088fcdfacf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:50.612896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf09670204e4ba785c97723cd11d800', 'request_id': 'req-b1be707c-042a-4332-932c-e1088fcdfacf'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:50.729484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] The token cache is being invalidate because project bdf09670204e4ba785c97723cd11d800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:50.730018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:50.731961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:50.735798 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3550/7072] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:50 2022] DELETE /identity/v3/projects/bdf09670204e4ba785c97723cd11d800 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:50.740153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:50.759184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b443-d0b3-46db-8dc7-928a1b73521a service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:50.948480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:50.949599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:50.949599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:50.949885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] PATH_INFO: `/v3/users/3361fd9ad2da449086c5be660456a883` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:50.952046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3361fd9ad2da449086c5be660456a883)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:50.954257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:51.073843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:51.245815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:51.250840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3361fd9ad2da449086c5be660456a883'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:51.353087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3361fd9ad2da449086c5be660456a883'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:51.377158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3361fd9ad2da449086c5be660456a883'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:51.381033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3361fd9ad2da449086c5be660456a883'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:51.382026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8b7435f5-4867-4257-9789-68cab30c59bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3361fd9ad2da449086c5be660456a883'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:51.422961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3523/7073] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:50 2022] DELETE /identity/v3/users/3361fd9ad2da449086c5be660456a883 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:52.006628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:52.008684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:52.039386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be707c-042a-4332-932c-e1088fcdfacf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:52.227170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:52.228931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:52.229439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:52.232139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] PATH_INFO: `/v3/users/149dc2cb594c45198b1a146e44c1444e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:52.240625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=149dc2cb594c45198b1a146e44c1444e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:52.248330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:52.576117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149dc2cb594c45198b1a146e44c1444e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:52.690752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149dc2cb594c45198b1a146e44c1444e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:52.736821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149dc2cb594c45198b1a146e44c1444e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:52.747163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149dc2cb594c45198b1a146e44c1444e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:52.748385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149dc2cb594c45198b1a146e44c1444e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:52.763719 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3551/7074] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:52 2022] DELETE /identity/v3/users/149dc2cb594c45198b1a146e44c1444e => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:52.766284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:52.766884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:52.767519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:52.902678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:52.910478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:53.101141 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3524/7075] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:53.106023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:53.109485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:53.119224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:53.122462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:53.137823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf8f60-fbe4-410a-940a-8780b5b6ca09 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:53.150020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:53.151106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.154005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.154538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] PATH_INFO: `/v3/projects/6fe2888702f84bd3a1e8118e28c7413d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.167206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe2888702f84bd3a1e8118e28c7413d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:53.175582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:53.351612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852727b-3983-4a28-bfd0-b1f322da8aa9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:53.361690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:53.362937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.363462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.363938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.393075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:53.396270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1934a4-5970-4659-8cfa-995e0207d856 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:53.426892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3525/7076] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:53.433090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe2888702f84bd3a1e8118e28c7413d', 'request_id': 'req-2139ac1b-654b-44c3-a661-b3f8f9e13b27'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:53.446862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe2888702f84bd3a1e8118e28c7413d', 'request_id': 'req-2139ac1b-654b-44c3-a661-b3f8f9e13b27'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:53.459184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe2888702f84bd3a1e8118e28c7413d', 'request_id': 'req-2139ac1b-654b-44c3-a661-b3f8f9e13b27'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:53.563422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] The token cache is being invalidate because project 6fe2888702f84bd3a1e8118e28c7413d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:53.565084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:53.566031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2139ac1b-654b-44c3-a661-b3f8f9e13b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:53.572379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3552/7077] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:53 2022] DELETE /identity/v3/projects/6fe2888702f84bd3a1e8118e28c7413d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:53.579226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.579829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.580128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:53.580938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.610519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:53.623388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:53.625416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:53.777535 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3526/7078] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:53.789379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.789944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.790395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.832140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:53.833663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:53.852982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3553/7079] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:53.861007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:53.877851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44623cdc-6abc-45b2-8dad-f3b5e922ab84 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:53.887526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:53.889361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.890513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.891618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.892966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:53.893830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:53.898180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:53.937931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:53.947375 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3527/7080] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:53.955935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d3f0b-9f81-4dd5-9192-dd8b5b35c481 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:53.970556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:53.971475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:53.971904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:53.972330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:53.973493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:53.979485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.191233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:54.191470 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3554/7081] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:53 2022] POST /identity/v3/projects => generated 399 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:54.222376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4258c-d637-472f-b5b0-39437a56c622 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:54.316019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:54.317225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.317723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.318395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.320250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:54.341169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.532512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:54.560255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:54.562141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:54.570169 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3528/7082] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:54 2022] POST /identity/v3/users => generated 300 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:54.575241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:54.580704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cad58e-0009-4b5b-923b-24083f253a60 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:54.585985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:54.586928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.587393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.587812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] PATH_INFO: `/v3/projects/3d34b3cffbc44c0aae74d45280e6cf4d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.590241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d34b3cffbc44c0aae74d45280e6cf4d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:54.594010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.599254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a8f6-4cd8-47f1-8453-0db8e34d4548 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:54.611841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:54.612532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.612787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.615717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.616536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:54.621566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.657551 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3529/7083] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:54.659155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:54.702669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647359-22a9-45ba-9557-3eb0956c9faa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:54.743929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d34b3cffbc44c0aae74d45280e6cf4d', 'request_id': 'req-e4b09525-793d-42b3-aebd-63c78c2e2bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:54.756441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d34b3cffbc44c0aae74d45280e6cf4d', 'request_id': 'req-e4b09525-793d-42b3-aebd-63c78c2e2bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:54.770459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d34b3cffbc44c0aae74d45280e6cf4d', 'request_id': 'req-e4b09525-793d-42b3-aebd-63c78c2e2bac'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:54.849515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:54.850771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.851798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.852286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.853212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:54.855644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.873850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] The token cache is being invalidate because project 3d34b3cffbc44c0aae74d45280e6cf4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:54.874309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:54.874996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e4b09525-793d-42b3-aebd-63c78c2e2bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:54.880724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3555/7084] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:54 2022] DELETE /identity/v3/projects/3d34b3cffbc44c0aae74d45280e6cf4d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:54.885740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246a04-5fa4-4855-9866-a719f397f341 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.886021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246a04-5fa4-4855-9866-a719f397f341 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.886296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce246a04-5fa4-4855-9866-a719f397f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.891501 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3530/7085] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:54.894929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:54.898021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:54.930172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a996a-03ef-46b5-b113-049cc52af093 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:54.935665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:54.936356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.936758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.937047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] PATH_INFO: `/v3/projects/0047c0775d354fd4baa9e9aa41c9d64b/users/9ed19f3afb954a1f8f0260de7ad94316/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:54.956675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0047c0775d354fd4baa9e9aa41c9d64b, user_id=9ed19f3afb954a1f8f0260de7ad94316, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:54.959532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff695f7-58a2-4b94-a08f-aae521c0f6b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:54.968053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ce246a04-5fa4-4855-9866-a719f397f341 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:54.969910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce246a04-5fa4-4855-9866-a719f397f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:54.984617 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3556/7086] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:54.992683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:54.993014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:54.993244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.019766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:55.021060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:55.032686 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3557/7087] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:55:55.037142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:55.056700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bea20d-2311-409a-a6e7-9799c7a2bbbf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:55.061023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:55.061235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.061562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.061848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.062698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:55:55.063116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:55.065098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:55.094735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3531/7088] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:54 2022] PUT /identity/v3/projects/0047c0775d354fd4baa9e9aa41c9d64b/users/9ed19f3afb954a1f8f0260de7ad94316/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:55.104839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3558/7089] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:55:55.109575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:55.115168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.115807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.116364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.130415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:55.150667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48526e48-dc1a-4014-a485-6dfd269482e5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:55.181494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] MFA Rules not processed for user `9ed19f3afb954a1f8f0260de7ad94316`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:55.183371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:55.325631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:55.341476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:55.342114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.342397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.342672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.343320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:55.345385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:55.425080 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3532/7090] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:55.428254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:55.446697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65632c7-e9e2-473f-9cad-b736faa99030 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:55.454779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:55.455785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.456168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.456590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.457353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:55.460053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:55.524273 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3559/7091] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/projects => generated 385 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:55:55.529078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:55.625859 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3533/7092] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/projects => generated 399 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:55.636574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:55.716642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e8059-14ab-45ed-b544-e5cfba4e796f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:55.852644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8253d74-240b-44ef-8c5d-d3433465170d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:55.886666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:55.890585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.892285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.895092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.897110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:55.901071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:55.973692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:55.975896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:55.976504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:55.979291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:55.983899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:55.987728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.081788 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3534/7093] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/users => generated 306 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:56.087655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.134213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b223f60-7671-4f4b-8912-848cbf4e04e0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.146515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:56.148798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:56.150229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:56.151647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:56.153899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:56.156192 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3560/7094] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:55:55 2022] POST /identity/v3/users => generated 293 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:55:56.161954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.165424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.202297 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3535/7095] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:56.205625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.217090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:56.222118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08426c4d-44c6-47f8-a3eb-a224caf2d0f2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.243941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16947396-c200-4a87-ac94-b61f3eb7e65b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.247379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:56.248181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:56.248471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:56.248850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:56.249544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:56.252291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.260815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:56.261477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:56.261761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:56.262042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] PATH_INFO: `/v3/users/facf25da6b1b48fc8ca97a2514c3ffc1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:56.265302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=facf25da6b1b48fc8ca97a2514c3ffc1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:56.269694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:56.270468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.278802 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3561/7096] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:56.279829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.305563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8094aa-05d1-4510-9acc-d90f4f16556e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.321942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:56.323133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:56.323496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:56.323787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] PATH_INFO: `/v3/projects/c4209067ee40456193b82494f3414a98/users/db0a6087fecb4e70811f645d6206e3d2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:56.347153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4209067ee40456193b82494f3414a98, user_id=db0a6087fecb4e70811f645d6206e3d2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:56.351539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.486437 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3562/7097] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:56 2022] PUT /identity/v3/projects/c4209067ee40456193b82494f3414a98/users/db0a6087fecb4e70811f645d6206e3d2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:56.488753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.623607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'facf25da6b1b48fc8ca97a2514c3ffc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:56.707561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f82bd3-a2ca-445b-858e-42b3e35a5bf7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.714856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'facf25da6b1b48fc8ca97a2514c3ffc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:56.734548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:56.738935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:56.740201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:56.740961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:56.743128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:56.748033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:56.748828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'facf25da6b1b48fc8ca97a2514c3ffc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:56.750826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'facf25da6b1b48fc8ca97a2514c3ffc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:56.751226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'facf25da6b1b48fc8ca97a2514c3ffc1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:56.772966 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3563/7098] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:56.775261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.779245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:56.811923 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8a49b-0f1c-4ad2-833a-02af4cef951c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:56.841018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3536/7099] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:56 2022] DELETE /identity/v3/users/facf25da6b1b48fc8ca97a2514c3ffc1 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:56.851058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:56.855923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:57.046183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:57.124062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:57.124062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.124062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.124062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.125118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:57.125118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de2257-29f1-4234-9b43-ce945b9e120b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:57.165869 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3564/7100] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:55:57.171849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56435e09-1a53-4d2b-8bc7-d19e63c94bfd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:57.180634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.183197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.183936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:57.184322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.184659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.184938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.188089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] PATH_INFO: `/v3/projects/5937877d57754ee28ff5e7926714b4f9/users/f96e8bcbb54d4d449d0ea6b57c65aac0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.224151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5937877d57754ee28ff5e7926714b4f9, user_id=f96e8bcbb54d4d449d0ea6b57c65aac0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:57.231385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:57.274093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:57.276816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:57.309375 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3565/7101] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:57.312931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:57.364681 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3537/7102] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:56 2022] PUT /identity/v3/projects/5937877d57754ee28ff5e7926714b4f9/users/f96e8bcbb54d4d449d0ea6b57c65aac0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:57.372894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:57.374978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2833af-6eec-45e3-9b5c-7ac1430adba4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:57.376817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:57.519688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:57.520610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.520997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.521372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] PATH_INFO: `/v3/projects/c4209067ee40456193b82494f3414a98/users/db0a6087fecb4e70811f645d6206e3d2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.530136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4209067ee40456193b82494f3414a98, user_id=db0a6087fecb4e70811f645d6206e3d2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:57.535772 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7fe8-6686-40ae-8397-1f64f6ed5251 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:57.568585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3566/7103] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:55:57 2022] PUT /identity/v3/projects/c4209067ee40456193b82494f3414a98/users/db0a6087fecb4e70811f645d6206e3d2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:55:57.571707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.571707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.574315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.614376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77dbce-5471-4b2d-8da5-c10183c56326 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:57.644606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] MFA Rules not processed for user `f96e8bcbb54d4d449d0ea6b57c65aac0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:57.648959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:57.714232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:57.739949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:57.740904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.741348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.741724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.843057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:57.845405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bd96e-ff9d-4f15-a9f4-d3300cac4069 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:57.868710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3538/7104] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:57.872111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:57.872943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:57.873890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:57.892407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3567/7105] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:57.943041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] MFA Rules not processed for user `db0a6087fecb4e70811f645d6206e3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:55:57.944691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:57.957491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:57.959222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:58.005248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641530b9-32e7-4dd3-86cd-8b6699766998 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:58.019797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:58.020633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:58.020917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:58.021197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:58.042014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:58.043518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:58.073236 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3568/7106] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:58.176847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3539/7107] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:55:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:55:58.189368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:58.194740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:58.410785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc89464-896b-4147-bb18-1c761ba2bc16 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:58.426663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:58.427855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:58.428427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:58.429230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:58.481686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:58.484832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:58.551439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3569/7108] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:55:58.986891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:59.007263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e4e0-f479-4cba-929b-d0863d336d63 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:59.017820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:59.018820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:59.019322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:59.020086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:59.029432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:59.037241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:59.043220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:55:59.115609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac454839-7993-4772-894f-0ae7c6408300 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:59.135695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:59.136698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:59.137264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:59.137699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] PATH_INFO: `/v3/projects/849047dce5fd44518d789ccb81411f74` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:59.140438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=849047dce5fd44518d789ccb81411f74)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:59.145462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:59.161843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:59.164460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:55:59.169097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:59.189262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3540/7109] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:55:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:55:59.329458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:55:59.415594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849047dce5fd44518d789ccb81411f74', 'request_id': 'req-e070fb0c-048c-4112-811e-0bf0d4e89f7b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:59.438367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849047dce5fd44518d789ccb81411f74', 'request_id': 'req-e070fb0c-048c-4112-811e-0bf0d4e89f7b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:59.467749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849047dce5fd44518d789ccb81411f74', 'request_id': 'req-e070fb0c-048c-4112-811e-0bf0d4e89f7b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:59.575754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] The token cache is being invalidate because project 849047dce5fd44518d789ccb81411f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:55:59.576207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:59.578254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:55:59.582515 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3570/7110] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:55:59 2022] DELETE /identity/v3/projects/849047dce5fd44518d789ccb81411f74 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:55:59.588667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:55:59.605773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ebe0-48cc-403c-91c7-7a5d8657e6e5 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:55:59.851426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:55:59.852758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:55:59.853774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:55:59.854520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] PATH_INFO: `/v3/users/28d5bd6885c341a6b695816031461cbe` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:55:59.858068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d5bd6885c341a6b695816031461cbe)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:55:59.862342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:00.187209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d5bd6885c341a6b695816031461cbe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:00.347478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d5bd6885c341a6b695816031461cbe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:00.389304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d5bd6885c341a6b695816031461cbe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:00.390440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d5bd6885c341a6b695816031461cbe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:00.402339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-71a783d1-52ac-4825-bd21-69a45a655ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d5bd6885c341a6b695816031461cbe'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:00.481675 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3541/7111] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:55:59 2022] DELETE /identity/v3/users/28d5bd6885c341a6b695816031461cbe => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:01.437110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:01.437110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:01.475467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070fb0c-048c-4112-811e-0bf0d4e89f7b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:01.604528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:01.654612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:01.654612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:01.654612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:01.654612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] PATH_INFO: `/v3/projects/2495b69f457e4c6d890b6101266bb182` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:01.655171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2495b69f457e4c6d890b6101266bb182)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:01.655171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:01.847556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2495b69f457e4c6d890b6101266bb182', 'request_id': 'req-ec9494b6-db61-4f07-a639-51e50ccee1e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:01.865047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2495b69f457e4c6d890b6101266bb182', 'request_id': 'req-ec9494b6-db61-4f07-a639-51e50ccee1e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:01.893811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2495b69f457e4c6d890b6101266bb182', 'request_id': 'req-ec9494b6-db61-4f07-a639-51e50ccee1e3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:02.011121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] The token cache is being invalidate because project 2495b69f457e4c6d890b6101266bb182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:02.011353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:02.014895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ec9494b6-db61-4f07-a639-51e50ccee1e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:02.023093 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3571/7112] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:01 2022] DELETE /identity/v3/projects/2495b69f457e4c6d890b6101266bb182 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:02.024977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.027487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.027981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.069962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:02.071477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:02.112209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:02.167995 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3542/7113] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:02.177901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.178251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.178493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.206405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:02.208615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:02.219982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3572/7114] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:02.224500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:02.237509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a55a1c-5766-4b7f-a834-f2f11ae1de4c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:02.248066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:02.249372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.249842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.250486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.251450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:02.251945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:02.253865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:02.269705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3543/7115] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:02.274185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:02.290317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397f09d-8886-4fc0-b42b-6ea20e27ace0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:02.306911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:02.307689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.307819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.308104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.308815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:02.314368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:02.530930 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3573/7116] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:02 2022] POST /identity/v3/projects => generated 367 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:02.536068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:02.553248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62d82-4093-4f06-9e38-39ddc1e282d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:02.741841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:02.742897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.743436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.743973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.745896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:02.748549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:02.871729 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3544/7117] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:02 2022] POST /identity/v3/users => generated 284 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:02.876546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:02.893117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7a831-4fbc-49b8-bc12-db7e1719193e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:02.913561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:02.914304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:02.914911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:02.915454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:02.917272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:02.925395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:02.958292 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3574/7118] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:02.962124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:02.990095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a301b6a-3755-4b0a-837a-bafc364242c8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:03.000987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:03.004994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:03.008417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:03.009106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:03.014911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:03.021661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bb17a-7f4b-4984-932f-5bc64b7d77a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:03.090597 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3545/7119] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:03.095427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:03.111399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d97960-968b-47d6-8200-f4191e6db90e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:03.129538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:03.130375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:03.130676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:03.130946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] PATH_INFO: `/v3/projects/c90913fe33954f4c8dd21300c59c9bfe/users/373b76226c5d47b9bd40f7a030a6fb5d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:03.188978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c90913fe33954f4c8dd21300c59c9bfe, user_id=373b76226c5d47b9bd40f7a030a6fb5d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:03.193106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:03.381234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3575/7120] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:03 2022] PUT /identity/v3/projects/c90913fe33954f4c8dd21300c59c9bfe/users/373b76226c5d47b9bd40f7a030a6fb5d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:03.394792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:03.395298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:03.395724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:03.467162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] MFA Rules not processed for user `373b76226c5d47b9bd40f7a030a6fb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:03.472343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:03.699545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:03.713702 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3546/7121] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:03.869503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf95b98-6a13-4110-a84e-3eea186c03cc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:03.887999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:03.888904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:03.889188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:03.889473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:03.890285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:03.895671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:04.124699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:04.155003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:04.155928 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3576/7122] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:03 2022] POST /identity/v3/projects => generated 369 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:04.186194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61d990-fcfa-4091-89a2-15b6b1f9911a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:04.463835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:04.469370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:04.470397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:04.473089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:04.474474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:04.487689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:04.664817 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3547/7123] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:04 2022] POST /identity/v3/users => generated 291 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:04.670663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:04.687806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225f7e0-6e1a-447f-8482-c7842d7c8788 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:04.703272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:04.707744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:04.708568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:04.708882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:04.709640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:04.717458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:04.758216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3577/7124] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:04.772980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:04.799573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d8986-d870-4707-90e4-aa4f553f0702 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:04.811368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:04.814559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:04.815502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:04.816287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] PATH_INFO: `/v3/projects/2ca9e81583ba4a039de06213c7222f8d/users/3ad8319023114a09a0151bcfc33543ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:04.882381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca9e81583ba4a039de06213c7222f8d, user_id=3ad8319023114a09a0151bcfc33543ac, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:04.888452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:05.113431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:05.117558 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3548/7125] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:04 2022] PUT /identity/v3/projects/2ca9e81583ba4a039de06213c7222f8d/users/3ad8319023114a09a0151bcfc33543ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:05.154597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65733c17-9cfa-475a-a562-bd12b6a82011 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:05.208346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:05.288920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:05.289579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:05.289912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:05.292790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:05.293543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:05.298261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842598a-f7b2-444d-a0c2-5f374e4ad64f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:05.323848 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3578/7126] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:05.337068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:05.361951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cc696-ab8a-4db4-8bef-d885275f947f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:05.381295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:05.387499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:05.389905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:05.391147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] PATH_INFO: `/v3/projects/2ca9e81583ba4a039de06213c7222f8d/users/3ad8319023114a09a0151bcfc33543ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:05.396389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca9e81583ba4a039de06213c7222f8d, user_id=3ad8319023114a09a0151bcfc33543ac, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:05.403180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:05.447945 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3549/7127] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:05 2022] PUT /identity/v3/projects/2ca9e81583ba4a039de06213c7222f8d/users/3ad8319023114a09a0151bcfc33543ac/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:05.466246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:05.466792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:05.467080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:05.531037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] MFA Rules not processed for user `3ad8319023114a09a0151bcfc33543ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:05.536214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:05.671239 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3579/7128] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:05.682555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:05.686509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:05.888103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5d04d-8ade-44a5-b7c1-6213b57c42a8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:05.892969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:05.893752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:05.894083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:05.894369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:05.917027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:05.920706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:05.939112 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3550/7129] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:06.136638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=2,keystone:DELETE=5,keystone:SELECT=93 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:07.290096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:08.456832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:09.198785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:09.878509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:10.308352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:11.880719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:12.076319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:12.148699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:12.297546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551270d-4f5f-4f5b-97be-7b5152cee1a4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:12.318499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:12.319381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:12.319804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:12.319986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] PATH_INFO: `/v3/users/373b76226c5d47b9bd40f7a030a6fb5d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:12.323601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=373b76226c5d47b9bd40f7a030a6fb5d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:12.325600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:12.648928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '373b76226c5d47b9bd40f7a030a6fb5d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:12.787839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '373b76226c5d47b9bd40f7a030a6fb5d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:12.837690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '373b76226c5d47b9bd40f7a030a6fb5d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:12.843270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:12.847561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:12.861964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '373b76226c5d47b9bd40f7a030a6fb5d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:12.862826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-441ffcf3-e50e-4fd5-8a98-009bed7e41b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '373b76226c5d47b9bd40f7a030a6fb5d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:12.879019 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3580/7130] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:12 2022] DELETE /identity/v3/users/373b76226c5d47b9bd40f7a030a6fb5d => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:12.880204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:12.881411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:12.881411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:12.914386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198fc15-2b17-4c48-ab77-faeee02b172e service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:12.986346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:12.996397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:13.083421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:13.192461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:13.193722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:13.198024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:13.198547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] PATH_INFO: `/v3/users/9ed19f3afb954a1f8f0260de7ad94316` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:13.203629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed19f3afb954a1f8f0260de7ad94316)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:13.212787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:13.319194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3581/7131] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:13.362704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:13.365095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:13.452130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed19f3afb954a1f8f0260de7ad94316'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:13.514820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c2d4-1e76-45d8-a30f-d407dae1b5cf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:13.521088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:13.522935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:13.528476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:13.529128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:13.557088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:13.560418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8f535-4da2-494f-b8b8-d49870ff4d10 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:13.586090 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3582/7132] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:13.600000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed19f3afb954a1f8f0260de7ad94316'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:13.609700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:13.639236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed19f3afb954a1f8f0260de7ad94316'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:13.640276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed19f3afb954a1f8f0260de7ad94316'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:13.647574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed19f3afb954a1f8f0260de7ad94316'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:13.682982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:13.682982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:13.682982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:13.687994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3551/7133] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:12 2022] DELETE /identity/v3/users/9ed19f3afb954a1f8f0260de7ad94316 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:13.706839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:13.708580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:13.770631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:13.900242 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3583/7134] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:14.083679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:14.088562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:14.273340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058c203-0dff-46a8-940a-244accb97ac1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:14.285675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:14.286581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:14.287078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:14.287555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:14.335186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:14.337753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde4a9b-6eef-46ba-ae4c-0a56fe2bcbaf service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:14.382959 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3552/7135] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:14.434845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:14.638582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:14.855865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:14.858051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:14.881690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c24c73-95e0-40f7-a8e7-ec15414590ce None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:14.907137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:14.908729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:14.909019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:14.909301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] PATH_INFO: `/v3/users/a18f6ff73b524a6f86cf8a792ada2f7d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:14.910838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18f6ff73b524a6f86cf8a792ada2f7d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:14.913779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:15.331210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18f6ff73b524a6f86cf8a792ada2f7d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:15.466706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18f6ff73b524a6f86cf8a792ada2f7d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:15.511634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18f6ff73b524a6f86cf8a792ada2f7d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:15.543655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18f6ff73b524a6f86cf8a792ada2f7d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:15.544773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18f6ff73b524a6f86cf8a792ada2f7d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:15.558261 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3584/7136] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:14 2022] DELETE /identity/v3/users/a18f6ff73b524a6f86cf8a792ada2f7d => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:15.560183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:15.560772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:15.560984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:15.609279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:15.611140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:15.778708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:15.814704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3553/7137] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:15.865478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:15.867337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:15.881992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:15.885309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:15.888643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c42461-ff8d-4880-bf96-0a7073144d0c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:15.896126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:15.897631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:15.898191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:15.898700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] PATH_INFO: `/v3/projects/0047c0775d354fd4baa9e9aa41c9d64b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:15.901920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0047c0775d354fd4baa9e9aa41c9d64b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:15.938338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:16.215884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0047c0775d354fd4baa9e9aa41c9d64b', 'request_id': 'req-84aec294-d7aa-4cc6-a005-cc2a615609d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.226337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08db3eb-d16f-4d0a-a495-e3e4ac6c8cf1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:16.243157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0047c0775d354fd4baa9e9aa41c9d64b', 'request_id': 'req-84aec294-d7aa-4cc6-a005-cc2a615609d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.259009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0047c0775d354fd4baa9e9aa41c9d64b', 'request_id': 'req-84aec294-d7aa-4cc6-a005-cc2a615609d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.385873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] The token cache is being invalidate because project 0047c0775d354fd4baa9e9aa41c9d64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:16.386435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.429717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:16.429717 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3585/7138] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:15 2022] DELETE /identity/v3/projects/0047c0775d354fd4baa9e9aa41c9d64b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:16.429717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:16.429717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:16.431218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:16.431218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:16.431218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:16.431218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:16.432157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:16.582125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aec294-d7aa-4cc6-a005-cc2a615609d7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:16.589457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:16.590447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:16.590887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:16.591316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] PATH_INFO: `/v3/projects/c90913fe33954f4c8dd21300c59c9bfe` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:16.593025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c90913fe33954f4c8dd21300c59c9bfe)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:16.595782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:16.616299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:16.621727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:16.652002 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3554/7139] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:16.654318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:16.656919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:16.706327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90309b5-f8a8-4980-b4b5-894ed14e8107 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:16.745772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:16.745772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:16.745772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:16.745772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] PATH_INFO: `/v3/users/db0a6087fecb4e70811f645d6206e3d2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:16.746434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0a6087fecb4e70811f645d6206e3d2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:16.746434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.041917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c90913fe33954f4c8dd21300c59c9bfe', 'request_id': 'req-6cb0979b-8726-46e1-b9ad-e54b8c0685da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.057769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c90913fe33954f4c8dd21300c59c9bfe', 'request_id': 'req-6cb0979b-8726-46e1-b9ad-e54b8c0685da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.076171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c90913fe33954f4c8dd21300c59c9bfe', 'request_id': 'req-6cb0979b-8726-46e1-b9ad-e54b8c0685da'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.299697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] The token cache is being invalidate because project c90913fe33954f4c8dd21300c59c9bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:17.301290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.304142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.307720 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3586/7140] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:16 2022] DELETE /identity/v3/projects/c90913fe33954f4c8dd21300c59c9bfe => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:17.310527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.315424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.351801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0a6087fecb4e70811f645d6206e3d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.435904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:17.462843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0a6087fecb4e70811f645d6206e3d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.493547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0a6087fecb4e70811f645d6206e3d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.494863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0a6087fecb4e70811f645d6206e3d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.496108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0a6087fecb4e70811f645d6206e3d2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.555784 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3555/7141] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:16 2022] DELETE /identity/v3/users/db0a6087fecb4e70811f645d6206e3d2 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:17.556918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0979b-8726-46e1-b9ad-e54b8c0685da admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.562137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:17.565638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:17.710284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.712046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.712859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.713376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] PATH_INFO: `/v3/projects/069498e1692a4682a013d9b732f3563a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.713972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799ccd9-af8d-497c-9fad-835d27c41de6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:17.715014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=069498e1692a4682a013d9b732f3563a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.717096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.727024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:17.728440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:17.729734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:17.736094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] PATH_INFO: `/v3/users/3ad8319023114a09a0151bcfc33543ac` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:17.736094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad8319023114a09a0151bcfc33543ac)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:17.738420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:17.795091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:17.914501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069498e1692a4682a013d9b732f3563a', 'request_id': 'req-c3c901e2-32a9-4b91-9230-bed2015d4109'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.936630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069498e1692a4682a013d9b732f3563a', 'request_id': 'req-c3c901e2-32a9-4b91-9230-bed2015d4109'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:17.970142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069498e1692a4682a013d9b732f3563a', 'request_id': 'req-c3c901e2-32a9-4b91-9230-bed2015d4109'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.129927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] The token cache is being invalidate because project 069498e1692a4682a013d9b732f3563a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:18.130750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.132138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad8319023114a09a0151bcfc33543ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.134678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3c901e2-32a9-4b91-9230-bed2015d4109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.142510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3587/7142] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:17 2022] DELETE /identity/v3/projects/069498e1692a4682a013d9b732f3563a => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:18.172402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:18.173313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:18.176108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:18.261179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad8319023114a09a0151bcfc33543ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.282641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:18.285465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:18.305133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad8319023114a09a0151bcfc33543ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.306475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad8319023114a09a0151bcfc33543ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.307558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4ba67608-0e54-46d8-a6fc-2de1e10eb140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad8319023114a09a0151bcfc33543ac'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:18.360326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3556/7143] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:17 2022] DELETE /identity/v3/users/3ad8319023114a09a0151bcfc33543ac => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:18.528542 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3588/7144] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:18.530404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:18.530821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:18.531223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:18.597881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:18.599692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:18.609664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:18.763660 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3557/7145] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:18.770957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:18.794438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae120ea9-b8ed-4382-ae36-17dfbe8c10ae None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:18.805996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:18.807374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:18.808032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:18.808479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:18.809400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:18.809968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:18.812139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:18.834334 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3589/7146] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:18.839238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:18.859228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff421a3-7065-4f90-88f2-47a9286e1164 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:18.868339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:18.869931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:18.870733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:18.871274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:18.872448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:18.883385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:19.008960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:19.026267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:19.078725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032944a-c9c5-424d-bc89-3862e3b57565 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:19.095429 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3558/7147] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:19.100666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:19.102814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.103736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.105114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] PATH_INFO: `/v3/projects/c4209067ee40456193b82494f3414a98` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.110083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4209067ee40456193b82494f3414a98)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:19.118570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:19.118812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:19.208263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:19.390985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4209067ee40456193b82494f3414a98', 'request_id': 'req-47cc3bee-ece2-46e9-a4f8-bf86272fa842'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:19.406611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4209067ee40456193b82494f3414a98', 'request_id': 'req-47cc3bee-ece2-46e9-a4f8-bf86272fa842'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:19.410292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8e8c2-ecc4-48c0-a504-fcb52b42419a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:19.427999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4209067ee40456193b82494f3414a98', 'request_id': 'req-47cc3bee-ece2-46e9-a4f8-bf86272fa842'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:19.609872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] The token cache is being invalidate because project c4209067ee40456193b82494f3414a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:19.610885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:19.611978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-47cc3bee-ece2-46e9-a4f8-bf86272fa842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:19.616054 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3590/7148] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:19 2022] DELETE /identity/v3/projects/c4209067ee40456193b82494f3414a98 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:19.627556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:19.630232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d24c-9530-4f08-9206-d628ad7df3bf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.631090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d24c-9530-4f08-9206-d628ad7df3bf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.631274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.631593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d24c-9530-4f08-9206-d628ad7df3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.634153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.634153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.634594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:19.638042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:19.671682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f769d24c-9530-4f08-9206-d628ad7df3bf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:19.673968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f769d24c-9530-4f08-9206-d628ad7df3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:19.689260 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3591/7149] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:19.698603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.698887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.705994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.723247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:19.724428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:19.734649 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3592/7150] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:19.739411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:19.750655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a588311-3c61-47a6-9d1e-1281bc969cb5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:19.756318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:19.756987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.757281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.757556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.758360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:19.758673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:19.760400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:19.780785 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3593/7151] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:19.782052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:19.797656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dce070-602a-4996-a618-db1abb862571 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:19.821070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:19.823549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:19.824142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:19.825292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:19.829454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:19.833725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:19.851096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3559/7152] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:19 2022] POST /identity/v3/users => generated 288 bytes in 743 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:19.853692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:19.854836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:19.979596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139e2fa-ab76-40c0-9605-1f7ec78cb400 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:20.005740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:20.014225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.014225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.014225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.014225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:20.015994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:20.019843 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3594/7153] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:19 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:20.020962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:20.029651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:20.068218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3560/7154] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:56:20.068218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:20.124201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35e24-ad53-4f29-a0db-aced1e60787f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:20.201007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f56122-1283-4a4d-8d70-fd6b1bcaceaa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:20.222599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:20.223274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.223545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.224018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] PATH_INFO: `/v3/projects/2ca9e81583ba4a039de06213c7222f8d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.226119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca9e81583ba4a039de06213c7222f8d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:20.229741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:20.300281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:20.370977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:20.396684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca9e81583ba4a039de06213c7222f8d', 'request_id': 'req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:20.424227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca9e81583ba4a039de06213c7222f8d', 'request_id': 'req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:20.435756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca9e81583ba4a039de06213c7222f8d', 'request_id': 'req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:20.451914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:20.456910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.457554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.458031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.468252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:20.473497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7124e-e3b1-4262-bbb3-7a31fb88e054 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:20.580527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] The token cache is being invalidate because project 2ca9e81583ba4a039de06213c7222f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:20.580986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:20.581955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:20.585187 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3595/7155] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:20 2022] DELETE /identity/v3/projects/2ca9e81583ba4a039de06213c7222f8d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:20.587083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:20.588945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:20.673103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3561/7156] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:20 2022] POST /identity/v3/users => generated 289 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:20.674606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.674899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.675173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.744195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:20.756946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:20.847767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fc448-5dc0-4aa1-8484-9ce7dfe03639 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:20.857335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:20.858780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.859650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.861006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.864055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:20.874851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:20.917254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3596/7157] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:20.919161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:20.922898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:20.951803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb68d-fd0b-45cc-ac52-4a81db065f9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:20.959675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:20.960823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:20.974459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:20.975437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:20.978238 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3562/7158] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:20.979221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:20.981216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:20.984300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c89b19-f747-4547-bdd2-5bc627562ee1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.005834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376657b-80f5-4b5f-9ed2-4a067c2c69c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:21.012420 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3597/7159] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:21.018130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.019063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.019744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.033649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:21.033649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.034005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.034177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] PATH_INFO: `/v3/projects/99c2eb8f4bc9406183f1b01bb8016fa3/users/3b914c73210c4a9e8a0d989ff495e474/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.067875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c2eb8f4bc9406183f1b01bb8016fa3, user_id=3b914c73210c4a9e8a0d989ff495e474, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:21.070760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.099795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:21.104675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:21.123421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3598/7160] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:21.125112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:21.144471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969c7b2-61ea-467b-8876-853c357ee124 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:21.153562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:21.154605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.155083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.155551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.156755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:21.159777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.192644 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3599/7161] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:21.200417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:21.221609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003af4c-4394-42fb-8c99-dbc682bfa211 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:21.235193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:21.236797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.237607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.238370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.239850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:21.240784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:21.245264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2115d7-70e9-481c-bb01-bec40b2dc47a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.261463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3563/7162] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:20 2022] PUT /identity/v3/projects/99c2eb8f4bc9406183f1b01bb8016fa3/users/3b914c73210c4a9e8a0d989ff495e474/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:21.273661 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3600/7163] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:21.274955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:21.278796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.282438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.282438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.371458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] MFA Rules not processed for user `3b914c73210c4a9e8a0d989ff495e474`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:21.373554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:21.460409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b2ddc-1f48-4044-9893-9768184f8e24 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:21.475767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:21.477318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.477763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.478634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] PATH_INFO: `/v3/projects/a85088ae46044a2fa99fb3108b1e2003/users/d3fe76722a46469799bd5b72b36c7142/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.501508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85088ae46044a2fa99fb3108b1e2003, user_id=d3fe76722a46469799bd5b72b36c7142, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:21.504475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.551168 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3601/7164] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:21.553399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:21.573991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f4e25-f43d-4ac3-b299-5f5ec744fb85 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:21.593850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:21.595683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.596170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.596701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.597783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:21.603030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0161103-45cd-4707-8fcc-1126d4768952 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:21.709346 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3564/7165] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:21 2022] PUT /identity/v3/projects/a85088ae46044a2fa99fb3108b1e2003/users/d3fe76722a46469799bd5b72b36c7142/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:21.716177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:21.722756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:21.757689 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3602/7166] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:21 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:21.760079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:21.760527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:21.760903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:21.807469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] MFA Rules not processed for user `d3fe76722a46469799bd5b72b36c7142`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:21.809188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:21.884369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43ace-0bec-43a0-b092-3a89c0ae3bfe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.027540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3603/7167] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:22.027540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.081219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.082790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.084987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.085619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.215227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315feb6-0b80-4fbd-8ffc-fb0ce50aeef1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.223301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.223989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.224282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.224573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.225430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.227738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.228668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.231038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.249901 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3565/7168] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:22.251698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.254186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:22.277928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d9348-9eeb-4d9e-9f32-bb8e2d1e2ef7 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.286135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.287415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.288143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.289115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] PATH_INFO: `/v3/users/fdb20e9133bd4f919466f12f8076a988` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.291819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb20e9133bd4f919466f12f8076a988)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.296217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.395172 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3604/7169] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:22 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:22.396318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.413248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cb309-23d3-4139-a4bb-66d3ef7d05ab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.421341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.422328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.422954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.423409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.432329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.437363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.550787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb20e9133bd4f919466f12f8076a988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:22.616658 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3605/7170] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:22 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:22.616658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.634156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb20e9133bd4f919466f12f8076a988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:22.659370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb20e9133bd4f919466f12f8076a988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:22.660282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb20e9133bd4f919466f12f8076a988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:22.662008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb20e9133bd4f919466f12f8076a988'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:22.683780 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3566/7171] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:22 2022] DELETE /identity/v3/users/fdb20e9133bd4f919466f12f8076a988 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:22.685077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.690424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:22.711534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:22.718197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02160eef-43ab-4135-a483-d78748ca5df8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.775946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:22.783190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbb942-2426-4f48-885e-d11c068df955 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.788914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.790213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.790490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.790949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.791701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.793293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.795872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.796506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.796784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.797055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] PATH_INFO: `/v3/users/3b914c73210c4a9e8a0d989ff495e474` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.798230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b914c73210c4a9e8a0d989ff495e474)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.800275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.809193 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3567/7172] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:22.809193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:22.814252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:22.832596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa418d3f-5732-4ed2-8ffc-6de030f1ef19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:22.854769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:22.854769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.854769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.854769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:22.855331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:22.855331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47c56e-d235-437f-a363-2fc6b351234e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:22.986759 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3568/7173] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:22 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:22.988584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:22.989112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:22.989968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.013788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:23.015038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.028004 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3569/7174] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:23.030061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.047121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b11387-79ae-4d3d-a7e8-f769bc81ec1f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.056871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.059901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.060827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.069105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.069105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.069105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.075505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b914c73210c4a9e8a0d989ff495e474'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:23.091822 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3570/7175] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:23.094956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.114778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2256-742d-416d-8808-6821ea70d978 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.121698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.122614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.123044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.123440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.124261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.126337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.142994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3571/7176] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:23.147000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.150082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.162174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b914c73210c4a9e8a0d989ff495e474'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:23.183378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b914c73210c4a9e8a0d989ff495e474'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:23.206688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b914c73210c4a9e8a0d989ff495e474'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:23.208702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b914c73210c4a9e8a0d989ff495e474'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:23.229018 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3606/7177] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:22 2022] DELETE /identity/v3/users/3b914c73210c4a9e8a0d989ff495e474 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:23.230107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.235053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.244735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:23.281689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646295-5d10-4053-babb-4bb1173ce9cb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.346818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.347443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.347722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.348097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.350005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.385039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2312-20b4-4123-b3a8-d253c2807981 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.401908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.401908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.401908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.407888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] PATH_INFO: `/v3/projects/751f0e302f1a4c1baf4fbafc7e62a261/users/2a44edc6a7c74be781b02ce97bb0b1c1/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.471298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=751f0e302f1a4c1baf4fbafc7e62a261, user_id=2a44edc6a7c74be781b02ce97bb0b1c1, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.478910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.486231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.488395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.502308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3572/7178] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:23.503285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.505720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.527837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d45551-c8ab-4bc9-8c7f-7a3963bb7cbe service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.533794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.537462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.537462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.537797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.538596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.541274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f12c20-8a64-4b69-ae67-891b1b7659d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.569012 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3573/7179] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:23.570858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f97ed-1e4a-4a61-b5fc-92fe5733c2b2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.571307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f97ed-1e4a-4a61-b5fc-92fe5733c2b2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.571651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f97ed-1e4a-4a61-b5fc-92fe5733c2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.620508 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3607/7180] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:23 2022] PUT /identity/v3/projects/751f0e302f1a4c1baf4fbafc7e62a261/users/2a44edc6a7c74be781b02ce97bb0b1c1/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:23.622002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.638606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-844f97ed-1e4a-4a61-b5fc-92fe5733c2b2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:23.643742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-844f97ed-1e4a-4a61-b5fc-92fe5733c2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.792526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3574/7181] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:23.802945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.802945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.802945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.815916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851492-705a-473a-9200-647b1f128d7c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:23.857172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:23.858412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:23.859136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:23.859717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] PATH_INFO: `/v3/projects/5d90babe25d241209650624d3c50799f/users/93573a4c65e14359bfb1c414f7e8dd5a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:23.889368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d90babe25d241209650624d3c50799f, user_id=93573a4c65e14359bfb1c414f7e8dd5a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:23.893243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:23.894343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] MFA Rules not processed for user `2a44edc6a7c74be781b02ce97bb0b1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:23.895685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:23.982067 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3608/7182] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:23 2022] PUT /identity/v3/projects/5d90babe25d241209650624d3c50799f/users/93573a4c65e14359bfb1c414f7e8dd5a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:23.991844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:23.999190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:24.058852 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3575/7183] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:24.058852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:24.058852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:24.097937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc30681-39dd-4bdb-af97-d85c4cf46c68 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:24.145164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0bbed-7bf7-4b35-b73b-54c0955a8909 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:24.159096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:24.159743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.160024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.160297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.245089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:24.257301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.258472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.263237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] PATH_INFO: `/v3/projects/d4052ea9dbe5435fad182eb586fcfe76` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.269435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4052ea9dbe5435fad182eb586fcfe76)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:24.284288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:24.286773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb416cc-a5e2-4b17-b61e-f92dfc45281c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:24.299946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:24.302569 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3609/7184] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:24.304296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.304999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.305649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.333010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:24.382089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] MFA Rules not processed for user `93573a4c65e14359bfb1c414f7e8dd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:24.384864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:24.531779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4052ea9dbe5435fad182eb586fcfe76', 'request_id': 'req-5043abb0-1c20-4415-965a-d6c4cfbad990'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:24.550512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4052ea9dbe5435fad182eb586fcfe76', 'request_id': 'req-5043abb0-1c20-4415-965a-d6c4cfbad990'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:24.577591 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3610/7185] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:24.579778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:24.595852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414056a7-c038-4327-b31a-223bfdeb4e39 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:24.625873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4052ea9dbe5435fad182eb586fcfe76', 'request_id': 'req-5043abb0-1c20-4415-965a-d6c4cfbad990'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:24.651473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] The token cache is being invalidate because project d4052ea9dbe5435fad182eb586fcfe76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:24.651913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:24.654697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:24.657093 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3576/7186] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:24 2022] DELETE /identity/v3/projects/d4052ea9dbe5435fad182eb586fcfe76 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:24.658147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:24.659909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:24.714913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:24.717178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.717618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.717999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.718798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:24.724924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd9f28-3d1f-4b0b-b66e-f188aec923a7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:24.793789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:24.866615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043abb0-1c20-4415-965a-d6c4cfbad990 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:24.892378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:24.894091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.894838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.895603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.897216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:24.902145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:24.904246 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3611/7187] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:24 2022] POST /identity/v3/projects => generated 365 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:24.905086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:24.905766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:24.906151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:24.938038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:24.942281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:25.056058 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3577/7188] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:24 2022] POST /identity/v3/projects => generated 379 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:25.064256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.074643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3612/7189] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:25.075405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:25.082102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.140602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc457a3-d96f-41b3-a875-d733585b8c79 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.258336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ebdd8-a431-48e0-9043-443b511c840f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.271281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.271744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.272420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.272420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.273468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.275617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.292731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.293360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.293640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.293911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.294559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.297854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643ff6e-f563-48da-8907-ac3d443c5295 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.439423 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3613/7190] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:25 2022] POST /identity/v3/users => generated 296 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:25.444800 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.445098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.445433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.452068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3578/7191] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:25 2022] POST /identity/v3/users => generated 289 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:25.454563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.475107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18848e4f-dbd8-4428-bebd-5530b5019d55 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.483235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:25.483819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.484886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:25.485347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.485734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.486272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.487415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.489919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.499462 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3614/7192] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:25.501095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.522134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ded261-7387-4a22-be68-c37e8dc94d54 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.525933 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3579/7193] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:25.528418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.548765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.548765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.548765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.548765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.549351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.552046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.568679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0578-8c98-479b-87b7-9ed0ed10c9a6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.577433 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3615/7194] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:25.578138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.579014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.579300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.579455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.579571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.580320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:25.580661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.583614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:25.594640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.608739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d4b488-dbf4-4672-bba9-3cb5fd5461b8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.630821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.631352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.631634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.631909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] PATH_INFO: `/v3/projects/330e25da487f4023bde999fff62b1384/users/d61a314650364951884de561b8462f67/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.632949 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3580/7195] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:25.634915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.657218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c6962-5a6e-4509-a413-3e7011269714 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:25.659086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e25da487f4023bde999fff62b1384, user_id=d61a314650364951884de561b8462f67, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.663480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.666048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:25.666541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:25.666886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:25.667227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] PATH_INFO: `/v3/projects/ad6f87965fe945bea32b0b2825048524/users/069ecd86626a4f408fd60baac8576b34/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:25.696407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6f87965fe945bea32b0b2825048524, user_id=069ecd86626a4f408fd60baac8576b34, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:25.701264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:25.823768 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3616/7196] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:25 2022] PUT /identity/v3/projects/330e25da487f4023bde999fff62b1384/users/d61a314650364951884de561b8462f67/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:25.825474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.868114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3581/7197] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:25 2022] PUT /identity/v3/projects/ad6f87965fe945bea32b0b2825048524/users/069ecd86626a4f408fd60baac8576b34/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:25.868812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:25.873371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:25.934051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb84275-111e-49de-9aa5-bdd9e6269d5e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.006626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aedfd9-f282-4abc-a31d-9ddde760efab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.010866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.011981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.012431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.012995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] PATH_INFO: `/v3/projects/99c2eb8f4bc9406183f1b01bb8016fa3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.015469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c2eb8f4bc9406183f1b01bb8016fa3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.018205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.070789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.071634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.072741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.078849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.078849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.078849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.214395 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3617/7198] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:25 2022] POST /identity/v3/projects => generated 357 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:26.216829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.237607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c2eb8f4bc9406183f1b01bb8016fa3', 'request_id': 'req-00b9347e-7228-41b9-b253-e142f4b911eb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:26.264307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c2eb8f4bc9406183f1b01bb8016fa3', 'request_id': 'req-00b9347e-7228-41b9-b253-e142f4b911eb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:26.344988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c2eb8f4bc9406183f1b01bb8016fa3', 'request_id': 'req-00b9347e-7228-41b9-b253-e142f4b911eb'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:26.359639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6594b74-43c3-49e3-9085-747c070b011c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.363818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] The token cache is being invalidate because project 99c2eb8f4bc9406183f1b01bb8016fa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:26.364363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:26.365209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.365720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:26.365988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.366341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.366742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.368727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.370466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.371847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3582/7199] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:25 2022] DELETE /identity/v3/projects/99c2eb8f4bc9406183f1b01bb8016fa3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:26.373020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.377578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.389526 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3618/7200] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:26.390726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.410381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.433436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2567b3d-3773-4f2d-a010-4adcf931f242 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.449901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.450525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.450858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.451275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.452021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.454017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.494315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9347e-7228-41b9-b253-e142f4b911eb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.501606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.502597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.503278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.503871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.504806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.506690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e13941-a684-4073-9b81-d2fcc4ef66fc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.532853 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3583/7201] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:26.536584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.539920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.540759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.576960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:26.578856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.594781 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3584/7202] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:26.595905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.601211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.604699 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3619/7203] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:26 2022] POST /identity/v3/users => generated 279 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:26.606611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.623880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f9677-e676-4017-900d-07aa0286ee29 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.625673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131dd7b-be4c-427f-8fc1-5c59f1ca8672 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.629725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.630757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.631580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.631931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] PATH_INFO: `/v3/projects/330e25da487f4023bde999fff62b1384/users/d61a314650364951884de561b8462f67/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.633755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.634219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.634577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.634965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] PATH_INFO: `/v3/projects/ad6f87965fe945bea32b0b2825048524/users/069ecd86626a4f408fd60baac8576b34/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.636251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330e25da487f4023bde999fff62b1384, user_id=d61a314650364951884de561b8462f67, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.637181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6f87965fe945bea32b0b2825048524, user_id=069ecd86626a4f408fd60baac8576b34, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.639501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.641009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4616529-0672-4f29-aab2-1668c74bbae6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:26.648711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:26.661253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3585/7204] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:26 2022] PUT /identity/v3/projects/330e25da487f4023bde999fff62b1384/users/d61a314650364951884de561b8462f67/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:26.661253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:26.675209 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3620/7205] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:26 2022] PUT /identity/v3/projects/ad6f87965fe945bea32b0b2825048524/users/069ecd86626a4f408fd60baac8576b34/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:26.677843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605839-f10b-4dc0-a6ec-ae859e4352f9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.678250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605839-f10b-4dc0-a6ec-ae859e4352f9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.678536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605839-f10b-4dc0-a6ec-ae859e4352f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.727097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fb605839-f10b-4dc0-a6ec-ae859e4352f9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:26.729319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fb605839-f10b-4dc0-a6ec-ae859e4352f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.804128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c57a0-0f9e-49ec-8724-1d2ed9d50697 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:26.898922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3621/7206] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:26.901863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.902354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.902774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.940838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] MFA Rules not processed for user `d61a314650364951884de561b8462f67`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:26.942628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:26.982805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:26.984023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:26.988870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:26.988870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:26.988870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:26.990770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171df09-ec00-4de6-840d-e023bbc211ec admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.023513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3586/7207] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:27.027255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.027814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.028278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.047394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:27.090231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3622/7208] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:27.100055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] MFA Rules not processed for user `069ecd86626a4f408fd60baac8576b34`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:27.101840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:27.102255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.144113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215242c-8fcf-4294-9a56-4bdb07f793dd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.162728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.170119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.170473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.170755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.173345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:27.176992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.178781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.228676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3623/7209] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:27.229860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.258134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:27.276655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8664e-c21d-4d6d-addd-19ef6e510571 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.287366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.289053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.289653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.290407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.292037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.295632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.307576 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3587/7210] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:27.309007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.310926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:27.326824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3624/7211] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:27.337824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.350185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a936cf-dee2-4f6d-9b7b-7959bcdb0561 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.359769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.365182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.365182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.365182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.365182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.366182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.389180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6aa9ba-3a0c-4a35-b33c-00a750bfe239 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.394081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.394871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.395157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.395429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.417787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.422576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.438292 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3588/7212] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:27.439221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.441094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:27.463640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cf3ba-5f65-4c4a-9bbf-5b6db9e1b205 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.474609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.475451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.475739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.476029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.505295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.508369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.516183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3625/7213] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:27 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:27.519769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.529337 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3589/7214] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:27.530872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.551286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80eeef-c724-4826-8f4d-479d71581cdb service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.657610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.658700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.659151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.659614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.660599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.664800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.707729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8107e-66cb-479b-9237-e648df929a9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:27.713455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:27.714194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:27.714478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:27.714754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] PATH_INFO: `/v3/projects/6790a6bdc3bd43eb9b393a49e206d97e/users/45c736b7ac1c4303b764761b2254e9d7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:27.739109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6790a6bdc3bd43eb9b393a49e206d97e, user_id=45c736b7ac1c4303b764761b2254e9d7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:27.742963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:27.807128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3590/7215] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:27 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:27.808180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:27.954301 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3626/7216] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:27 2022] PUT /identity/v3/projects/6790a6bdc3bd43eb9b393a49e206d97e/users/45c736b7ac1c4303b764761b2254e9d7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:27.955706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:28.040642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87483e-e322-46e6-ace2-47228e4f048f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.126140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149b489-eae4-4137-8322-86ea5cfa2c42 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.137148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.139804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.140657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.141028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.143431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:28.146623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.148949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.151864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.156973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.156973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.168078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793aa206-b30c-4dae-8a9c-4ca8766e85c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.188042 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3627/7217] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:28.189709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b802-c977-473e-9497-87652739e439 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.194706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b802-c977-473e-9497-87652739e439 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.194706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441b802-c977-473e-9497-87652739e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.239912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2441b802-c977-473e-9497-87652739e439 None None] MFA Rules not processed for user `45c736b7ac1c4303b764761b2254e9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:28.242893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2441b802-c977-473e-9497-87652739e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:28.263675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.275328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.354965 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3591/7218] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:28.358079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:28.384932 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3628/7219] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:28.389485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b802-c977-473e-9497-87652739e439 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:28.400541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e997b-b575-4689-9c09-3b83fc47bb8d service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.418076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.418995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.419415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.419831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.426984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:28.439750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441b802-c977-473e-9497-87652739e439 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.463126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.467210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.467849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.467849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.472961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.480981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.526411 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3629/7220] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:28.527326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:28.535810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:28.536172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:28.611625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:28.642374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.647393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.670131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ad4b8-058d-411a-817a-bf1e0610e062 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.689750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3592/7221] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:28.690780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:28.693525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.698575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.699202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.699795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.724744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbed3bd-5d75-4004-8984-d77d0cb0858c service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:28.731196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:28.733755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.736864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.738640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bd773-aa74-4f81-832f-069790b15e38 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.752590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.752590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] PATH_INFO: `/v3/projects/33b89034367e44ba805f5e730402c7b7/users/6c3df19242b74f35ae584ff5fed9e508/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:28.754758 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3630/7222] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:28.785211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b89034367e44ba805f5e730402c7b7, user_id=6c3df19242b74f35ae584ff5fed9e508, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:28.793188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:28.973029 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3593/7223] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:28 2022] PUT /identity/v3/projects/33b89034367e44ba805f5e730402c7b7/users/6c3df19242b74f35ae584ff5fed9e508/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:28.990212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:28.990982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:28.990982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:29.037662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] MFA Rules not processed for user `6c3df19242b74f35ae584ff5fed9e508`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:29.039440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:29.219289 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3631/7224] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:29.221619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:29.377533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcaf37-7b0d-4d37-8d07-a416f8812204 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:29.380943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:29.385931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:29.386482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:29.386923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:29.387786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:29.390884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:29.466790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:29.563258 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3594/7225] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:29 2022] POST /identity/v3/projects => generated 371 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:29.566585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:29.586676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5ce5f-9381-45da-bc8b-18f9251b58db None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:29.754892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:29.755589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:29.755884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:29.756165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:29.756994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:29.760444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:29.833788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:29.836726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:29.871485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd183888-883e-42ac-af6e-aab801a3be50 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:29.897759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3632/7226] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:29 2022] POST /identity/v3/users => generated 292 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:29.907250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:29.913518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:29.914521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:29.915030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:29.915374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] PATH_INFO: `/v3/users/f96e8bcbb54d4d449d0ea6b57c65aac0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:29.917379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f96e8bcbb54d4d449d0ea6b57c65aac0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:29.920578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:29.942213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=2,keystone:INSERT=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:29.975630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf475-9acd-4ac9-8f5f-8b5c07b98577 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:30.018334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:30.019053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.019053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.019422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.020519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:30.034178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:30.073439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3633/7227] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:30.084024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:30.117440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfbfb0b-d741-4292-abec-f657ecb56c46 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:30.162748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:30.164532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.165037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.165594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] PATH_INFO: `/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7/users/709b09ce27654fb89abfda2810bf3884/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.175500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f96e8bcbb54d4d449d0ea6b57c65aac0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:30.245484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3455d38f8f6e4aa984e55f22fd981ad7, user_id=709b09ce27654fb89abfda2810bf3884, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:30.255305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:30.281728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f96e8bcbb54d4d449d0ea6b57c65aac0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:30.299687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f96e8bcbb54d4d449d0ea6b57c65aac0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:30.301802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f96e8bcbb54d4d449d0ea6b57c65aac0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:30.302658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e8bd25dd-f916-4c8b-bd2a-ad5a7cc94069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f96e8bcbb54d4d449d0ea6b57c65aac0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:30.324275 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3595/7228] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:29 2022] DELETE /identity/v3/users/f96e8bcbb54d4d449d0ea6b57c65aac0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:30.328820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.329481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.329965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.359318 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3634/7229] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:30 2022] PUT /identity/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7/users/709b09ce27654fb89abfda2810bf3884/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:30.361872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:30.365636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:30.369157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:30.370236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:30.500584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3596/7230] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:30.514420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:30.516812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:30.577381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826f92e-23bd-4251-91ab-5f39c06af9f6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:30.594223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:30.595083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.595372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.595648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.596386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:30.605855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:30.634820 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3635/7231] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:30.640816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:30.659239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f41bb-122d-4216-860f-b2a88c3fd9b5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:30.667076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:30.667880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.668189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.668444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] PATH_INFO: `/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7/users/709b09ce27654fb89abfda2810bf3884/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.670919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c594c81f-2d27-44b3-a254-40dead8b989b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:30.671912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3455d38f8f6e4aa984e55f22fd981ad7, user_id=709b09ce27654fb89abfda2810bf3884, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:30.676745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aad699-c7f1-4058-90a8-3937a58bb216 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:30.683335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:30.683985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.684445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.684756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.706883 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3636/7232] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:30 2022] PUT /identity/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7/users/709b09ce27654fb89abfda2810bf3884/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:30.706883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:30.707862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:30.707862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:30.711892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:30.712832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:30.713722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:30.732801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3597/7233] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:30.773461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] MFA Rules not processed for user `709b09ce27654fb89abfda2810bf3884`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:30.775949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:30.916739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3637/7234] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:30.934884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:30.937173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:31.071811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ace2a-7da7-40bd-85be-55883a20bb5d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:31.175970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:31.176751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:31.177226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:31.185747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:31.199052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:31.201010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c07ca-07a9-42f5-a835-18752b435484 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:31.230962 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3598/7235] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:56:31.265248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:31.267430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:31.484924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb3d60-16df-47a9-8085-cacdfe3bf90f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:31.497538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:31.498589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:31.499032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:31.499459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] PATH_INFO: `/v3/projects/5937877d57754ee28ff5e7926714b4f9` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:31.501201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5937877d57754ee28ff5e7926714b4f9)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:31.505791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:31.765388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5937877d57754ee28ff5e7926714b4f9', 'request_id': 'req-a360829a-9da0-4a8f-be8f-40292b08891f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:31.785734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5937877d57754ee28ff5e7926714b4f9', 'request_id': 'req-a360829a-9da0-4a8f-be8f-40292b08891f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:31.798321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5937877d57754ee28ff5e7926714b4f9', 'request_id': 'req-a360829a-9da0-4a8f-be8f-40292b08891f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:31.929218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] The token cache is being invalidate because project 5937877d57754ee28ff5e7926714b4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:31.930509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:31.931990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a360829a-9da0-4a8f-be8f-40292b08891f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:31.938233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3638/7236] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:31 2022] DELETE /identity/v3/projects/5937877d57754ee28ff5e7926714b4f9 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:31.943132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:31.943595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:31.943694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.009203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:32.013228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.016913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:32.336851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3599/7237] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:32.347629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.348454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.348454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.374278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:32.376158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:32.403775 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3639/7238] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:32.406448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.429797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d1570-563a-4b5b-9cd5-b2351f7d45f3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.449863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.450648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.455368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.455782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.456967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:32.457604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.469384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:32.496465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3600/7239] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:32.503959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.523598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d8301-9dd0-4b20-87a7-90161744c3d0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.546765 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.547758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.548208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.548687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.549877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.587039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:32.816109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:32.822178 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3640/7240] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/projects => generated 377 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:32.829316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:32.844923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3763a61-e314-4686-bee7-65b68dc93877 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:32.970619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:32.971446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:32.971569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:32.971771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:32.972417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:32.974475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.117940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.120952 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3601/7241] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:32 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:33.142735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6301eed-515f-416f-ac1b-c0135fe195ac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.156619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.158059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.158743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.159440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.160670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.164461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.188705 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3641/7242] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:33.194008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.215278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0b6d-6867-43a8-a9f7-f278627fad49 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.234196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.238476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.251812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.258732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.258732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.258732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.262044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.267439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.289395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e7647-b7c7-4806-b84e-04ab4ecd5aea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.299086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.300671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.303328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.306794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] PATH_INFO: `/v3/users/6c3df19242b74f35ae584ff5fed9e508` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.311391 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3602/7243] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:33.316061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.317645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3df19242b74f35ae584ff5fed9e508)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.321078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.351667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f69ba-d731-4ca3-8f38-10c244be5ed9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.374088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.375356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.375923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.377308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] PATH_INFO: `/v3/projects/0e26d2dda78c4793b14106afc3e3ccb8/users/a36d27967c6647a1be17ac8d7f5f1fef/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.441771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e26d2dda78c4793b14106afc3e3ccb8, user_id=a36d27967c6647a1be17ac8d7f5f1fef, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:33.451850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:33.599956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3df19242b74f35ae584ff5fed9e508'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:33.639580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3603/7244] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:33 2022] PUT /identity/v3/projects/0e26d2dda78c4793b14106afc3e3ccb8/users/a36d27967c6647a1be17ac8d7f5f1fef/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:33.640946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:33.646221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.767639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3df19242b74f35ae584ff5fed9e508'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:33.791440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3df19242b74f35ae584ff5fed9e508'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:33.802496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3df19242b74f35ae584ff5fed9e508'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:33.810256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3fd00743-65a2-48ce-ba7b-91801d459dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3df19242b74f35ae584ff5fed9e508'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:33.814753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40146f9-2218-40fd-92e4-63338278adc1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:33.817318 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3642/7245] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:33 2022] DELETE /identity/v3/users/6c3df19242b74f35ae584ff5fed9e508 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:33.818953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1acd8-562b-41d5-969f-8e7f20b35664 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.819282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1acd8-562b-41d5-969f-8e7f20b35664 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.819742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1acd8-562b-41d5-969f-8e7f20b35664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.891875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-42f1acd8-562b-41d5-969f-8e7f20b35664 None None] MFA Rules not processed for user `a36d27967c6647a1be17ac8d7f5f1fef`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:33.893823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-42f1acd8-562b-41d5-969f-8e7f20b35664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:33.940695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:33.942295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:33.942295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:33.942665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:33.947157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:34.069270 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3643/7246] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:34.072239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:34.073329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:34.073329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:34.117475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:34.124179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:34.175200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:34.177838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:34.214937 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3604/7247] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:34.215824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:34.224368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:34.286676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3644/7248] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:34.299658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:34.342377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:34.429490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b782-fa52-4171-b6f3-b45d193206d5 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:34.437924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:34.438705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:34.439396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:34.439912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:34.441045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:34.467092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:34.470072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:34.475583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe638fc-83a6-4716-8fc2-c888e7f0a0a5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:34.492237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:34.493280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:34.495361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3605/7249] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:34.495846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:34.497220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:34.538521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:34.542035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a39251-de84-4b35-808b-6ed8cc318bff service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:34.596930 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3645/7250] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:56:34.675220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:34.676746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:34.710639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f133f-1cca-4d22-8a1b-e2b1aacb2a6d service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:34.735874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:34.736937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:34.738102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:34.742265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] PATH_INFO: `/v3/users/a36d27967c6647a1be17ac8d7f5f1fef` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:34.743798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36d27967c6647a1be17ac8d7f5f1fef)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:34.746520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:35.071416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36d27967c6647a1be17ac8d7f5f1fef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:35.190333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36d27967c6647a1be17ac8d7f5f1fef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:35.217150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36d27967c6647a1be17ac8d7f5f1fef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:35.217150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36d27967c6647a1be17ac8d7f5f1fef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:35.217150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36d27967c6647a1be17ac8d7f5f1fef'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:35.282899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3606/7251] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:34 2022] DELETE /identity/v3/users/a36d27967c6647a1be17ac8d7f5f1fef => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:35.284317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:35.285831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:35.286107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:35.751065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:35.751065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:35.840450 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3646/7252] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:36.059468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:36.072692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:36.075941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:36.099669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:36.103590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:36.129201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166f12-ba2a-4826-8a28-e38c178008d0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:36.151804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:36.160382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:36.160382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:36.160382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] PATH_INFO: `/v3/projects/33b89034367e44ba805f5e730402c7b7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:36.162056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b89034367e44ba805f5e730402c7b7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:36.172528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:36.412451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3f0ed-bf2a-4a73-95cd-7289ca580f2d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:36.434994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:36.435883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:36.436267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:36.436939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:36.482596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:36.492536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:36.509128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b89034367e44ba805f5e730402c7b7', 'request_id': 'req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:36.520912 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3647/7253] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:36.530323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b89034367e44ba805f5e730402c7b7', 'request_id': 'req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:36.637290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b89034367e44ba805f5e730402c7b7', 'request_id': 'req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:36.680594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] The token cache is being invalidate because project 33b89034367e44ba805f5e730402c7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:36.680594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:36.680594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:36.688993 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3607/7254] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:36 2022] DELETE /identity/v3/projects/33b89034367e44ba805f5e730402c7b7 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:36.690356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:36.710189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af3325-a170-492e-9233-0806341bd4ff service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:36.981854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:37.042248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:37.047783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:37.049620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:37.050466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] PATH_INFO: `/v3/users/709b09ce27654fb89abfda2810bf3884` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:37.063563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=709b09ce27654fb89abfda2810bf3884)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:37.078588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:37.624969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709b09ce27654fb89abfda2810bf3884'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:37.731017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709b09ce27654fb89abfda2810bf3884'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:37.834492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709b09ce27654fb89abfda2810bf3884'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:37.882532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709b09ce27654fb89abfda2810bf3884'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:37.885115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1609e1df-4dc2-4915-a6b3-8b588cb32115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709b09ce27654fb89abfda2810bf3884'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:37.902760 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3648/7255] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:36 2022] DELETE /identity/v3/users/709b09ce27654fb89abfda2810bf3884 => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:38.046258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:38.609351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:38.612042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:38.653255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:38.697526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf0eaa-a6fc-4f9e-832b-2c995d7e2ed9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:38.750431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:39.089650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:39.095379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:39.112654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:39.112654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] PATH_INFO: `/v3/projects/0e26d2dda78c4793b14106afc3e3ccb8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:39.112654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e26d2dda78c4793b14106afc3e3ccb8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:39.120744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:39.351900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e26d2dda78c4793b14106afc3e3ccb8', 'request_id': 'req-f8a2d9bc-483f-404c-9903-948768aad3cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:39.382391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e26d2dda78c4793b14106afc3e3ccb8', 'request_id': 'req-f8a2d9bc-483f-404c-9903-948768aad3cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:39.481690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e26d2dda78c4793b14106afc3e3ccb8', 'request_id': 'req-f8a2d9bc-483f-404c-9903-948768aad3cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:39.521016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] The token cache is being invalidate because project 0e26d2dda78c4793b14106afc3e3ccb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:39.521545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:39.527287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f8a2d9bc-483f-404c-9903-948768aad3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:39.552224 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3608/7256] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:38 2022] DELETE /identity/v3/projects/0e26d2dda78c4793b14106afc3e3ccb8 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:39.553482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:39.554618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:39.555221 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:39.719959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:39.725587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:39.970896 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3649/7257] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:39.972684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:39.973219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:39.973741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.104860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:40.136414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:40.175672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3609/7258] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:40.182554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:40.199818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afb887-a642-4ef8-8e21-21b54ac0788c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:40.213076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:40.214895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:40.215402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:40.215840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.216760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:40.217442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:40.235338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:40.285893 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3650/7259] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:40.291213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:40.303378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951726b-124c-4982-95c4-cc092e8525c0 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:40.322215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:40.322929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:40.323105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:40.323376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.339122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:40.345599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:40.509372 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3610/7260] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:40 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:40.514990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:40.530873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a203e-2cfc-4392-a8d9-cd689d8e68ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:40.625622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:40.680606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:40.682008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:40.682617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:40.684127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.686213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:40.691151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:40.827108 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3651/7261] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:40 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:40.833304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:40.850121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00705726-bb82-473c-968b-51a36c35ec74 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:40.868844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:40.869491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:40.869766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:40.870030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.870723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:40.874762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:40.891913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:40.907706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3611/7262] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:40.908143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:40.937391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418351e-e3f9-481d-8515-942ba1fa7ecc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:40.968944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:40.969576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:40.969850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:40.970119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:40.970762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:40.972756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43981c91-8194-43b8-8439-f9f5950f8faf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:41.017445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:41.025275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3652/7263] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:56:41.041117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bb379-b253-47c7-b08d-ebad13f490a9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:41.076089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:41.076089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:41.076089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:41.076089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] PATH_INFO: `/v3/projects/d2f96e5e124549f6aee09ca22970dea6/users/fc59e58185494a95b679dc2082b09d08/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:41.142121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f96e5e124549f6aee09ca22970dea6, user_id=fc59e58185494a95b679dc2082b09d08, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:41.145740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:41.238340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3612/7264] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:41 2022] PUT /identity/v3/projects/d2f96e5e124549f6aee09ca22970dea6/users/fc59e58185494a95b679dc2082b09d08/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:41.265933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:41.266370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:41.266744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:41.347218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] MFA Rules not processed for user `fc59e58185494a95b679dc2082b09d08`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:41.357006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:41.396788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:41.396788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:41.494653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:41.639071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a4a8a-b874-4b39-8957-50064fb657da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:41.646968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:41.647867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:41.648260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:41.648630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] PATH_INFO: `/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:41.650989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3455d38f8f6e4aa984e55f22fd981ad7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:41.653489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:41.657453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3653/7265] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:41.669303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:41.693641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515c73-7656-45b5-8d5b-8576703816e2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:41.703420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:41.706328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:41.707219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:41.707982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:41.709676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:41.716024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:41.898957 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3654/7266] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:41 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:41.902191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:41.940006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3455d38f8f6e4aa984e55f22fd981ad7', 'request_id': 'req-341005e8-4507-4559-a239-720adc0251a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:41.968449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3455d38f8f6e4aa984e55f22fd981ad7', 'request_id': 'req-341005e8-4507-4559-a239-720adc0251a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:42.079000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3455d38f8f6e4aa984e55f22fd981ad7', 'request_id': 'req-341005e8-4507-4559-a239-720adc0251a5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:42.115567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] The token cache is being invalidate because project 3455d38f8f6e4aa984e55f22fd981ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:42.125262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:42.128593 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-341005e8-4507-4559-a239-720adc0251a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:42.136802 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3613/7267] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:41 2022] DELETE /identity/v3/projects/3455d38f8f6e4aa984e55f22fd981ad7 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:42.155306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96536f7e-52ea-40e2-af89-2eea1f0c4a6e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.155976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96536f7e-52ea-40e2-af89-2eea1f0c4a6e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.155976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96536f7e-52ea-40e2-af89-2eea1f0c4a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.173611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:42.190536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58cece-e1c3-4af2-af3d-7f5efb108df7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.205681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.206326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.206603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.206947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.207600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.214123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.233111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-96536f7e-52ea-40e2-af89-2eea1f0c4a6e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:42.235326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96536f7e-52ea-40e2-af89-2eea1f0c4a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:42.283897 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3614/7268] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:42.286310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.286874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.287326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.337405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:42.337667 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3655/7269] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:41 2022] POST /identity/v3/users => generated 295 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:42.339212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:42.343449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.345208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:42.351339 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3615/7270] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:42.360660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.392681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1eef9-5188-4a7d-80f3-12ce1aa5cad1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.412674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4740985-7842-47c7-88d3-5db1fcefcfaf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.420413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.420413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.420413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.421372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.421372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.422998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.445415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.446402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.446732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.447010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.448632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:42.452741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:42.453404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.455201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3656/7271] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:42.461952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.464748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.507506 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3616/7272] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:42.509214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.515175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fe378-bc8c-4293-b086-accf3142f99e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.534573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e51890-6a5f-4e02-a8a9-59337dffaef7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.542752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.543600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.543600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.543940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.544090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.544773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.546667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.547081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.547231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.547801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] PATH_INFO: `/v3/projects/90478e6c54d4437d9963c6df9e4236f4/users/958357074bf143259539efce30e6946a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.643594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90478e6c54d4437d9963c6df9e4236f4, user_id=958357074bf143259539efce30e6946a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.659986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.740668 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3617/7273] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:42 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:42.763018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.797783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3657/7274] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:42 2022] PUT /identity/v3/projects/90478e6c54d4437d9963c6df9e4236f4/users/958357074bf143259539efce30e6946a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:42.802516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:42.934782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4fb609-0bef-482d-ab07-3d1538e818b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:42.952710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:42.953746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:42.954409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:42.955705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:42.958362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:42.962015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:42.993121 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3658/7275] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:43.000720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:43.026794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b9d4-ff73-4910-9ba8-589451947365 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.031733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652635b-278e-40a4-ba22-702c3d25edb6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.035333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.036992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.037610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.038875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] PATH_INFO: `/v3/projects/90478e6c54d4437d9963c6df9e4236f4/users/958357074bf143259539efce30e6946a/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.045034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] RBAC: Authorizing `identity:create_grant(project_id=90478e6c54d4437d9963c6df9e4236f4, user_id=958357074bf143259539efce30e6946a, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.049094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.050009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.050619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.051453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.054648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f05de3-c294-4c8e-a27c-3481d83a94da admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:43.054929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.059414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:43.073506 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3659/7276] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:42 2022] PUT /identity/v3/projects/90478e6c54d4437d9963c6df9e4236f4/users/958357074bf143259539efce30e6946a/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:43.084475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.089294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.089874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.139412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] MFA Rules not processed for user `958357074bf143259539efce30e6946a`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:43.141337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:43.227483 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3618/7277] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:42 2022] POST /identity/v3/users => generated 292 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:43.233201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:43.258677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07db2e-8b51-4498-9ae9-7fbe657d1307 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.263228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:43.348813 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3660/7278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:43.398358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.399047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.399332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.399610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.400276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.402005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:43.433052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:43.443052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3619/7279] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:43.445932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:43.451448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:43.454015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c9e23-2375-47f6-b8ab-fafb72a4de83 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.468804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.474734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.474734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.474734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.474734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.486839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:43.531368 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3661/7280] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:43.532787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:43.561890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800eda5-c7a2-4c16-bc39-40c8adffe92a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.577914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.578637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.579063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.579433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] PATH_INFO: `/v3/projects/ca6ec65d2e7344f28da1f942b389c2ea/users/6a15488bb2764fd7b06b8d62f4d66295/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.612434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6ec65d2e7344f28da1f942b389c2ea, user_id=6a15488bb2764fd7b06b8d62f4d66295, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.615197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df84d12-0bdb-4d8e-99fd-90933bf20215 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:43.697946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33259e33-c0e6-4314-b42b-6f41c76aceef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:43.722616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:43.723173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.723452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.723725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.731299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3662/7281] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:43 2022] PUT /identity/v3/projects/ca6ec65d2e7344f28da1f942b389c2ea/users/6a15488bb2764fd7b06b8d62f4d66295/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:43.733300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:43.748508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:43.749041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:43.749469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:43.874720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] MFA Rules not processed for user `6a15488bb2764fd7b06b8d62f4d66295`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:43.876099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:43.974559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:43.981461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:43.983009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:44.005786 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3620/7282] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:44.061663 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3663/7283] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:44.113501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:44.113501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:44.127736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d04d1-a3fa-429d-b6da-e85801c08152 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:44.298196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:44.298887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:44.299104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:44.299378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:44.330055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:44.331821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996f0b0-e773-4f9a-b313-4e8e4f8989c4 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:44.365109 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3621/7284] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:44.493626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:44.640878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:45.206546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:45.947466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:45.949273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:46.204354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b874f-36ab-4c71-a15e-347715e2d76e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:46.221642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:46.222761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:46.223263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:46.223764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] PATH_INFO: `/v3/users/d3fe76722a46469799bd5b72b36c7142` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:46.230330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3fe76722a46469799bd5b72b36c7142)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:46.241903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:46.321708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:46.614564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3fe76722a46469799bd5b72b36c7142'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:46.693993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3fe76722a46469799bd5b72b36c7142'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:46.741720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3fe76722a46469799bd5b72b36c7142'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:46.813033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3fe76722a46469799bd5b72b36c7142'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:46.820055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3fe76722a46469799bd5b72b36c7142'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:46.867643 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3664/7285] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:45 2022] DELETE /identity/v3/users/d3fe76722a46469799bd5b72b36c7142 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:46.869289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:46.869606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:46.869883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:46.926853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:46.934897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:47.238505 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3622/7286] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:47.332838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:47.407509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:47.412052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:47.790118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ed2c-16be-47df-9893-0149562911bb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:47.821757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:47.822816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:47.823331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:47.823790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:47.899102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:47.915031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695603-8a16-49bb-a206-a2b13bf58aae service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:48.002808 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3665/7287] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:56:48.328364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:48.431827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:48.633696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:48.640782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:48.691550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa0aab-4261-430b-b2ed-62aee4513450 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:48.715046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:48.715383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:48.719111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:48.719801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] PATH_INFO: `/v3/users/2a44edc6a7c74be781b02ce97bb0b1c1` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:48.726116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a44edc6a7c74be781b02ce97bb0b1c1)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:48.735129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:49.110066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a44edc6a7c74be781b02ce97bb0b1c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:49.220335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a44edc6a7c74be781b02ce97bb0b1c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:49.252129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a44edc6a7c74be781b02ce97bb0b1c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:49.269115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a44edc6a7c74be781b02ce97bb0b1c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:49.277441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a44edc6a7c74be781b02ce97bb0b1c1'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:49.353851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3623/7288] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:48 2022] DELETE /identity/v3/users/2a44edc6a7c74be781b02ce97bb0b1c1 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:49.363369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:49.363369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:49.363369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:49.407782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:49.410811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:49.593773 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3666/7289] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:49.605203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:49.606971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:49.626049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:49.795484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0d7-c81c-46c1-b56e-90fcc461926d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:49.831008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:49.832457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:49.833398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:49.833868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:49.854926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:49.857634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:49.888234 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3624/7290] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:56:49.951465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:50.345994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:50.945383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:51.120409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:51.172556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:51.174714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:51.233090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af5db7-0c58-453e-b2e7-8761c448fc3e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:51.249204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:51.250548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:51.251212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:51.251837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] PATH_INFO: `/v3/projects/a85088ae46044a2fa99fb3108b1e2003` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:51.275061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85088ae46044a2fa99fb3108b1e2003)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:51.283725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:51.503294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85088ae46044a2fa99fb3108b1e2003', 'request_id': 'req-baf60d00-f6c3-4899-885d-3add4d89dced'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:51.531886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85088ae46044a2fa99fb3108b1e2003', 'request_id': 'req-baf60d00-f6c3-4899-885d-3add4d89dced'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:51.541649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85088ae46044a2fa99fb3108b1e2003', 'request_id': 'req-baf60d00-f6c3-4899-885d-3add4d89dced'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:51.738444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] The token cache is being invalidate because project a85088ae46044a2fa99fb3108b1e2003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:51.739096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:51.740774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:51.756429 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3667/7291] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:51 2022] DELETE /identity/v3/projects/a85088ae46044a2fa99fb3108b1e2003 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:51.758228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:51.769372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:51.772989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:51.814714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad9fa-a29c-4492-9035-93adb5cdc5ff service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:51.886022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:52.002328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:52.006632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:52.006632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:52.006632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] PATH_INFO: `/v3/users/93573a4c65e14359bfb1c414f7e8dd5a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:52.006632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93573a4c65e14359bfb1c414f7e8dd5a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:52.007773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:52.140170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf60d00-f6c3-4899-885d-3add4d89dced admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:52.154377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:52.157780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:52.157780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:52.157780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] PATH_INFO: `/v3/projects/751f0e302f1a4c1baf4fbafc7e62a261` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:52.159554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=751f0e302f1a4c1baf4fbafc7e62a261)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:52.161788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:52.236842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93573a4c65e14359bfb1c414f7e8dd5a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.349863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93573a4c65e14359bfb1c414f7e8dd5a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.362082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '751f0e302f1a4c1baf4fbafc7e62a261', 'request_id': 'req-a217fc63-9834-4713-a5d2-7ed6d719c395'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.378592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '751f0e302f1a4c1baf4fbafc7e62a261', 'request_id': 'req-a217fc63-9834-4713-a5d2-7ed6d719c395'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.399084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '751f0e302f1a4c1baf4fbafc7e62a261', 'request_id': 'req-a217fc63-9834-4713-a5d2-7ed6d719c395'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.399669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93573a4c65e14359bfb1c414f7e8dd5a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.401160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93573a4c65e14359bfb1c414f7e8dd5a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.402659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93573a4c65e14359bfb1c414f7e8dd5a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.462616 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3625/7292] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:51 2022] DELETE /identity/v3/users/93573a4c65e14359bfb1c414f7e8dd5a => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:52.551833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] The token cache is being invalidate because project 751f0e302f1a4c1baf4fbafc7e62a261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:52.552323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.563810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:52.576778 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3668/7293] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:51 2022] DELETE /identity/v3/projects/751f0e302f1a4c1baf4fbafc7e62a261 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:52.580893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:52.583905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:52.918083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:52.925892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee3e0-a65c-4ba2-aeb2-df1b0efb38d6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:52.970009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:52.972663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:52.976109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:52.980062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] PATH_INFO: `/v3/users/069ecd86626a4f408fd60baac8576b34` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:52.987881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=069ecd86626a4f408fd60baac8576b34)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:52.997126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:53.082583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:53.229272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069ecd86626a4f408fd60baac8576b34'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.343673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069ecd86626a4f408fd60baac8576b34'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.397294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069ecd86626a4f408fd60baac8576b34'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.398148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069ecd86626a4f408fd60baac8576b34'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.399029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069ecd86626a4f408fd60baac8576b34'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:53.438854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3626/7294] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:52 2022] DELETE /identity/v3/users/069ecd86626a4f408fd60baac8576b34 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:54.562793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:54.624423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:54.627545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:54.684975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:54.823394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:54.825910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:54.896073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc63-9834-4713-a5d2-7ed6d719c395 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:55.074692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d31c92-4277-4091-82d7-64eb98226c85 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:55.108402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:55.111308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:55.112826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:55.113265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:55.113906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:55.114322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:55.114837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] PATH_INFO: `/v3/projects/5d90babe25d241209650624d3c50799f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:55.116142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:55.118608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d90babe25d241209650624d3c50799f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:55.121419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:55.122342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:55.130415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:55.298397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d90babe25d241209650624d3c50799f', 'request_id': 'req-718145df-2082-4b91-8391-94bd0305d6a1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:55.316418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:55.321265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:55.322112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d90babe25d241209650624d3c50799f', 'request_id': 'req-718145df-2082-4b91-8391-94bd0305d6a1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:55.340306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d90babe25d241209650624d3c50799f', 'request_id': 'req-718145df-2082-4b91-8391-94bd0305d6a1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:55.348637 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3627/7295] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:56:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:56:55.503792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] The token cache is being invalidate because project 5d90babe25d241209650624d3c50799f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:55.504168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:55.504944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:55.511253 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3669/7296] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:54 2022] DELETE /identity/v3/projects/5d90babe25d241209650624d3c50799f => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:55.511673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:55.513234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:55.557693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7e5dc-42fb-465e-bfd6-ce0474c6e0dd service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:55.639361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:55.641443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:55.733005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:55.734113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:55.734399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:55.734673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] PATH_INFO: `/v3/users/d61a314650364951884de561b8462f67` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:55.735936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61a314650364951884de561b8462f67)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:55.737965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:55.769158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718145df-2082-4b91-8391-94bd0305d6a1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:55.787106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:55.787484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:55.787809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:55.788090 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] PATH_INFO: `/v3/projects/ad6f87965fe945bea32b0b2825048524` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:55.789379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6f87965fe945bea32b0b2825048524)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:55.792443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:56.032383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:56.159486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6f87965fe945bea32b0b2825048524', 'request_id': 'req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.168656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6f87965fe945bea32b0b2825048524', 'request_id': 'req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.170188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61a314650364951884de561b8462f67'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.183560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6f87965fe945bea32b0b2825048524', 'request_id': 'req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.314839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61a314650364951884de561b8462f67'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.359908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61a314650364951884de561b8462f67'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.361022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61a314650364951884de561b8462f67'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.365437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-482a938a-5797-4048-9e7c-f9fe120488e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61a314650364951884de561b8462f67'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.399280 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3628/7297] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:56:55 2022] DELETE /identity/v3/users/d61a314650364951884de561b8462f67 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:56:56.418259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:56.489794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] The token cache is being invalidate because project ad6f87965fe945bea32b0b2825048524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:56.493721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.493721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ff1877ef-dcb9-47b5-ac81-e571da7f9a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:56.496310 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3670/7298] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:55 2022] DELETE /identity/v3/projects/ad6f87965fe945bea32b0b2825048524 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:56.501571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:56.501861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:56.502474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:56.586474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:56.588843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:56.795134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3629/7299] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:56.804080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:56.804714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:56.805792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:56.890825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:56.904594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:56.941691 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3671/7300] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:56.945462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:56.962290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b37c-4611-4ef9-8aa8-9701fde8164c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:56.976728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:56.978151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:56.979660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:56.981272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:56.983621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:56.984124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:56.987651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:57.008098 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3630/7301] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:56:57.014073 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:57.027689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3372461-b707-44f6-bf94-601b32d08809 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:57.042361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:57.043085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:57.043368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:57.043646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:57.044364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:57.052208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:57.150904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:57.242168 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3672/7302] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:57 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:57.248734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:57.268144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70def63-0b4e-42b3-9ec5-3d5318023420 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:57.492889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:57.494457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:57.494457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:57.494457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:57.497608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:57.500937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:57.664913 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3631/7303] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:57 2022] POST /identity/v3/users => generated 293 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:56:57.669832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:57.690075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7f961-c2d4-4eac-9ff2-0a824d3e8416 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:57.705671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:57.705671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:57.705671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:57.705671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:57.707460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:57.719063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:57.761131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3673/7304] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:57.761662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:57.780145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19dda-2ad9-4601-bebc-9c7b04f81679 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:57.805027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:57.805831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:57.805953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:57.808511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:57.810020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:57.813234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d263d2e-0c7b-47ec-bde4-4b4f423ad7ba admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:57.862345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:57.862930 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3632/7305] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:56:57.877928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9e506-aec6-400c-afa3-a2114410ad72 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:57.903194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:57.904377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:57.910877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:57.913188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] PATH_INFO: `/v3/projects/5da8c82d99974d6f80fd156432e8f43e/users/6db87dd47288466c83a1cfa8223e7ed2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:57.954087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da8c82d99974d6f80fd156432e8f43e, user_id=6db87dd47288466c83a1cfa8223e7ed2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:57.960280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:58.078428 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3674/7306] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:57 2022] PUT /identity/v3/projects/5da8c82d99974d6f80fd156432e8f43e/users/6db87dd47288466c83a1cfa8223e7ed2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:58.090122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:58.090411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:58.091109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:58.163512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:58.170674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] MFA Rules not processed for user `6db87dd47288466c83a1cfa8223e7ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:58.180452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:58.354052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3633/7307] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:58.358513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:58.467258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0d1a4-9dd0-43da-9bf1-aef14a905958 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:58.473258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:58.474247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:58.475200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:58.475636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:58.476575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:58.479629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:58.515482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:58.517198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:58.554205 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf514fb-ab13-4da2-b630-e3583c9f526f None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:58.560990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:58.562923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:58.563488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:58.563639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] PATH_INFO: `/v3/projects/330e25da487f4023bde999fff62b1384` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:58.565137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330e25da487f4023bde999fff62b1384)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:58.567097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:58.654165 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3675/7308] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:58 2022] POST /identity/v3/projects => generated 385 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:58.659514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:58.765403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ba75-44c7-4a8c-8c02-9a2ffa3f21ec admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:58.771413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:58.772717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:58.773289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:58.773844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:58.774980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:58.777560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:58.823360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330e25da487f4023bde999fff62b1384', 'request_id': 'req-681c25a6-b1b8-428a-b06f-1308ba301a56'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:58.834076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330e25da487f4023bde999fff62b1384', 'request_id': 'req-681c25a6-b1b8-428a-b06f-1308ba301a56'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:58.962176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330e25da487f4023bde999fff62b1384', 'request_id': 'req-681c25a6-b1b8-428a-b06f-1308ba301a56'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:58.979500 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3676/7309] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:58 2022] POST /identity/v3/users => generated 293 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:58.983389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.008984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] The token cache is being invalidate because project 330e25da487f4023bde999fff62b1384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:56:59.009709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:59.012939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-681c25a6-b1b8-428a-b06f-1308ba301a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:56:59.024947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3634/7310] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:56:58 2022] DELETE /identity/v3/projects/330e25da487f4023bde999fff62b1384 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:59.029034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d1ae4-6ff1-4603-89ff-a061626587e7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.032381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b790-aa2a-41bb-ad1a-50d21ad025c9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.032793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b790-aa2a-41bb-ad1a-50d21ad025c9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.032993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4b790-aa2a-41bb-ad1a-50d21ad025c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.125607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7ce4b790-aa2a-41bb-ad1a-50d21ad025c9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:59.129075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7ce4b790-aa2a-41bb-ad1a-50d21ad025c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:59.233922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.234951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.235430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.235896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.236776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.238801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.282951 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3677/7311] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:59.284140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.288996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:59.320776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927a3fe-4aa0-4f21-b248-7f9d73e476c0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.322431 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3635/7312] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:59.329480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.330049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.330479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.337210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:59.344046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.344821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.345178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.345527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.346272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.350375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.376106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:59.377841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:59.390803 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3678/7313] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:56:59.391986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.407791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:59.414835 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3636/7314] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:56:59.428432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.432124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3d05b-a7e1-41a0-bd47-c9c73ed0a3ee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.447346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.448836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.450644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.450985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] PATH_INFO: `/v3/projects/a4d766e4522f4d56b3846cf7739bdb1b/users/f8350251f8e24f4daf3e565dd21e428c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.462564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92225f75-98d0-43fd-8d3d-76ba2b545f42 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.498468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.499380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.499825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.500242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.501259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:56:59.501725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.503549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.510328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d766e4522f4d56b3846cf7739bdb1b, user_id=f8350251f8e24f4daf3e565dd21e428c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.513766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df6030-d12c-4b6c-9cc3-aedc7ee16028 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.571410 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3637/7315] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:56:59.575942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.590681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea4769-62f7-48ed-b7bc-fc91f058bc5f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.606394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.607185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.607467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.608387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.608387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.610619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.649419 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3679/7316] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:56:59 2022] PUT /identity/v3/projects/a4d766e4522f4d56b3846cf7739bdb1b/users/f8350251f8e24f4daf3e565dd21e428c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:56:59.663327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.664238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.664908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.754140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] MFA Rules not processed for user `f8350251f8e24f4daf3e565dd21e428c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:56:59.756543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:56:59.774209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:59.788010 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3638/7317] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:56:59.792001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:56:59.879499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:56:59.945092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb78bc-1649-40c8-bbc7-25b7a7235f8d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:56:59.953890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:56:59.954540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:56:59.954819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:56:59.955093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:56:59.955759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:56:59.956967 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3680/7318] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:56:59.957837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:56:59.965158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:00.122673 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3639/7319] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/users => generated 292 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:57:00.126818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:00.150737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4acddc-7b67-4ffa-bf3b-a4b2922112d4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:00.179932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:00.180718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:00.181027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:00.181305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:00.181976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:00.187184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:00.187626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873a1e2-906f-4b38-9932-1d6d4dfca947 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:00.203814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:00.205299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:00.206338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:00.209651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:00.210642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:00.217277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:00.226106 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3640/7320] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:00.230705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:00.260011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c47ff-8b07-4c58-92e3-7d7028abe24f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:00.269129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:00.270046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:00.272310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:00.272310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:00.272310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:00.273800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:00.303941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3641/7321] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:00.308753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:00.330336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a72222-3ed0-460e-b220-ccb27bfbfb8d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:00.342154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:00.343000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:00.343419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:00.343948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] PATH_INFO: `/v3/projects/2a9f3d071f3045a8bb12b9b1657c2683/users/f10bd0cb5de8407fb1b7f4f17bc00c9c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:00.396807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9f3d071f3045a8bb12b9b1657c2683, user_id=f10bd0cb5de8407fb1b7f4f17bc00c9c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:00.401940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d4b74-995c-43c3-af0e-725fa977eae6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:00.409045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:00.426860 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3681/7322] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:56:59 2022] POST /identity/v3/projects => generated 383 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:57:00.441624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:00.534133 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3642/7323] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:00 2022] PUT /identity/v3/projects/2a9f3d071f3045a8bb12b9b1657c2683/users/f10bd0cb5de8407fb1b7f4f17bc00c9c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:57:00.546525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:00.547556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:00.548063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:00.669382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] MFA Rules not processed for user `f10bd0cb5de8407fb1b7f4f17bc00c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:00.670830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:00.835553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc49b5c-5bd8-4778-8cce-326198ca627d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:00.947037 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3643/7324] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:57:00.949443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:01.150098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:01.153081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:01.154351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:01.154986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:01.158593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:01.161934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:01.197560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed26cc-df8f-4434-91f6-3e986a4bac5d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:01.217603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:01.219084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:01.220195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:01.221383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:01.222279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:01.224799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:01.676225 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3682/7325] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:00 2022] POST /identity/v3/users => generated 298 bytes in 1227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:01.679719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:01.712953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375fc3c-f443-420a-8df3-c1518ed37e44 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:01.718572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:01.719567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:01.720725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:01.725530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:01.726496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:01.728736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:01.786065 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3683/7326] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:57:01.798756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:01.806969 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3644/7327] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:00 2022] POST /identity/v3/projects => generated 385 bytes in 859 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:01.811982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:01.848626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66768b3b-6b88-4542-9643-f2f12967166f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.045395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.046153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.046434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.046712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] PATH_INFO: `/v3/projects/d8388084e8c3407ca8bbb2280312bd5d/users/249cd9116efb4b9c8203ad47b6697821/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.080349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5b0b4-1318-4633-8738-896014aaf14b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.102469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8388084e8c3407ca8bbb2280312bd5d, user_id=249cd9116efb4b9c8203ad47b6697821, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:02.105892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:02.107307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.109681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.109681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.113398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.113398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:02.116465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:02.161846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:02.235560 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3684/7328] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:01 2022] PUT /identity/v3/projects/d8388084e8c3407ca8bbb2280312bd5d/users/249cd9116efb4b9c8203ad47b6697821/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:02.240610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:02.301592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:02.307152 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3645/7329] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:01 2022] POST /identity/v3/users => generated 299 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:02.318391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:02.348999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e59af9d-258f-411d-ac6b-bd2b3960ed18 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.391201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2be0e4-fa1a-4e4a-adf7-f7ab8a2f2f50 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.397105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.399015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.399949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.400199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.403350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:02.407609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:02.437074 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3685/7330] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:57:02.441781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:02.473792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09fe14-b608-4f1b-b405-1084b944ac37 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.487399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.488982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.490276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.490718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] PATH_INFO: `/v3/projects/d8388084e8c3407ca8bbb2280312bd5d/users/249cd9116efb4b9c8203ad47b6697821/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.494705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8388084e8c3407ca8bbb2280312bd5d, user_id=249cd9116efb4b9c8203ad47b6697821, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:02.500819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32f02a-abc5-4ea9-8a86-1d6a332d65ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:02.524097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3686/7331] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:02 2022] PUT /identity/v3/projects/d8388084e8c3407ca8bbb2280312bd5d/users/249cd9116efb4b9c8203ad47b6697821/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:02.560361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.561684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.563417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.596712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.598937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.599466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.599990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:02.604743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:02.608196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:02.657981 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3646/7332] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:02.662959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] MFA Rules not processed for user `249cd9116efb4b9c8203ad47b6697821`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:02.664166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:02.665358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:02.727168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c89f-5e5d-46d0-8209-cde56a02079d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:02.928656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:02.930298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:02.930940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:02.931685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] PATH_INFO: `/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec/users/ce62c8df39174323a8243e3255f862d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:03.031984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e5e8cec8aa4f078a0f408cca94aaec, user_id=ce62c8df39174323a8243e3255f862d3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:03.038422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:03.053881 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3687/7333] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:03.069206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:03.071583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:03.180576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:03.186504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3647/7334] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:02 2022] PUT /identity/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec/users/ce62c8df39174323a8243e3255f862d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:03.194817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:03.316329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bb0a1-3589-487e-bca8-d6fcc1effe06 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:03.434461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:03.435021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:03.435305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:03.435583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:03.444986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:03.540826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f6098-9a2a-4ad9-b506-a9d8b5859035 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:03.556091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:03.556777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:03.557088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:03.557362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:03.562860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:03.566189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:03.610563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:03.613664 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3648/7335] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:03.620295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:03.629857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5fa02-71d9-4ac4-b73a-b589aed68cbc service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:03.676208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76dcb7-4e1b-4b08-9650-48bad66d42bc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:03.676370 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3688/7336] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:03.683040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:03.690371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:03.690833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:03.691253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] PATH_INFO: `/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec/users/ce62c8df39174323a8243e3255f862d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:03.696589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e5e8cec8aa4f078a0f408cca94aaec, user_id=ce62c8df39174323a8243e3255f862d3, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:03.736517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:03.783225 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3649/7337] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:03 2022] PUT /identity/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec/users/ce62c8df39174323a8243e3255f862d3/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:57:03.812884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:03.813405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:03.813899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:03.873741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] MFA Rules not processed for user `ce62c8df39174323a8243e3255f862d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:03.876988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:04.169496 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3689/7338] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:57:04.173171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:04.202432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:04.211091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:04.524787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b2463-bc89-44bd-9573-d626b34a0568 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:04.540498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:04.544960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:04.545494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:04.546034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:04.770484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:04.779887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d98b5-ed35-471d-bc70-43b7e0e6a689 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:04.806205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:04.811905 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3650/7339] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:05.822439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:06.740412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:07.445724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:07.837253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:08.684004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:08.737880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:08.741781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:08.903747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492806a-d1b3-4320-8d33-72972a162b26 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:08.914096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:08.916678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:08.919149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:08.919859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] PATH_INFO: `/v3/users/2e68af718b814d97b55b8fff4daff325` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:08.922416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e68af718b814d97b55b8fff4daff325)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:08.925844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:09.307603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e68af718b814d97b55b8fff4daff325'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:09.395585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e68af718b814d97b55b8fff4daff325'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:09.421621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e68af718b814d97b55b8fff4daff325'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:09.447527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e68af718b814d97b55b8fff4daff325'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:09.447527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e68af718b814d97b55b8fff4daff325'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:09.467798 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3690/7340] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:08 2022] DELETE /identity/v3/users/2e68af718b814d97b55b8fff4daff325 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:09.470418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:09.472044 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:09.472840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:09.500370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:09.502101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:09.540333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:09.541996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:09.662636 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3651/7341] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:09.677137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:09.678896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:09.700386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667d936-030b-46ec-b326-01e72d099b47 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:09.711091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:09.711722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:09.711998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:09.714599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:09.717140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:09.806597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2454c-087d-4801-b712-8e6a6b3aec45 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:09.815673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:09.816236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:09.816530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:09.817135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:09.838822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:09.841779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:09.857488 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3652/7342] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:09.866726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:09.868367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:09.882274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:09.901051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a249047-be6a-4ad2-b249-dad4f1a2f1df service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:09.914128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:09.914128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:09.914128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:09.914128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] PATH_INFO: `/v3/users/6a15488bb2764fd7b06b8d62f4d66295` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:09.915522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a15488bb2764fd7b06b8d62f4d66295)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:09.918654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:09.922082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d88f2f-4429-4085-a40b-f8fccb7c4f88 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:09.974574 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3691/7343] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:57:10.143604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:10.342038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a15488bb2764fd7b06b8d62f4d66295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:10.452347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a15488bb2764fd7b06b8d62f4d66295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:10.479327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a15488bb2764fd7b06b8d62f4d66295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:10.486697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a15488bb2764fd7b06b8d62f4d66295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:10.487443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a15488bb2764fd7b06b8d62f4d66295'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:10.530418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3653/7344] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:09 2022] DELETE /identity/v3/users/6a15488bb2764fd7b06b8d62f4d66295 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:10.532527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:10.532807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:10.533253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:10.596746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:10.596746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:10.761501 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3692/7345] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:10.771715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:10.774093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:10.903260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e28d46-4645-49f4-adf8-a2d62cfe4e12 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:10.913231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:10.917688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:10.917688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:10.917688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:10.924627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:10.926028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:10.953571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51546ded-1bd0-4be0-ba14-4ee9ede44d99 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:10.972842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:10.988156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:10.988156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:10.988156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] PATH_INFO: `/v3/projects/5340fac0485940499d0a0e647871e557` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:10.991802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:10.997972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:10.998243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5340fac0485940499d0a0e647871e557)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:11.013001 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3654/7346] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:11.013261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:11.160275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:11.257406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5340fac0485940499d0a0e647871e557', 'request_id': 'req-b8565092-8222-4c1f-b812-4f1667e286f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:11.273141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5340fac0485940499d0a0e647871e557', 'request_id': 'req-b8565092-8222-4c1f-b812-4f1667e286f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:11.290990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5340fac0485940499d0a0e647871e557', 'request_id': 'req-b8565092-8222-4c1f-b812-4f1667e286f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:11.481561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] The token cache is being invalidate because project 5340fac0485940499d0a0e647871e557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:11.482566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:11.483566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:11.492938 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3693/7347] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:10 2022] DELETE /identity/v3/projects/5340fac0485940499d0a0e647871e557 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:11.498814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:11.529746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4bae2-9f72-41a7-b85d-7d3a7376a04f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:11.746382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:11.747064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:11.747826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:11.748450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] PATH_INFO: `/v3/users/2b7034215fd1488a98150974d30926b5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:11.750118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7034215fd1488a98150974d30926b5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:11.763627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:12.038158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:12.039618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:12.079761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8565092-8222-4c1f-b812-4f1667e286f8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:12.107071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:12.107071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:12.107071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:12.107071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] PATH_INFO: `/v3/projects/ca6ec65d2e7344f28da1f942b389c2ea` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:12.108243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6ec65d2e7344f28da1f942b389c2ea)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:12.110759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:12.381177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7034215fd1488a98150974d30926b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.461905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6ec65d2e7344f28da1f942b389c2ea', 'request_id': 'req-45157b80-40bd-4f60-be70-694790ef2949'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.470523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6ec65d2e7344f28da1f942b389c2ea', 'request_id': 'req-45157b80-40bd-4f60-be70-694790ef2949'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.478003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6ec65d2e7344f28da1f942b389c2ea', 'request_id': 'req-45157b80-40bd-4f60-be70-694790ef2949'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.700683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7034215fd1488a98150974d30926b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.762278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7034215fd1488a98150974d30926b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.763532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7034215fd1488a98150974d30926b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.764638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ba687a64-9c24-4a75-973a-a96dd5b9d59e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7034215fd1488a98150974d30926b5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.817159 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3655/7348] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:11 2022] DELETE /identity/v3/users/2b7034215fd1488a98150974d30926b5 => generated 0 bytes in 1315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:12.939691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] The token cache is being invalidate because project ca6ec65d2e7344f28da1f942b389c2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:12.941093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.943661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-45157b80-40bd-4f60-be70-694790ef2949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:12.948713 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3694/7349] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:12 2022] DELETE /identity/v3/projects/ca6ec65d2e7344f28da1f942b389c2ea => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:12.956585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:12.956585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:12.956585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:12.998708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:13.002092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:13.335616 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3656/7350] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:13.344740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:13.345977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:13.346515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:13.396901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:13.403801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:13.428141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:13.435609 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3695/7351] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:13.477184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d4ebed-27b7-43c6-b56e-797d46929c11 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:13.486744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:13.487517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:13.489496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:13.489496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:13.489892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:13.490452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:13.493467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:13.517705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3657/7352] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:13.522297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:13.586151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12d740-f3d6-4491-8c74-ec2577d78242 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:13.597124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:13.598105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:13.598707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:13.599280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:13.601095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:13.603685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:13.729564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:13.732788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:13.769577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60273b0-2897-415b-a153-e5c2da8a29a6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:13.797417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3696/7353] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:13 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:13.803123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:13.806033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:13.810849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:13.822074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:13.822350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] PATH_INFO: `/v3/projects/39f7d1d90b134583b6e57cb34b545b73` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:13.827489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f7d1d90b134583b6e57cb34b545b73)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:13.848747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.002657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad5d7-17a0-4753-9d4c-0f11d2c19722 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.043807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f7d1d90b134583b6e57cb34b545b73', 'request_id': 'req-df5b5df2-7a06-4cc2-b973-edf899b111a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:14.053523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f7d1d90b134583b6e57cb34b545b73', 'request_id': 'req-df5b5df2-7a06-4cc2-b973-edf899b111a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:14.157350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.157350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.157350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.157350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.158468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.158468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef18404-2680-408e-b38d-e1d874146e3b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.384252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f7d1d90b134583b6e57cb34b545b73', 'request_id': 'req-df5b5df2-7a06-4cc2-b973-edf899b111a6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:14.410099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] The token cache is being invalidate because project 39f7d1d90b134583b6e57cb34b545b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:14.410099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:14.410099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:14.410099 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3658/7354] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:13 2022] DELETE /identity/v3/projects/39f7d1d90b134583b6e57cb34b545b73 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:14.410099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.412683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:14.531838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5df2-7a06-4cc2-b973-edf899b111a6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.534558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3697/7355] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:13 2022] POST /identity/v3/users => generated 287 bytes in 732 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:14.537484 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.538462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.538922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.545131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.545770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.546248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.546518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.548886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:14.570394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:14.572480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:14.602399 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3698/7356] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:14.611767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.615113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:14.635900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7666-9c10-4d39-81d4-cbba0b25c420 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.645505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.646316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.646752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.647116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.648012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.650280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93bb5e-7932-4b34-91fd-1f775456cc4b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.659102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.662684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.666270 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3699/7357] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:14.667897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.668613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.669089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.716787 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3659/7358] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:14.718502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.732116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:14.740146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32815b-ae07-4d52-a2fd-68fc0ca811e1 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.742161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:14.744798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:14.763099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.763099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.763099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.763099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.763941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.766020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.772237 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3700/7359] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:14.776581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.789264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3660/7360] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:14.791225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.804882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d2b86-b005-4b59-a890-b0d9258c6a3e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.812521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50592db4-39d8-4565-9bd7-31d5fa00f7ef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.825298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.829945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.831559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.833316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] PATH_INFO: `/v3/projects/f3d0c1caf7064c358553de86bf1c3e52/users/58e7f8c4628d45d6ae285ed8a6ebeb8b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.853834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.866761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.867085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.867423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.868061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:14.868392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.875759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d0c1caf7064c358553de86bf1c3e52, user_id=58e7f8c4628d45d6ae285ed8a6ebeb8b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.886831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.887493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a58479-e92e-457d-90e7-ff02ec5385c3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.917874 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3701/7361] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:57:14.924105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:14.963833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43550e30-91fe-45eb-a029-dfe9b69b9110 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:14.967751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:14.968626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:14.969167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:14.969633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:14.970997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:14.974297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:14.989385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3661/7362] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:14 2022] PUT /identity/v3/projects/f3d0c1caf7064c358553de86bf1c3e52/users/58e7f8c4628d45d6ae285ed8a6ebeb8b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:15.004310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.004637 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.004912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.075049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] MFA Rules not processed for user `58e7f8c4628d45d6ae285ed8a6ebeb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:15.081164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:15.153589 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3702/7363] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:14 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:15.156129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:15.330912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3662/7364] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:15.364532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:15.398156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74a951-e7a4-4980-9c2c-87795197a8ab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:15.437588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:15.438673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.443367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.443367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.443367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:15.446822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:15.541552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a98ccc-baf5-4bec-9ae5-a46c23fe8805 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:15.632990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3703/7365] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:15 2022] POST /identity/v3/users => generated 287 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:15.638654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:15.665497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2291c7-36a1-4c00-a9f6-4899f5a6cbe5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:15.688212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:15.689289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.689810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.690307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.691328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:15.696287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:15.730753 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3704/7366] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:15.731263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:15.732292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:15.739477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.740990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.741934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.751175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494793-eb25-474e-99f6-e7452e77dbbd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:15.770202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:15.770666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.771050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.771428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.772206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:15.774115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:15.808301 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3705/7367] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:15.813497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:15.842404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5363e-4549-4a88-93a7-c1b7ea3c20ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:15.924469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:15.924469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:15.924469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:15.924469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] PATH_INFO: `/v3/projects/687a0c3a36ab4f619c4f80743fcdd9fc/users/88ccaba4c6704a60a4a3eacc1231e34c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:15.924817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=687a0c3a36ab4f619c4f80743fcdd9fc, user_id=88ccaba4c6704a60a4a3eacc1231e34c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:15.924817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:15.971391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:15.973737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925855a-d393-40e7-ae63-fc9474b85307 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:15.992355 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3663/7368] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:16.064446 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3706/7369] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:15 2022] PUT /identity/v3/projects/687a0c3a36ab4f619c4f80743fcdd9fc/users/88ccaba4c6704a60a4a3eacc1231e34c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:16.077724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:16.077996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:16.078271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:16.243955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] MFA Rules not processed for user `88ccaba4c6704a60a4a3eacc1231e34c`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:16.247811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:16.574094 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3664/7370] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:16.585901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:16.589608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:16.766750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbce8e7-651f-4280-9370-932c18fef68d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:16.775501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:16.776613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:16.777054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:16.779084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:16.803485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:16.809759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:16.857027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:16.858027 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3707/7371] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:17.063204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:17.989868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:19.891811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:20.377756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:21.428160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:21.540978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:21.542473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:21.703255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ceb849-b441-4050-a620-ea4697bfa96a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:21.709539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:21.710421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:21.710921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:21.711347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:21.713385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:21.884379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:21.885884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460f2d-13d4-441a-956e-46b50c7e0312 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:21.949208 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3665/7372] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:22.697466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:23.090695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:25.720157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:26.244322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:27.765164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:28.398936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:29.324091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:30.643348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:30.667160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:30.863426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7177eb-ab7b-4c0b-bae8-9be4da65d26d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:30.875609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:30.877868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:30.880958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:30.881516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] PATH_INFO: `/v3/users/58e7f8c4628d45d6ae285ed8a6ebeb8b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:30.883094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e7f8c4628d45d6ae285ed8a6ebeb8b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:30.886980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:31.181792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e7f8c4628d45d6ae285ed8a6ebeb8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:31.347528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e7f8c4628d45d6ae285ed8a6ebeb8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:31.379738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e7f8c4628d45d6ae285ed8a6ebeb8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:31.420306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:31.465817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e7f8c4628d45d6ae285ed8a6ebeb8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:31.466961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e7f8c4628d45d6ae285ed8a6ebeb8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:31.481929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3708/7373] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:30 2022] DELETE /identity/v3/users/58e7f8c4628d45d6ae285ed8a6ebeb8b => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:31.486223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:31.491843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:31.491843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:31.586302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:31.594327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:31.770267 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3666/7374] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:31.805608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:31.807308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:32.021463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd47419-d9cd-423a-9a73-2ddded6b340e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:32.029986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:32.032416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:32.032830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:32.033067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:32.076075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:32.088612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:32.127094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3709/7375] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:32.584670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:33.821925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:33.829959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:33.831912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:33.886456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c37e4-fc51-4f29-913e-45eb31e3eb2a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:33.905471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:33.906209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:33.906502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:33.906783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] PATH_INFO: `/v3/users/d69a96c41e8044cbb4cc311c3d5732e0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:33.908731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69a96c41e8044cbb4cc311c3d5732e0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:33.913953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:34.008070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:34.009890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:34.071399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3482b9e-498a-4eca-bd61-7a46b8a4973d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:34.102480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:34.103141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:34.103423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:34.103720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] PATH_INFO: `/v3/projects/f3d0c1caf7064c358553de86bf1c3e52` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:34.111663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d0c1caf7064c358553de86bf1c3e52)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:34.117701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:34.388111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69a96c41e8044cbb4cc311c3d5732e0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.570926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69a96c41e8044cbb4cc311c3d5732e0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.617165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69a96c41e8044cbb4cc311c3d5732e0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.625235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d0c1caf7064c358553de86bf1c3e52', 'request_id': 'req-565211e5-90d5-4aa4-b5d6-a730574b857e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.625474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69a96c41e8044cbb4cc311c3d5732e0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.625474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c224e351-1ba0-49ca-89c5-68fc641e19d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69a96c41e8044cbb4cc311c3d5732e0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.645118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d0c1caf7064c358553de86bf1c3e52', 'request_id': 'req-565211e5-90d5-4aa4-b5d6-a730574b857e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.674872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d0c1caf7064c358553de86bf1c3e52', 'request_id': 'req-565211e5-90d5-4aa4-b5d6-a730574b857e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.682662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3667/7376] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:33 2022] DELETE /identity/v3/users/d69a96c41e8044cbb4cc311c3d5732e0 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:34.685704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:34.690966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:34.691304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:34.701597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:34.749824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:34.754026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:34.906587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] The token cache is being invalidate because project f3d0c1caf7064c358553de86bf1c3e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:34.910835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.910835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-565211e5-90d5-4aa4-b5d6-a730574b857e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:34.910835 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3710/7377] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:34 2022] DELETE /identity/v3/projects/f3d0c1caf7064c358553de86bf1c3e52 => generated 0 bytes in 903 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:34.919012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3b26-00ca-46c5-a2f9-78ce9b36224e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:34.919446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3b26-00ca-46c5-a2f9-78ce9b36224e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:34.919749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3b26-00ca-46c5-a2f9-78ce9b36224e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.020813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-405c3b26-00ca-46c5-a2f9-78ce9b36224e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:35.022619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-405c3b26-00ca-46c5-a2f9-78ce9b36224e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:35.029856 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3668/7378] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:35.030891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:35.039324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:35.062703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3711/7379] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:35.062703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:35.062703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:35.062703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.140839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:35.142486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:35.173864 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3712/7380] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:35.174891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:35.194703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225030-1322-495e-afc4-d4eac2e54e03 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:35.204209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:35.205070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:35.205533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:35.205998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.207365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:35.207848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:35.212927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:35.288714 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3713/7381] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:35.296372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:35.297312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e69969-3aa1-4577-aad3-08f5e8122004 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:35.304541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:35.305199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:35.305595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:35.312215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.327866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d14802-4a95-446b-9ba5-7d8f6aaf0086 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:35.341461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:35.343523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:35.351685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:35.352646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:35.353099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:35.353550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.354366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:35.357241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:35.444259 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3669/7382] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:35.580347 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3714/7383] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:35 2022] POST /identity/v3/projects => generated 363 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:35.588989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:35.604670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f29f42-7777-4fc0-b904-f030b019bf8b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:35.876677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:35.877316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:35.877597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:35.877895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:35.878584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:35.881117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:36.019264 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3670/7384] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:35 2022] POST /identity/v3/users => generated 282 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:36.025641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:36.066414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c87b0-3347-4730-b1d5-a26320a01a17 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:36.100665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:36.111244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:36.116590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:36.116590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:36.116590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:36.117793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:36.167424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3715/7385] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:36.177925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:36.208450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266932ac-be09-4f4c-a625-9eb167d096b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:36.243464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:36.244214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:36.244600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:36.244947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:36.247071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:36.251549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c40b7b-b8cc-457e-8c00-bfdd2dcbfebe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:36.285744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:36.286473 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3671/7386] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:36.302942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a1252-2186-43f4-8858-da8782002f6e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:36.329315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:36.330346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:36.337053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:36.338075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] PATH_INFO: `/v3/projects/a9cd102e94b44d1094c6d82f97d738b6/users/23176dd8ee394e4a93ccf4eac51f406e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:36.407610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cd102e94b44d1094c6d82f97d738b6, user_id=23176dd8ee394e4a93ccf4eac51f406e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:36.420766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:36.606723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:36.613499 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3716/7387] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:36 2022] PUT /identity/v3/projects/a9cd102e94b44d1094c6d82f97d738b6/users/23176dd8ee394e4a93ccf4eac51f406e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:36.624000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:36.624383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:36.624985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:36.767132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] MFA Rules not processed for user `23176dd8ee394e4a93ccf4eac51f406e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:36.772541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:36.888577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:36.891160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:37.128792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470e04-ea99-4622-9d21-71060250db18 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:37.153246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:37.154082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:37.157302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:37.157964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] PATH_INFO: `/v3/projects/ba5d685edb1c4561b8d519ed80128dba` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:37.163571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5d685edb1c4561b8d519ed80128dba)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:37.170803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:37.195507 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3672/7388] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 572 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:37.210363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:37.233185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:37.277501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:37.540732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5d685edb1c4561b8d519ed80128dba', 'request_id': 'req-c4f21a23-15c1-4a72-b6df-5b27fbed829b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:37.583795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5d685edb1c4561b8d519ed80128dba', 'request_id': 'req-c4f21a23-15c1-4a72-b6df-5b27fbed829b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:37.614396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5d685edb1c4561b8d519ed80128dba', 'request_id': 'req-c4f21a23-15c1-4a72-b6df-5b27fbed829b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:37.651688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2d9d7-d8d3-4b1b-bea5-757829f034b7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:37.810974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] The token cache is being invalidate because project ba5d685edb1c4561b8d519ed80128dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:37.811470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:37.813048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c4f21a23-15c1-4a72-b6df-5b27fbed829b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:37.816722 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3717/7389] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:36 2022] DELETE /identity/v3/projects/ba5d685edb1c4561b8d519ed80128dba => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:37.823146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7026-59cd-4f03-9f1d-1c03d7d45b02 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:37.825516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7026-59cd-4f03-9f1d-1c03d7d45b02 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:37.830004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b7026-59cd-4f03-9f1d-1c03d7d45b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:37.866316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:37.867029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:37.867309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:37.872851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:37.881053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:37.959036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e93b7026-59cd-4f03-9f1d-1c03d7d45b02 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:37.982834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e93b7026-59cd-4f03-9f1d-1c03d7d45b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:38.268609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:38.277867 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:38.363534 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3673/7390] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 1153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:38.366853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:38.368281 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3718/7391] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:38.376677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:38.379707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:38.386829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:38.390271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:38.446582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37566bd1-d7ad-45f6-b76c-85d170459534 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:38.467013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:38.469929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:38.469929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:38.469929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] PATH_INFO: `/v3/users/6db87dd47288466c83a1cfa8223e7ed2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:38.480831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db87dd47288466c83a1cfa8223e7ed2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:38.482991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:38.501565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:38.509392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:38.581364 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3719/7392] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:38.587624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:38.641206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb4eb7-42a6-453b-b477-1a8bb4c8cdb0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:38.666509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:38.667165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:38.667446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:38.667725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:38.668424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:38.673863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:38.679328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:38.686572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:38.746587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3720/7393] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:38.759948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:38.788901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:38.824544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5963638-ba0f-4f91-9955-13d86e9be645 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:38.859387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:38.860051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:38.860334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:38.862797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:38.865235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:38.880868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fde49b-98df-455c-acb8-613711d3c765 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:38.885443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db87dd47288466c83a1cfa8223e7ed2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:38.991912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db87dd47288466c83a1cfa8223e7ed2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:39.022149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db87dd47288466c83a1cfa8223e7ed2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:39.042818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db87dd47288466c83a1cfa8223e7ed2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:39.049459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db87dd47288466c83a1cfa8223e7ed2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:39.123464 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3674/7394] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:38 2022] DELETE /identity/v3/users/6db87dd47288466c83a1cfa8223e7ed2 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:39.130620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:39.130620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:39.138226 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3721/7395] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:38 2022] POST /identity/v3/projects => generated 391 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:39.141150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:39.144839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:39.145413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:39.304248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:39.304248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:39.416221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e898fe3-5fac-44ef-b4cc-195b6560d8a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:39.521908 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3722/7396] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:39.530710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:39.540456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:39.611336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1278c9-1a9c-415d-94ce-98aedcad17eb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:39.645089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:39.645739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:39.646019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:39.651365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:39.652241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:39.660893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:39.665746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:39.666395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:39.666679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:39.667024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:39.685418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:39.735670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:39.738779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:39.759177 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3675/7397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:39.760329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:39.762045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:39.867450 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3723/7398] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:39 2022] POST /identity/v3/users => generated 296 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:39.874987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:39.953431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a68fa1-4d7b-412f-b405-45d811f823c4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:40.015728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:40.016542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:40.016698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:40.022785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:40.023782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:40.042364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:40.055239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbc1e5-5172-46b5-8df1-01fff434383d service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:40.093429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:40.094256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:40.094653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:40.097855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:40.110042 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3724/7399] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:40.110042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:40.117067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:40.151376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:40.153756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62162f3-339b-4c89-9bb4-be1195b8bb84 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:40.162432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:40.202730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:40.203799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:40.215740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:40.215740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:40.215740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:40.215740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356b45c-d028-4bc1-96f3-981067963c50 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:40.244782 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3676/7400] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:40.274254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:40.275164 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3725/7401] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:40.291120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb9567-0e65-44bb-a8eb-4929b35911b4 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:40.316302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:40.316302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:40.316302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:40.316302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] PATH_INFO: `/v3/projects/d00d4c699919471dbb5b924919bff33e/users/2524f858d6434f8f8a8fefd268106a84/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:40.335425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:40.448766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00d4c699919471dbb5b924919bff33e, user_id=2524f858d6434f8f8a8fefd268106a84, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:40.466304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:40.644244 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3677/7402] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:40 2022] PUT /identity/v3/projects/d00d4c699919471dbb5b924919bff33e/users/2524f858d6434f8f8a8fefd268106a84/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:40.656737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:40.657303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:40.657303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:40.759272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] MFA Rules not processed for user `2524f858d6434f8f8a8fefd268106a84`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:40.769711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:41.008929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3726/7403] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:41.015668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:41.019194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:41.237504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90cb9b-1faa-4a86-8a2e-085083e10751 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:41.280054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:41.283248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:41.283604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:41.283922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:41.329348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:41.341618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:41.350017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:41.402991 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3678/7404] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:41 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:41.672886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:42.233018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:42.341360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:43.621752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:43.623297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:43.633446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:43.686041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:43.880427 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f642d-0ff2-4d3f-aa8c-d23be5871bef None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:43.895941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:43.897700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:43.898309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:43.899205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] PATH_INFO: `/v3/projects/5da8c82d99974d6f80fd156432e8f43e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:43.900779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da8c82d99974d6f80fd156432e8f43e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:43.902926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:44.126789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da8c82d99974d6f80fd156432e8f43e', 'request_id': 'req-a954b3b0-25a6-4861-bfb3-f2481c0fe694'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:44.161620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da8c82d99974d6f80fd156432e8f43e', 'request_id': 'req-a954b3b0-25a6-4861-bfb3-f2481c0fe694'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:44.194520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da8c82d99974d6f80fd156432e8f43e', 'request_id': 'req-a954b3b0-25a6-4861-bfb3-f2481c0fe694'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:44.321930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] The token cache is being invalidate because project 5da8c82d99974d6f80fd156432e8f43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:44.323533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:44.324911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:44.327828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3727/7405] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:43 2022] DELETE /identity/v3/projects/5da8c82d99974d6f80fd156432e8f43e => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:44.337865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:44.366618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b0d2d-ac1f-4a7b-b0c1-14097412f39e service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:44.605894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:44.606661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:44.607990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:44.608577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] PATH_INFO: `/v3/users/f8350251f8e24f4daf3e565dd21e428c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:44.610871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8350251f8e24f4daf3e565dd21e428c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:44.620361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:44.648991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:44.732982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:44.961764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8350251f8e24f4daf3e565dd21e428c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:45.046107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8350251f8e24f4daf3e565dd21e428c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:45.095825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8350251f8e24f4daf3e565dd21e428c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:45.097351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8350251f8e24f4daf3e565dd21e428c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:45.098055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8350251f8e24f4daf3e565dd21e428c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:45.163216 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3679/7406] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:44 2022] DELETE /identity/v3/users/f8350251f8e24f4daf3e565dd21e428c => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:45.823940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:45.984260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:46.133228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:46.135565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:46.175761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954b3b0-25a6-4861-bfb3-f2481c0fe694 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:46.467920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:46.470679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:46.471595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:46.472105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] PATH_INFO: `/v3/projects/a4d766e4522f4d56b3846cf7739bdb1b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:46.472375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:46.478448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d766e4522f4d56b3846cf7739bdb1b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:46.504249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:46.562087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:46.626556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:46.771076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d766e4522f4d56b3846cf7739bdb1b', 'request_id': 'req-b6e58451-b103-4848-847c-53873889a704'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:46.803011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d766e4522f4d56b3846cf7739bdb1b', 'request_id': 'req-b6e58451-b103-4848-847c-53873889a704'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:46.826162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d766e4522f4d56b3846cf7739bdb1b', 'request_id': 'req-b6e58451-b103-4848-847c-53873889a704'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:46.930137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] The token cache is being invalidate because project a4d766e4522f4d56b3846cf7739bdb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:46.930137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:46.930783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:46.933241 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3728/7407] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:46 2022] DELETE /identity/v3/projects/a4d766e4522f4d56b3846cf7739bdb1b => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:46.937294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:46.939005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:46.980214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc996ec-9d81-46e2-9442-2f546f101516 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:47.215899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:47.216946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:47.216946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:47.217173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] PATH_INFO: `/v3/users/249cd9116efb4b9c8203ad47b6697821` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:47.220508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=249cd9116efb4b9c8203ad47b6697821)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:47.226292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:47.461029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:47.477527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249cd9116efb4b9c8203ad47b6697821'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:47.594235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249cd9116efb4b9c8203ad47b6697821'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:47.645521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249cd9116efb4b9c8203ad47b6697821'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:47.646724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249cd9116efb4b9c8203ad47b6697821'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:47.647387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e811de8-102a-43a9-85a5-76b0a50c0ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249cd9116efb4b9c8203ad47b6697821'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:47.689014 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3680/7408] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:46 2022] DELETE /identity/v3/users/249cd9116efb4b9c8203ad47b6697821 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:47.786956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:49.000646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:49.112772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:49.759336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:49.761689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:49.822778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e58451-b103-4848-847c-53873889a704 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:49.996469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:50.140535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:50.143534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:50.144803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:50.147692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] PATH_INFO: `/v3/projects/d8388084e8c3407ca8bbb2280312bd5d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:50.150621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8388084e8c3407ca8bbb2280312bd5d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:50.156436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:50.277971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:50.432508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8388084e8c3407ca8bbb2280312bd5d', 'request_id': 'req-c804b5b9-3020-43d5-b560-18bf264a91b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:50.456273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8388084e8c3407ca8bbb2280312bd5d', 'request_id': 'req-c804b5b9-3020-43d5-b560-18bf264a91b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:50.491063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8388084e8c3407ca8bbb2280312bd5d', 'request_id': 'req-c804b5b9-3020-43d5-b560-18bf264a91b5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:50.575997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] The token cache is being invalidate because project d8388084e8c3407ca8bbb2280312bd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:50.576618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:50.578218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c804b5b9-3020-43d5-b560-18bf264a91b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:50.580779 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3729/7409] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:49 2022] DELETE /identity/v3/projects/d8388084e8c3407ca8bbb2280312bd5d => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:50.586010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:50.586380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:50.586610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:50.636437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:50.643708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:50.837171 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3681/7410] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:50.846397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:50.847011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:50.847324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:50.894317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:50.898562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:50.925565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3730/7411] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:50.929330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:50.944118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97776309-694b-49e8-82fd-09b245ce03f6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:50.958240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:50.959506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:50.961555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:50.962033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:50.964878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:57:50.965401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:50.968373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:51.000903 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3682/7412] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:57:51.005015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:51.021335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614696c-9335-4440-ad2f-d4ef20e80200 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:51.041148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:51.043609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:51.044394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:51.044864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:51.046992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:51.051767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:51.067206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:51.123152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:51.192115 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3731/7413] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:57:51 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:51.193491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:51.212314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708b5e6-088a-4f8a-9d25-58e9935fa240 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:51.413635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:51.413635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:51.413635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:51.413635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:51.414900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:51.423921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:51.605087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3683/7414] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:57:51 2022] POST /identity/v3/users => generated 293 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:57:51.606469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:51.624596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88b5fe-fa6e-4b7a-bb37-f6d851a2dd5a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:51.659622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:51.660353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:51.663666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:51.663666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:51.663907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:51.668045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:51.715639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:51.723918 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3732/7415] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:57:51.826316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:51.833988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9651d-c16f-4df3-9e69-e4fbfd3f905d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:51.853210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:51.870367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:51.876596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:51.877677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:51.884441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:51.888209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a779b83-79bc-482d-9754-5d35c58defee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:51.941844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:51.972727 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3684/7416] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:57:51.973782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76306265-8c79-45bc-83fc-1a58d4f0d40b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:51.994666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:51.998834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:51.999415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:52.001609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] PATH_INFO: `/v3/projects/d00acf0b24ef4ecf9b16d51986b302d7/users/40ddd452003f41b98661b0388a092d71/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:52.064402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00acf0b24ef4ecf9b16d51986b302d7, user_id=40ddd452003f41b98661b0388a092d71, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:52.077401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:52.168941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:52.213592 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3733/7417] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:57:51 2022] PUT /identity/v3/projects/d00acf0b24ef4ecf9b16d51986b302d7/users/40ddd452003f41b98661b0388a092d71/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:52.223576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:52.223897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:52.224233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:52.315685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] MFA Rules not processed for user `40ddd452003f41b98661b0388a092d71`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:52.317297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:52.409582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:52.411642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:52.525658 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3685/7418] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:52.534785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:52.535981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:52.631381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:52.685887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfe7d3-7d88-48b9-aaa0-fced929b0552 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:52.705661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:52.706338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:52.706618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:52.707031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] PATH_INFO: `/v3/users/f10bd0cb5de8407fb1b7f4f17bc00c9c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:52.710525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10bd0cb5de8407fb1b7f4f17bc00c9c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:52.716461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:52.798651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1645fae-e6ee-41b5-b57e-6b1e73b91424 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:52.817981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:52.819726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:52.823838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:52.827438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:52.876301 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:52.881893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d60e-fd17-4b34-b5ce-d10b14d3737a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:52.927713 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3686/7419] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:57:53.053518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10bd0cb5de8407fb1b7f4f17bc00c9c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:53.168670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10bd0cb5de8407fb1b7f4f17bc00c9c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:53.191730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10bd0cb5de8407fb1b7f4f17bc00c9c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:53.213886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10bd0cb5de8407fb1b7f4f17bc00c9c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:53.217255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10bd0cb5de8407fb1b7f4f17bc00c9c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:53.231564 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3734/7420] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:52 2022] DELETE /identity/v3/users/f10bd0cb5de8407fb1b7f4f17bc00c9c => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:53.238217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:53.238990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:53.239682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:53.339240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:57:53.342653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:53.455424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:53.603701 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3687/7421] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:57:53.624136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:53.626432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:53.809115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:53.809773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384d171-317e-4720-b086-bedb9cb0465c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:53.827054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:53.832475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:53.834845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:53.835369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:53.882992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:53.883560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:53.911420 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3735/7422] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:57:54.682578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:55.353150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:55.474732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:55.477070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:55.515119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128bb35-3ac3-4a8b-ba2e-a98a236a994c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:55.568792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:55.569456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:55.576584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:55.576852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] PATH_INFO: `/v3/projects/2a9f3d071f3045a8bb12b9b1657c2683` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:55.588307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9f3d071f3045a8bb12b9b1657c2683)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:55.618780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:55.763943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:55.857084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9f3d071f3045a8bb12b9b1657c2683', 'request_id': 'req-020df0a9-08c0-403a-aebe-5b72ee31daa6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:55.896778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9f3d071f3045a8bb12b9b1657c2683', 'request_id': 'req-020df0a9-08c0-403a-aebe-5b72ee31daa6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:55.985992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9f3d071f3045a8bb12b9b1657c2683', 'request_id': 'req-020df0a9-08c0-403a-aebe-5b72ee31daa6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.009676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] The token cache is being invalidate because project 2a9f3d071f3045a8bb12b9b1657c2683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:57:56.010231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.013006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.016070 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3688/7423] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:55 2022] DELETE /identity/v3/projects/2a9f3d071f3045a8bb12b9b1657c2683 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:56.020873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:56.034883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d8ed4-2f01-4ebf-b814-ec01acbbfd03 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:56.257039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:56.258246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:56.258404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:56.258674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] PATH_INFO: `/v3/users/ce62c8df39174323a8243e3255f862d3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:56.260183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce62c8df39174323a8243e3255f862d3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:56.263848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:56.304906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:56.307376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:56.539762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df0a9-08c0-403a-aebe-5b72ee31daa6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:56.557233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce62c8df39174323a8243e3255f862d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.571601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:56.573460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:56.574427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:56.574871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:56.583047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:56.610823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:56.614380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:56.654841 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3689/7424] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:57:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:57:56.700151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce62c8df39174323a8243e3255f862d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.748947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce62c8df39174323a8243e3255f862d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.777973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce62c8df39174323a8243e3255f862d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.777973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce62c8df39174323a8243e3255f862d3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:57:56.795452 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3736/7425] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:57:56 2022] DELETE /identity/v3/users/ce62c8df39174323a8243e3255f862d3 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:57:56.840643 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:57.168591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:58.168443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:58.278367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:58.935817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:58.937406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:59.228060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f769e5-c620-4882-abd6-54cae7f4351e service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:59.248625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:59.372708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:59.377810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:59.378329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:59.378798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:59.381339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:59.489654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:57:59.592944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:59.599627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe23874-b75c-4d03-9cd4-9d27632e9e9c service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:57:59.653618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3690/7426] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:57:59.665542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:57:59.668038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:57:59.828636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501b551-03f0-4146-85dd-486234aaaa79 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:57:59.847260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:57:59.848451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:57:59.849008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:57:59.849463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] PATH_INFO: `/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:57:59.853341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e5e8cec8aa4f078a0f408cca94aaec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:57:59.856653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:00.091889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e5e8cec8aa4f078a0f408cca94aaec', 'request_id': 'req-82633843-2c19-4218-a093-19217ea7816d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:00.120320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e5e8cec8aa4f078a0f408cca94aaec', 'request_id': 'req-82633843-2c19-4218-a093-19217ea7816d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:00.150345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e5e8cec8aa4f078a0f408cca94aaec', 'request_id': 'req-82633843-2c19-4218-a093-19217ea7816d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:00.268823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] The token cache is being invalidate because project 48e5e8cec8aa4f078a0f408cca94aaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:00.268823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:00.268823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-82633843-2c19-4218-a093-19217ea7816d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:00.270277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3737/7427] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:57:59 2022] DELETE /identity/v3/projects/48e5e8cec8aa4f078a0f408cca94aaec => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:00.276618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:00.276901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:00.277360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:00.404787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:00.417724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:00.669232 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3691/7428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:00.678626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:00.679136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:00.679791 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:00.733365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:00.749031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:00.755885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:00.834379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3738/7429] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:00.839339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:00.853188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea4785-b05a-4d21-9d73-cc1b90e79348 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:00.885449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:00.886578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:00.887172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:00.887748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:00.888767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:00.890998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:00.899350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:00.983148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3692/7430] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:00.987786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:01.007481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343400cc-3764-4845-896c-e2c82cfbf6a5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:01.022891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:01.023540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:01.023823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:01.024105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:01.024961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:01.026872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:01.212233 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3739/7431] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:01.216408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:01.275734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0a705-3f41-4799-a91b-4036a55c7a27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:01.562270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:01.563574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:01.565839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:01.566383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:01.567246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:01.576964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:01.582792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:01.585534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:01.623518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2308e15-56e0-48d9-937f-9570de902814 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:01.669426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:01.670272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:01.670665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:01.671045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] PATH_INFO: `/v3/users/fc59e58185494a95b679dc2082b09d08` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:01.677491 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc59e58185494a95b679dc2082b09d08)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:01.680146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:01.745583 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3693/7432] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:01 2022] POST /identity/v3/users => generated 293 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:01.746317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:01.786330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86bed9-dd2c-4d6c-a15f-54a68c6ec3e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:01.814388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:01.815071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:01.815362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:01.815641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:01.816425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:01.818409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:01.866379 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3694/7433] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:58:01.872700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:01.914842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf1e4-e81e-426c-9de4-d3c7b77461fa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:01.942234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:01.943314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:01.943464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:01.943709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:01.944607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:01.946292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:02.001693 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3695/7434] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:02.002690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:02.062128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e302b-2cf3-4c65-93d4-361da2784208 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:02.092072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:02.101983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc59e58185494a95b679dc2082b09d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:02.103816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:02.104322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:02.108201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] PATH_INFO: `/v3/projects/d05c094cc9a242d1af8d896f3a617e8a/users/49782515f3824c66b54eb73062b737ba/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:02.208029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:02.219556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05c094cc9a242d1af8d896f3a617e8a, user_id=49782515f3824c66b54eb73062b737ba, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:02.222527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8baf9e-6e28-4785-8822-350ea550d4bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:02.247981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc59e58185494a95b679dc2082b09d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:02.283682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc59e58185494a95b679dc2082b09d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:02.310489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc59e58185494a95b679dc2082b09d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:02.311690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-dfa45983-e5da-4154-8de0-da3d60a643c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc59e58185494a95b679dc2082b09d08'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:02.320922 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3740/7435] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:01 2022] DELETE /identity/v3/users/fc59e58185494a95b679dc2082b09d08 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:02.327869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:02.332433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:02.336707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:02.357454 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3696/7436] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:02 2022] PUT /identity/v3/projects/d05c094cc9a242d1af8d896f3a617e8a/users/49782515f3824c66b54eb73062b737ba/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:02.408065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:02.409746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:02.568095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:02.568673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:02.568950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:02.665407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] MFA Rules not processed for user `49782515f3824c66b54eb73062b737ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:02.674313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:02.677404 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3741/7437] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:02.800477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:02.805674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:02.966287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:03.106252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:03.130633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3697/7438] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:03.149020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:03.153790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:03.159214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ddc5d-4a7c-4864-970f-40dbe8358538 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:03.178892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:03.180285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:03.181496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:03.182244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:03.223265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:03.226903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:03.268863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3742/7439] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:03.397158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0d968-c83d-4d44-ba86-69b0f37fccbc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:03.412061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:03.414226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:03.415078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:03.415879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:03.452921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:03.466395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc678b9-7d5e-4a17-af9a-455dffebed85 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:03.494585 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3698/7440] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:03.513459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:03.516284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:03.548267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f565b-ac39-4b5c-9400-25b842af53b5 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:03.564600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:03.565617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:03.569457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:03.569947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] PATH_INFO: `/v3/users/49782515f3824c66b54eb73062b737ba` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:03.571691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49782515f3824c66b54eb73062b737ba)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:03.581468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:03.837402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:03.944819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49782515f3824c66b54eb73062b737ba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.106062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49782515f3824c66b54eb73062b737ba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.133844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:04.140205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49782515f3824c66b54eb73062b737ba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.175926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49782515f3824c66b54eb73062b737ba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.177066 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49782515f3824c66b54eb73062b737ba'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.212742 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3743/7441] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:03 2022] DELETE /identity/v3/users/49782515f3824c66b54eb73062b737ba => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:04.217578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:04.217943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:04.222171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:04.259083 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:04.267993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:04.301821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:04.303366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:04.458342 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3699/7442] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:04.469877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:04.478868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:04.553980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fed381-99b0-4500-8727-57c4900384b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:04.581863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:04.582524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:04.582989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:04.583572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] PATH_INFO: `/v3/projects/d2f96e5e124549f6aee09ca22970dea6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:04.590798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f96e5e124549f6aee09ca22970dea6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:04.593478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:04.714339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac628a98-3cc2-4ab8-ae9c-2614574311c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:04.738362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:04.742973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:04.742973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:04.742973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:04.847078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:04.866557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:04.924725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f96e5e124549f6aee09ca22970dea6', 'request_id': 'req-ac017e2a-7d04-41c2-a209-1482ce38198b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.950226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f96e5e124549f6aee09ca22970dea6', 'request_id': 'req-ac017e2a-7d04-41c2-a209-1482ce38198b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.978746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f96e5e124549f6aee09ca22970dea6', 'request_id': 'req-ac017e2a-7d04-41c2-a209-1482ce38198b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:04.978991 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3700/7443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:05.132055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:05.138241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] The token cache is being invalidate because project d2f96e5e124549f6aee09ca22970dea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:05.138540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.139960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.142768 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3744/7444] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:04 2022] DELETE /identity/v3/projects/d2f96e5e124549f6aee09ca22970dea6 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:58:05.147215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:05.178310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdde1be-3f9b-4343-9a7c-1aeb1fc8ad99 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:05.441197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:05.442341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:05.442873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:05.443441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] PATH_INFO: `/v3/users/958357074bf143259539efce30e6946a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:05.445067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958357074bf143259539efce30e6946a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:05.447308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:05.800321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:05.805908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958357074bf143259539efce30e6946a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.889161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958357074bf143259539efce30e6946a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.919840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958357074bf143259539efce30e6946a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.921137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958357074bf143259539efce30e6946a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.925210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958357074bf143259539efce30e6946a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:05.964812 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3701/7445] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:05 2022] DELETE /identity/v3/users/958357074bf143259539efce30e6946a => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:58:06.218349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:06.894663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:07.128373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:07.131123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:07.161075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac017e2a-7d04-41c2-a209-1482ce38198b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:07.261584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:07.387831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:07.388982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:07.389708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:07.400851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] PATH_INFO: `/v3/users/40ddd452003f41b98661b0388a092d71` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:07.400851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ddd452003f41b98661b0388a092d71)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:07.400851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:07.599915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:07.612796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:07.614358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:07.648860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e09f3b-a3dc-4bc7-ae28-421723f80fc8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:07.705841 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:07.706524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:07.706803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:07.707073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] PATH_INFO: `/v3/projects/d05c094cc9a242d1af8d896f3a617e8a` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:07.714733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05c094cc9a242d1af8d896f3a617e8a)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:07.719383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:07.754442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ddd452003f41b98661b0388a092d71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.875704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ddd452003f41b98661b0388a092d71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.908411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ddd452003f41b98661b0388a092d71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.931439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ddd452003f41b98661b0388a092d71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.934633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65336c06-e8d0-4a37-a0af-c3fcf0429109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ddd452003f41b98661b0388a092d71'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:07.948259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3745/7446] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:07 2022] DELETE /identity/v3/users/40ddd452003f41b98661b0388a092d71 => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:07.950718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:07.951466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:07.951937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:07.984755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:07.990378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:08.116399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:08.171671 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3746/7447] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:08.173960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:08.175139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05c094cc9a242d1af8d896f3a617e8a', 'request_id': 'req-d804035a-2bc4-4033-9dcd-bbae0bdd508d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.183564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:08.185303 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05c094cc9a242d1af8d896f3a617e8a', 'request_id': 'req-d804035a-2bc4-4033-9dcd-bbae0bdd508d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.208268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3895b-63d6-4584-8749-bb8e486a62d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:08.341825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05c094cc9a242d1af8d896f3a617e8a', 'request_id': 'req-d804035a-2bc4-4033-9dcd-bbae0bdd508d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.379632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] The token cache is being invalidate because project d05c094cc9a242d1af8d896f3a617e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:08.381740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.383891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.397282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3702/7448] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:07 2022] DELETE /identity/v3/projects/d05c094cc9a242d1af8d896f3a617e8a => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:08.399606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:08.405054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:08.411783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:08.413494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:08.415105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:08.416204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] PATH_INFO: `/v3/projects/90478e6c54d4437d9963c6df9e4236f4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:08.422375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90478e6c54d4437d9963c6df9e4236f4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:08.431934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:08.686813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804035a-2bc4-4033-9dcd-bbae0bdd508d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:08.695512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:08.698834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:08.698834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:08.698834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:08.702171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:08.745948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:08.748248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f35d5-fa90-470b-9087-71890e953a3a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:08.769244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90478e6c54d4437d9963c6df9e4236f4', 'request_id': 'req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.795043 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3703/7449] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:08.800410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cabfe-f0b8-46cd-aeb5-e031f8819b6c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:08.802697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90478e6c54d4437d9963c6df9e4236f4', 'request_id': 'req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.810037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cabfe-f0b8-46cd-aeb5-e031f8819b6c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:08.811677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2cabfe-f0b8-46cd-aeb5-e031f8819b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:08.841608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90478e6c54d4437d9963c6df9e4236f4', 'request_id': 'req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.886872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bb2cabfe-f0b8-46cd-aeb5-e031f8819b6c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:08.889299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bb2cabfe-f0b8-46cd-aeb5-e031f8819b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:08.979777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] The token cache is being invalidate because project 90478e6c54d4437d9963c6df9e4236f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:08.980217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.981761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4b7dd23e-f296-4342-b83d-0ceba17d3ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:08.987704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3747/7450] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:08 2022] DELETE /identity/v3/projects/90478e6c54d4437d9963c6df9e4236f4 => generated 0 bytes in 811 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:08.989673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45bd-993c-4d75-9cd4-aa84a73a06cf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:08.991918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45bd-993c-4d75-9cd4-aa84a73a06cf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:08.992635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b45bd-993c-4d75-9cd4-aa84a73a06cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.037554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:09.067610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6f3b45bd-993c-4d75-9cd4-aa84a73a06cf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:09.076320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6f3b45bd-993c-4d75-9cd4-aa84a73a06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:09.094540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:09.140440 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3704/7451] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:09.150098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.151909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.152425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.205602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:09.208196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:09.233119 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3705/7452] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:09.234482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.280337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d57c0-c848-4393-88c7-21d98b78d9c6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.294171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.295517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.297211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.299692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.301336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:09.302361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.307510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.344179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3706/7453] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:09.349211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.369087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b33142-13ea-4af4-8317-ec44e6c3af57 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.385807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.386893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.387344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.387965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.388913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.391949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.408478 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3748/7454] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:09.428100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.429766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.433428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.551078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3707/7455] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:09 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:09.551299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:09.555020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:09.557673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.744195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3749/7456] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:09.763069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.786896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939cbbc-96a7-42b4-a893-c9dadd9d3dde admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.797454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c808205-7cfe-4af9-b3dc-0103b9525cea None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.805233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.805970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.806478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.806919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.807738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.812794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.813426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.814231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.815942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.816178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.817537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:09.819442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.829554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.884823 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3750/7457] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:09.889740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:09.924645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1481c5-aef6-4bae-b1cf-6deb11b5bf20 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:09.941723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:09.943052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:09.943601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:09.944124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:09.945079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:09.947313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:09.964785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:09.972467 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3708/7458] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:09 2022] POST /identity/v3/users => generated 289 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:09.978175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.027363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ede22-2454-42f8-a08e-4f09712cd7e6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:10.050580 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:10.051219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.051498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.051772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.052523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:10.054183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:10.084096 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3709/7459] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:10.088160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:10.097224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.132358 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3751/7460] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:10.139275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.144700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54404f59-1d74-4cbd-98ea-71c9878d40ed admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:10.393354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:10.393673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.393957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.394232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.394888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:10.399777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:10.441704 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3710/7461] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:10.441944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.450319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196b263-ab5d-4b91-95fe-d17aa9ee82d5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:10.474371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35131832-e720-4618-b109-c00a5e99df40 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:10.483063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:10.483425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.483764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.484144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.484954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:10.486785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:10.487472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.487749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.488021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] PATH_INFO: `/v3/projects/38ace51e7bf842f5a52c522047e5db9d/users/0b7ce807d41a410db636b249c3cb3e1c/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.489304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16fa7f-c80b-47fc-90a9-cbfba8e43e14 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:10.530625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=38ace51e7bf842f5a52c522047e5db9d, user_id=0b7ce807d41a410db636b249c3cb3e1c, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:10.533791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:10.699649 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3711/7462] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:10 2022] PUT /identity/v3/projects/38ace51e7bf842f5a52c522047e5db9d/users/0b7ce807d41a410db636b249c3cb3e1c/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:10.701859 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3752/7463] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:10 2022] POST /identity/v3/users => generated 290 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:10.708009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.718865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.719329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.719851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.824896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] MFA Rules not processed for user `0b7ce807d41a410db636b249c3cb3e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:10.830727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:10.931495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c473e-a135-4598-be92-6205a5c98a5f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:10.951468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:10.952270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:10.952851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:10.953171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:10.953998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:10.956651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:10.972135 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3712/7464] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:10.977310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:10.993648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881be0b-026b-4d13-abe0-85f01948d782 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:11.011043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:11.011884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:11.019221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:11.019221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:11.019221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:11.040573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:11.070749 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3713/7465] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:11.071672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:11.085569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:11.126257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61985f26-35cf-4f2e-97ce-b362fe8520db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:11.149462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:11.150578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:11.151078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:11.151548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] PATH_INFO: `/v3/projects/d00acf0b24ef4ecf9b16d51986b302d7` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:11.158207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00acf0b24ef4ecf9b16d51986b302d7)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:11.160858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:11.228078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3753/7466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:11.230845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:11.346396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500bc88-0ae5-4a58-b690-567b65bf92d6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:11.368479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:11.370207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:11.370954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:11.371703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] PATH_INFO: `/v3/projects/fdb750f94ae74377b5d77f5de21ebd3b/users/75a1235c0d5d43a6a204563e26f4d9b4/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:11.448951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00acf0b24ef4ecf9b16d51986b302d7', 'request_id': 'req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:11.465529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb750f94ae74377b5d77f5de21ebd3b, user_id=75a1235c0d5d43a6a204563e26f4d9b4, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:11.477911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:11.489298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00acf0b24ef4ecf9b16d51986b302d7', 'request_id': 'req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:11.678137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:11.687007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00acf0b24ef4ecf9b16d51986b302d7', 'request_id': 'req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:11.700659 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3754/7467] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:11 2022] PUT /identity/v3/projects/fdb750f94ae74377b5d77f5de21ebd3b/users/75a1235c0d5d43a6a204563e26f4d9b4/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:11.707823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:11.725180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:11.732262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] The token cache is being invalidate because project d00acf0b24ef4ecf9b16d51986b302d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:11.733386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:11.749352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-41e81ce2-7771-4b5e-9e6a-a0ae650b9f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:11.749352 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3714/7468] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:11 2022] DELETE /identity/v3/projects/d00acf0b24ef4ecf9b16d51986b302d7 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:11.752620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:11.756051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:11.756717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:11.909824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:11.961834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] MFA Rules not processed for user `75a1235c0d5d43a6a204563e26f4d9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:11.963135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:12.015420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799a0a3-04c2-4489-9861-b2b8d19003f9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:12.048871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:12.055425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.055425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.055425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.056614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:12.221356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:12.258943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:12.260468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc456b84-e773-4d4b-be2f-c2966a3a64f0 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:12.289911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3755/7469] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:12.303879 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3715/7470] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 555 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:12.305471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:12.310609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:12.312919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cae20-f43d-4dce-8d52-3958bc974aac None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.314515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cae20-f43d-4dce-8d52-3958bc974aac None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.316322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cae20-f43d-4dce-8d52-3958bc974aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.351638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7c2cae20-f43d-4dce-8d52-3958bc974aac None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:12.353186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7c2cae20-f43d-4dce-8d52-3958bc974aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:12.556634 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3756/7471] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:12.566840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.567280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.567686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.600474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29288853-5847-46f1-9ff3-71d10dccda26 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:12.611240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:12.614198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.614368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.616880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.621517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:12.634686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:12.635947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:12.639517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:12.676679 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3757/7472] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:12.681613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:12.708432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87bd3b-2790-44a0-b2be-33f4731d3814 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:12.721733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:12.722797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.723365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.723893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.725108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:12.725620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:12.728449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:12.750188 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3758/7473] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:58:12.755214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:12.778669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17bb38-4268-4665-ac41-0d347be0835e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:12.787386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:12.789968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:12.790436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:12.790894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:12.791714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:12.793947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:12.845241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3716/7474] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:12 2022] POST /identity/v3/projects => generated 381 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:12.847653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:12.998896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748885d-996d-4dd7-8f03-2c25ebbb57f9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.005100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.005929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.006464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.006804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.007525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.009698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.078381 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3759/7475] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:12 2022] POST /identity/v3/projects => generated 383 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:13.084425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.177961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3717/7476] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:12 2022] POST /identity/v3/users => generated 297 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:13.183693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.214538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56761-09d3-4e14-a7fc-afe2b5db98bc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.288660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa423b9-6a64-4039-a2c5-ccd258f666e8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.304243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.304902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.305355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.305635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.306347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.308241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.352110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.352996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.354690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.355631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.356449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.360823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.374349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3718/7477] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:13.379957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.419276 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3760/7478] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:13 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:13.419811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.427748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a985998-8c38-477b-a2c8-064ccb88b9f1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.443997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.445372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.445859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.446500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] PATH_INFO: `/v3/projects/addd701236a34b8a959f1c67edf2e724/users/0a781a88c1964bab84d27db61320d04b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.456211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c146f6-7ebb-41c4-b43a-c915414f2c59 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.463282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.464545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.465017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.465443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.468843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.471948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.494697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=addd701236a34b8a959f1c67edf2e724, user_id=0a781a88c1964bab84d27db61320d04b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.498744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.508117 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3761/7479] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:13.514190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.576093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24127ccd-e72f-437f-bbd3-a349164d3e81 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.595303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.603443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.603823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.604144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.604895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.606854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.627194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3762/7480] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:13.629302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.643643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed445055-7cfd-4de8-99a5-f05f53ef92c5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:13.651366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:13.655837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:13.659805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.659805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.659805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] PATH_INFO: `/v3/projects/2688c21d1c2446738e30f08d35853087/users/0373f7b34b984b07b8ab3f3965a7ea6d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.683243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2688c21d1c2446738e30f08d35853087, user_id=0373f7b34b984b07b8ab3f3965a7ea6d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:13.687013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00c729-bc3e-40d1-84f9-c7bcda3326d9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:13.719498 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3719/7481] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:13 2022] PUT /identity/v3/projects/addd701236a34b8a959f1c67edf2e724/users/0a781a88c1964bab84d27db61320d04b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:13.744632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:13.748612 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:13.818891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3763/7482] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:13 2022] PUT /identity/v3/projects/2688c21d1c2446738e30f08d35853087/users/0373f7b34b984b07b8ab3f3965a7ea6d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:13.831176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:13.844979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:13.844979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:13.912009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:13.917538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:14.055681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded78ade-2bc5-4594-b15a-2d9963b14b9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:14.126844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3764/7483] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:14.142260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:14.145009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:14.159581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:14.160626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:14.161090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:14.162141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:14.163307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:14.165552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:14.222063 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3720/7484] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:14.226650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:14.256625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8de9d5-a01a-40da-b37e-f0f2fbc084cb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:14.279352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:14.281958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:14.282430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:14.283095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] PATH_INFO: `/v3/projects/addd701236a34b8a959f1c67edf2e724/users/0a781a88c1964bab84d27db61320d04b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:14.306476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=addd701236a34b8a959f1c67edf2e724, user_id=0a781a88c1964bab84d27db61320d04b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:14.315722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8206c-7655-4e2c-8d3e-abeae5a45a6e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:14.351307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3721/7485] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:14 2022] PUT /identity/v3/projects/addd701236a34b8a959f1c67edf2e724/users/0a781a88c1964bab84d27db61320d04b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:14.363695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f3565-f544-4cc1-bd5c-34c2d9ac7d42 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:14.386147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:14.386147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:14.386147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:14.574784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] MFA Rules not processed for user `0a781a88c1964bab84d27db61320d04b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:14.576934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:14.654715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:14.655547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:14.655750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:14.656234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:14.685716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:14.817307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:14.820359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:14.843187 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3765/7486] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:58:14.920068 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3722/7487] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:14.944999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:14.945905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:15.078234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581ebc2-45ac-4af0-8f83-a2f543683116 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:15.083452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:15.084283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:15.085432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:15.085853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:15.100983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:15.101586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:15.119170 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3766/7488] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:15.222894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:17.233474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:17.249990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c746-390f-4338-b1ab-e80e34880cdd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:17.262403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a781a88c1964bab84d27db61320d04b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addd701236a34b8a959f1c67edf2e724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:17.262403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:17.264331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:17.265595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:17.270089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:17.271014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:17.275426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:17.310488 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3723/7489] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:17.319510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:17.324503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5d715-6a2d-491c-b13a-11421f0c1700 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:17.341028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a781a88c1964bab84d27db61320d04b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addd701236a34b8a959f1c67edf2e724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:17.341723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:17.342013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:17.342289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:17.342946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:17.345036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:17.515777 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3767/7490] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:17 2022] POST /identity/v3/projects => generated 353 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:17.533148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:17.549720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc6dee-ac4c-48b1-bcb1-cb4057ccc498 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:17.689957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a781a88c1964bab84d27db61320d04b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addd701236a34b8a959f1c67edf2e724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:17.691169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:17.691464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:17.691792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:17.692471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:17.692799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:17.695158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b20a8-74f4-4d11-aeb2-982c5e6cb667 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:17.714415 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3724/7491] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:17.805004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:17.820006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81a4c5-c10a-4ce8-81fb-e8d52899c499 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:17.833405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a781a88c1964bab84d27db61320d04b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'addd701236a34b8a959f1c67edf2e724', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:17.834077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:17.834397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:17.836242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] PATH_INFO: `/v3/projects/7d6e0a89763e48ed97135781e8e4a3ab` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:17.837207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7d6e0a89763e48ed97135781e8e4a3ab)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:17.839188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:18.106541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d6e0a89763e48ed97135781e8e4a3ab', 'request_id': 'req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:18.127702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d6e0a89763e48ed97135781e8e4a3ab', 'request_id': 'req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:18.152743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d6e0a89763e48ed97135781e8e4a3ab', 'request_id': 'req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:18.186055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:18.310605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:18.311878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:18.312540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:18.382033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] The token cache is being invalidate because project 7d6e0a89763e48ed97135781e8e4a3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:18.383594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:18.384819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:18.387933 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3768/7492] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:17 2022] DELETE /identity/v3/projects/7d6e0a89763e48ed97135781e8e4a3ab => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:18.402901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] MFA Rules not processed for user `0373f7b34b984b07b8ab3f3965a7ea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:18.407952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:18.511265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:18.640628 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3725/7493] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:18.841780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:18.845106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:19.051352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129aa5-4e1e-4d24-b697-41c2c8e11fd9 tempest-VolumeQuotaClassesTest-1848052660 tempest-VolumeQuotaClassesTest-1848052660-project-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:19.075632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:19.076996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:19.077525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:19.080910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:19.122086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:19.142530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793bf02-fc0c-4eee-9b85-bbe90b0400b2 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:19.165118 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3769/7494] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:20.452281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:20.453563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:20.633657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843d2ee-2fa5-4bf7-a9db-a17ea3b99041 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:20.637951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:20.639168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:20.639742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:20.640237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] PATH_INFO: `/v3/users/75a1235c0d5d43a6a204563e26f4d9b4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:20.645426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a1235c0d5d43a6a204563e26f4d9b4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:20.648608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:21.112744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a1235c0d5d43a6a204563e26f4d9b4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:21.213234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a1235c0d5d43a6a204563e26f4d9b4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:21.251579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a1235c0d5d43a6a204563e26f4d9b4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:21.254006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a1235c0d5d43a6a204563e26f4d9b4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:21.256092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a1235c0d5d43a6a204563e26f4d9b4'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:21.321488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:21.321616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:21.321616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:21.321616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:21.322253 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3726/7495] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:20 2022] DELETE /identity/v3/users/75a1235c0d5d43a6a204563e26f4d9b4 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:21.385909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:21.387178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:21.771887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3770/7496] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:22.132018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:22.132018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:22.271131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122d32-3a3e-456a-bd17-b88934533fd5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:22.291410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:22.295927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:22.296690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:22.308918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:22.309321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:22.336540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:22.340278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:22.409710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3727/7497] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:23.586389 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:23.589138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:23.661522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c9437-7d8d-4fca-9097-b48c5f6505ed None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:23.671792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:23.674140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:23.674655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:23.677557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] PATH_INFO: `/v3/projects/fdb750f94ae74377b5d77f5de21ebd3b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:23.682962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb750f94ae74377b5d77f5de21ebd3b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:23.694553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:24.046912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb750f94ae74377b5d77f5de21ebd3b', 'request_id': 'req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:24.071431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb750f94ae74377b5d77f5de21ebd3b', 'request_id': 'req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:24.073706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb750f94ae74377b5d77f5de21ebd3b', 'request_id': 'req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:24.208571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] The token cache is being invalidate because project fdb750f94ae74377b5d77f5de21ebd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:24.212697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:24.212697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:24.217221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3771/7498] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:23 2022] DELETE /identity/v3/projects/fdb750f94ae74377b5d77f5de21ebd3b => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:24.218648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:24.238464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3f45b-3ce4-446f-b9ff-6bf05a96fe30 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:24.246586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:24.456289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:24.457026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:24.457504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:24.457959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] PATH_INFO: `/v3/users/0a781a88c1964bab84d27db61320d04b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:24.462400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a781a88c1964bab84d27db61320d04b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:24.468445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:24.862557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a781a88c1964bab84d27db61320d04b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:25.008461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a781a88c1964bab84d27db61320d04b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:25.034735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a781a88c1964bab84d27db61320d04b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:25.035875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a781a88c1964bab84d27db61320d04b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:25.036317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e10d9d1c-b99f-48af-a587-a3602f640c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a781a88c1964bab84d27db61320d04b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:25.082481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3728/7499] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:24 2022] DELETE /identity/v3/users/0a781a88c1964bab84d27db61320d04b => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:26.422619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:26.424182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:26.459705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d202-9d47-4569-a7a4-ddeadaac3f7f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:26.694280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:26.694944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:26.695628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:26.696356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] PATH_INFO: `/v3/projects/addd701236a34b8a959f1c67edf2e724` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:26.703703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] RBAC: Authorizing `identity:delete_project(project_id=addd701236a34b8a959f1c67edf2e724)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:26.730145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:26.882231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:27.013908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:27.048847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'addd701236a34b8a959f1c67edf2e724', 'request_id': 'req-1a5def01-75c8-477d-8f45-d63e5063321d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:27.068630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'addd701236a34b8a959f1c67edf2e724', 'request_id': 'req-1a5def01-75c8-477d-8f45-d63e5063321d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:27.090447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'addd701236a34b8a959f1c67edf2e724', 'request_id': 'req-1a5def01-75c8-477d-8f45-d63e5063321d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:27.243545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] The token cache is being invalidate because project addd701236a34b8a959f1c67edf2e724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:27.243845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:27.245309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1a5def01-75c8-477d-8f45-d63e5063321d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:27.247373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3772/7500] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:26 2022] DELETE /identity/v3/projects/addd701236a34b8a959f1c67edf2e724 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:27.252471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:27.252818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:27.253057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:27.306332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:27.310813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:27.561302 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3729/7501] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:27.569295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:27.569818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:27.569818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:27.688682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:27.690350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:27.711622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3773/7502] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:27.712810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:27.771659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1569ec-256a-4d92-b776-ba6759ba22de None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:27.795242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:27.798039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:27.800664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:27.801122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:27.801587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:27.804055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:27.804710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:27.807391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:27.856840 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3730/7503] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:27.861694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:27.901493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89271d4-1376-41f8-8c39-59af0ea053e3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:27.938293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:27.941583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:27.941583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:27.941583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:27.941583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:27.943473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:28.118044 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3774/7504] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:27 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:28.122947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:28.160099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd8e7-2914-4052-9199-f971441fea96 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:28.388010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:28.389567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:28.390076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:28.390795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:28.391884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:28.394488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:28.562899 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3731/7505] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:28 2022] POST /identity/v3/users => generated 287 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:28.567741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:28.584767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2d6b7-56df-4ff8-a6c1-f83995b3c520 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:28.599244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:28.599971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:28.600475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:28.600992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:28.601831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:28.603629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:28.638062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:28.638847 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3775/7506] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:28.666886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8712f-69d5-4eed-bf97-65751286b964 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:28.676188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:28.676866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:28.677149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:28.677423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:28.680735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:28.684743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a58215-67f8-4404-8eb1-6f9b21cf1feb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:28.711307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3732/7507] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:28.722705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:28.735855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951cd25-16f5-4c8a-9e6d-8bc97ebe6c02 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:28.755717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:28.756530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:28.756834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:28.757233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] PATH_INFO: `/v3/projects/0496e97d046243a298cd6e60e13c289e/users/167004f9694344f1b595951ff2338753/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:28.805390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0496e97d046243a298cd6e60e13c289e, user_id=167004f9694344f1b595951ff2338753, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:28.808363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:28.935201 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3776/7508] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:28 2022] PUT /identity/v3/projects/0496e97d046243a298cd6e60e13c289e/users/167004f9694344f1b595951ff2338753/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:28.941134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:28.941342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:28.941584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:28.980420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:28.981912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:28.983241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:29.160217 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3733/7509] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:29.196070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:29.198844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:29.388878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca33bb1-785d-43f0-af24-49a446a56fec admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:29.399440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:29.400543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:29.401049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:29.401497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:29.436657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:29.451553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11845e-e652-4b6f-9e94-f534d92ab1cd service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:29.495348 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3777/7510] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:29.630634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:30.597582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:30.600677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:30.644479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7d5c2-62a7-42b2-b5d8-6dbe3f44361c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:30.673720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:30.674430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:30.674712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:30.674992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] PATH_INFO: `/v3/users/2524f858d6434f8f8a8fefd268106a84` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:30.678135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2524f858d6434f8f8a8fefd268106a84)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:30.693591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:31.133723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2524f858d6434f8f8a8fefd268106a84'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:31.149893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:31.328791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2524f858d6434f8f8a8fefd268106a84'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:31.367105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2524f858d6434f8f8a8fefd268106a84'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:31.379019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2524f858d6434f8f8a8fefd268106a84'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:31.379019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2524f858d6434f8f8a8fefd268106a84'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:31.408600 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3734/7511] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:58:30 2022] DELETE /identity/v3/users/2524f858d6434f8f8a8fefd268106a84 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:31.409840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:31.410154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:31.410435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:31.470507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:31.472102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:31.750032 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3778/7512] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:31.793809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:31.802979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:32.060887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3483e-28c0-4a53-91a1-5a72fcf7b9a9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:32.072974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:32.074219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:32.074990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:32.075700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:32.092215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:32.102660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:32.102660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd73a9-992b-40b9-b381-37fec5fb08b8 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:32.114792 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3735/7513] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:58:32.727322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:33.012986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:33.841984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:34.798150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:35.501513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:35.522936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:35.524704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:35.524989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:35.525266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:35.550285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d4db5-dae6-41a0-96a7-eed087ca498c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:35.569316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:35.578463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:35.579032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:35.579468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] PATH_INFO: `/v3/projects/d00d4c699919471dbb5b924919bff33e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:35.585138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00d4c699919471dbb5b924919bff33e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:35.588679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:35.609736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] MFA Rules not processed for user `167004f9694344f1b595951ff2338753`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:35.611038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:35.822773 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3736/7514] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:35.823876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:35.825422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:35.829249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00d4c699919471dbb5b924919bff33e', 'request_id': 'req-b65d48fb-28cd-4f4f-864a-9b727a702b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:35.869926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00d4c699919471dbb5b924919bff33e', 'request_id': 'req-b65d48fb-28cd-4f4f-864a-9b727a702b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:35.886737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafebeb-d048-4107-9016-f7e9f4d52e3c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:35.887979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00d4c699919471dbb5b924919bff33e', 'request_id': 'req-b65d48fb-28cd-4f4f-864a-9b727a702b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:36.129279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] The token cache is being invalidate because project d00d4c699919471dbb5b924919bff33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:58:36.130144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:36.131535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:58:36.146687 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3779/7515] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:58:35 2022] DELETE /identity/v3/projects/d00d4c699919471dbb5b924919bff33e => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 12:58:36.199446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:36.199446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:36.258075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:36.270022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:36.271485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:36.273696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:36.275603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:36.284620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29917a4-f9b8-409f-8711-c6453b47315c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:36.498971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:36.588883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3737/7516] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:35 2022] POST /identity/v3/projects => generated 371 bytes in 765 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:58:36.593086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:36.596005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:36.597885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:36.619787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:36.706920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:36.707964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:36.724234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d48fb-28cd-4f4f-864a-9b727a702b8b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:36.907772 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3738/7517] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:36.912995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:36.917914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:36.950386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee69ea-1ff9-42bb-b9e9-61b157f0a36c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:36.963734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:36.964711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:36.966041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:36.966572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:36.967402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:36.972162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b988c3-0f7e-4d2d-90b0-ec08089cceee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.083648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3739/7518] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:36 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:37.085340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.085624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.085897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.131684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.140690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.142007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.148031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.160877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:37.211088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:37.221438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:37.222036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.222036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.233735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3740/7519] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:37.237177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.244125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3780/7520] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 1059 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:37.245036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.250696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a274f9-e481-432e-a386-f2e1cd486e25 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.254682 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.255487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.255914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.256372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.257223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.258972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.272894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d217d-8e2b-4c85-9ee8-3a63c77eb113 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.276227 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3741/7521] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:37.282234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.295608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.296278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.296579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.296851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.297512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:58:37.297816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.302667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed037-6636-48a3-aa01-bc1392753115 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.303794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.315476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.317033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.318691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.319094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] PATH_INFO: `/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca/users/05fe3432cccd4334b29d669b1de93cc2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.328285 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3781/7522] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:58:37.333587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.355819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefd1a0f53c244a0b03e8ba94a4ca7ca, user_id=05fe3432cccd4334b29d669b1de93cc2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.356401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee056cc-96b2-4fe8-86f0-3f345f7b792f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.362228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.372228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.373386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.374987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.375522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.377578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.382445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.472428 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3742/7523] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:37 2022] PUT /identity/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca/users/05fe3432cccd4334b29d669b1de93cc2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:37.478000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.549602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3782/7524] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:37 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:37.554022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.648836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4767870-7907-4c7b-a874-d64f8d1d7ee1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.723880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e740a-fccd-41c2-a66d-d6636d395d63 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.734523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.737592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.737592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.745448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.747567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.755931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.773300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.774180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.774321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.774523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.775141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.777078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.807198 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3743/7525] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:37.808181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.829594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d540b8-221e-42e5-b505-5c44d72b57e8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.847703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:37.853178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:37.853178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:37.853178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] PATH_INFO: `/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca/users/05fe3432cccd4334b29d669b1de93cc2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:37.860341 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3783/7526] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:37 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:37.860606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefd1a0f53c244a0b03e8ba94a4ca7ca, user_id=05fe3432cccd4334b29d669b1de93cc2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:37.861149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:37.861651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:37.885479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9295df1-bd9e-41bc-b41e-ffd5a8ffbdab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:37.887654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3744/7527] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:37 2022] PUT /identity/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca/users/05fe3432cccd4334b29d669b1de93cc2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:37.923021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:38.065282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:38.066990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:38.067359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:38.068868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:38.069778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:38.074806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:38.146121 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3784/7528] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:38.146383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:38.183025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041bac-0e35-4d98-b427-eb03d0ea870b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:38.200161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:38.200844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:38.201110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:38.201386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:38.202565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:38.204239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c5484-77ed-4600-8501-c783ff49276d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:38.243199 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3745/7529] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:38.247041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:38.269081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2ca2-28aa-4958-9ee3-110084662021 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:38.283719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:38.286521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:38.287136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:38.289299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] PATH_INFO: `/v3/projects/2c29a45b18b948beb86b5f13b25e46b9/users/2f0a27458da7483e81250180de9beb45/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:38.348436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c29a45b18b948beb86b5f13b25e46b9, user_id=2f0a27458da7483e81250180de9beb45, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:38.352743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:38.448573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:38.472148 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3785/7530] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:38 2022] PUT /identity/v3/projects/2c29a45b18b948beb86b5f13b25e46b9/users/2f0a27458da7483e81250180de9beb45/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:38.483151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:38.484075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:38.484358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:38.584373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] MFA Rules not processed for user `2f0a27458da7483e81250180de9beb45`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:38.586209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:38.833293 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3746/7531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:38.837856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:39.075180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63834107-58e5-4ec8-aac1-2dde50a3408d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:39.090637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:39.090637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.090637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.090637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:39.091475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:39.094028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:39.227323 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3786/7532] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:38 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:39.228661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:39.241801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88813d9c-ed45-489f-b5fd-e86ca30dc678 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:39.399540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:39.403606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:39.404904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.405701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.406144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:39.406936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:39.409098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:39.501048 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3747/7533] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:39 2022] POST /identity/v3/users => generated 294 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:58:39.514739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:39.559402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b51b-ac6c-446c-9c19-6ec09c09309b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:39.588456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:39.589242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.593900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.594293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:39.595061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:39.603233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:39.605587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:39.631882 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3787/7534] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:39.632318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:39.651237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9913f-3294-429b-a079-1401f04722d1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:39.667763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:39.668342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.668696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.672098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:39.673153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:39.676477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77a996-586c-4355-a377-084e5fa1db1f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:39.717488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:39.725252 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3748/7535] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:39.746973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9162a2c-4d5f-49ad-a3c0-e0c83b8389ea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:39.752338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:39.755220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.756881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.757390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] PATH_INFO: `/v3/projects/f5d4e2cacfbe4a9d8c920edce17ab97d/users/b473c35114134c2389b212e4dfa52428/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:39.789929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5d4e2cacfbe4a9d8c920edce17ab97d, user_id=b473c35114134c2389b212e4dfa52428, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:39.796407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:39.949216 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3788/7536] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:39 2022] PUT /identity/v3/projects/f5d4e2cacfbe4a9d8c920edce17ab97d/users/b473c35114134c2389b212e4dfa52428/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:39.950057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:39.950496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:39.950935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:40.076180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] MFA Rules not processed for user `b473c35114134c2389b212e4dfa52428`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:40.080568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:40.184194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:40.371580 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3749/7537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:40.377079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:40.588118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcec50-34a4-4f91-9d1e-e79a681ecc99 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:40.627601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:40.628577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:40.629068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:40.629595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:40.630442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:40.635016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:40.777596 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3789/7538] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:58:40 2022] POST /identity/v3/projects => generated 389 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:40.782467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:40.802550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db6671-633a-4b97-90a8-8c0efb5cca54 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:40.974074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:40.975622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:40.976195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:40.976914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:40.977743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:40.980018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:40.995514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:41.202546 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3750/7539] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:58:40 2022] POST /identity/v3/users => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:58:41.207141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:41.236332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185a543-b179-46ae-9077-44413900d892 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:41.254606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:41.255304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:41.255590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:41.255863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:41.256626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:41.258333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:41.306154 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3790/7540] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:58:41.308101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:41.325221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e40174-af1e-4878-8fe3-720b51e8f609 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:41.339573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:41.340263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:41.340710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:41.341008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] PATH_INFO: `/v3/projects/f98bc8389d714e16a7aad5922acfd898/users/8a46b9b2f81b452695d38c4731bb27e5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:41.378071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98bc8389d714e16a7aad5922acfd898, user_id=8a46b9b2f81b452695d38c4731bb27e5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:41.380941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:41.553161 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3751/7541] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:41 2022] PUT /identity/v3/projects/f98bc8389d714e16a7aad5922acfd898/users/8a46b9b2f81b452695d38c4731bb27e5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:41.554551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:41.572917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234040-422f-4fe6-b6ea-0bd404690639 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:41.756424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:41.757085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:41.759577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:41.759874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:41.760878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:41.768371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a969719-251a-4a17-9160-199870b4858f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:41.796636 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3791/7542] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 12:58:41.797546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:41.814326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:41.855304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfea93-fe7c-4bc2-8ed3-5067a46aceb1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:41.887142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:41.890815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:41.890815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:41.898357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] PATH_INFO: `/v3/projects/f98bc8389d714e16a7aad5922acfd898/users/8a46b9b2f81b452695d38c4731bb27e5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:41.918142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98bc8389d714e16a7aad5922acfd898, user_id=8a46b9b2f81b452695d38c4731bb27e5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:41.930144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:42.001793 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3752/7543] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:58:41 2022] PUT /identity/v3/projects/f98bc8389d714e16a7aad5922acfd898/users/8a46b9b2f81b452695d38c4731bb27e5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:58:42.017530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88105a2-f507-4966-8cb0-b0e5fd8e93b4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:42.018496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88105a2-f507-4966-8cb0-b0e5fd8e93b4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:42.018959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88105a2-f507-4966-8cb0-b0e5fd8e93b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:42.091357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f88105a2-f507-4966-8cb0-b0e5fd8e93b4 None None] MFA Rules not processed for user `8a46b9b2f81b452695d38c4731bb27e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:42.095027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f88105a2-f507-4966-8cb0-b0e5fd8e93b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:42.267728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:42.429415 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3792/7544] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:42.479300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:42.480358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:42.751785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fbb59-0870-439b-88b7-615e0b33760a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:42.752085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fbb59-0870-439b-88b7-615e0b33760a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:42.753166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fbb59-0870-439b-88b7-615e0b33760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:42.869521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bb2fbb59-0870-439b-88b7-615e0b33760a None None] MFA Rules not processed for user `05fe3432cccd4334b29d669b1de93cc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:42.875849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bb2fbb59-0870-439b-88b7-615e0b33760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:42.924152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efb1ec-d626-4011-820b-954d2654501c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:42.942079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:42.943175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:42.943725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:42.944262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:43.094654 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3793/7545] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:58:43.110740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:43.111006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:43.111934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:43.140396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:43.142671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:43.157801 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3753/7546] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:43.165130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] MFA Rules not processed for user `167004f9694344f1b595951ff2338753`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:58:43.166384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:43.895301 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3794/7547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:58:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 787 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:58:43.940189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:43.941641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:43.943476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:44.032615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238efad-61ef-4e9a-bc69-7ab32c3c5c83 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:44.063170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:44.063813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:44.064093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:44.064367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:44.069537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:44.114487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:44.119181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de1b06-949a-4a86-8b88-c8ded5cbd7c5 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:44.171679 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3754/7548] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:44.229596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:44.232122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:44.471726 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebea311-476f-49ba-a889-7825de2001fc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:44.562465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:44.570604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:44.577697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:44.578311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:44.592748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:44.684315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:44.697633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:44.789040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:44.816636 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3795/7549] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:45.631426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:46.383877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:46.441302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:47.671438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:47.672150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:47.672776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:58:47.685543 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:58:47.690434 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 12:58:47.695967 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3755/7550] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:58:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:58:49.919293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:50.031730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:51.925978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:52.114355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:52.287623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ffdc-1737-4d63-8cd7-df0246bf8fec service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:52.321694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:52.322259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:52.322530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:52.330716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:52.338638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:52.477234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:52.477234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:52.510299 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3796/7551] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:52.664448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:53.211902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:53.620766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:53.623317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:53.657890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:53.834114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:53.897407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:53.904298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:53.905282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:53.905755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:53.906288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:53.930909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:53.936817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:53.980334 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3756/7552] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:55.103694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:55.201074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:56.224214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:56.298072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:56.346206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:58:56.348646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:58:56.572591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a998e6e-2653-4af4-8d74-2b9a00575310 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:58:56.587157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:58:56.587824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:58:56.588102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:58:56.588964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:58:56.631015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:58:56.637072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45493a25-f9f8-47cd-845c-85b30b6143e6 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:58:56.674965 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3797/7553] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:58:56 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:58:58.192286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:58.338193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:58.850079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:58:59.604819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:00.264546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:01.162923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=3,keystone:DELETE=9,keystone:SELECT=88 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:01.252129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:02.793458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:03.051653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:05.143495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:05.405828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:05.949000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:06.086052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:06.416058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:06.883869 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:07.823915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:08.074990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:08.569694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:08.713185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:10.050261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:10.923687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:11.419969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:11.422756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:11.695262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:11.729452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:11.755085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435d215-619d-4742-9f04-3de0af92da1a service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:11.774175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:11.774915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:11.795046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:11.799805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:11.799805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:12.039571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:12.046183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:12.067298 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3757/7554] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:12.588836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:13.009377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:13.348748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:13.598321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:14.785087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd573-3719-4656-a129-db5c1793114f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:14.785783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd573-3719-4656-a129-db5c1793114f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:14.785783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddd573-3719-4656-a129-db5c1793114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:14.860084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f6ddd573-3719-4656-a129-db5c1793114f None None] MFA Rules not processed for user `2f0a27458da7483e81250180de9beb45`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:14.864715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f6ddd573-3719-4656-a129-db5c1793114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:14.942695 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3798/7555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:15.057468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:15.061720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:15.096979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319e569-a5e1-4ccb-95d0-0f82a166db5f service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:15.129109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:15.130228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:15.133218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:15.136510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:15.136821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:15.139441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:15.197949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:15.199532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:15.235644 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3758/7556] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:59:15.264411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:16.643305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:16.708706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:16.766574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:16.767047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:16.767326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 12:59:16.783341 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 12:59:16.784387 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 12:59:16.801449 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3799/7557] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 12:59:16 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 36 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 12:59:17.692152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:18.221336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:19.097454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:19.549705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:20.162039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:20.303998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:21.225659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:21.414734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:22.049477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:23.379087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:25.056625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:26.033715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:26.748565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:27.582172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:28.127271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:30.934778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:31.628198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:32.382047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:32.437190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:32.545792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:32.561598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119adf87-3f04-43b8-a5c4-f2d0b12a5dba service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:32.600532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:32.603175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:32.603670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:32.604104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:32.613545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:32.886810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:32.902071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b12aa5-675e-4614-8c88-97adf97e6cc3 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:32.940737 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3759/7558] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:59:32.947363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:34.249463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:34.317708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:35.461402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:35.709402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ef2f9-c404-499e-b173-4be5be17db4d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:35.751152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:35.751152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:35.751152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:35.751152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] PATH_INFO: `/v3/users/2f0a27458da7483e81250180de9beb45` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:35.752273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0a27458da7483e81250180de9beb45)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:35.754035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:36.041236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:36.083536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0a27458da7483e81250180de9beb45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:36.267965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0a27458da7483e81250180de9beb45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:36.322540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0a27458da7483e81250180de9beb45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:36.423575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0a27458da7483e81250180de9beb45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:36.427007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0a27458da7483e81250180de9beb45'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:36.460693 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3800/7559] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:59:35 2022] DELETE /identity/v3/users/2f0a27458da7483e81250180de9beb45 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:36.461984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:36.462513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:36.462513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:36.610021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:36.679629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:36.695482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:36.912010 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3760/7560] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:36.923097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:36.925217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:37.135472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3ed3c-6e55-42b2-b836-1b7997e9e5dd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:37.150408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:37.151053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:37.151328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:37.152356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:37.171450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:37.173280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:37.188904 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3801/7561] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 12:59:37.410714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:37.879713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:37.881809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:37.915909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f36a4-666d-473a-b0be-e8953d0439b4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:37.926764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:37.931228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:37.932544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:37.935615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] PATH_INFO: `/v3/projects/2c29a45b18b948beb86b5f13b25e46b9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:37.937839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c29a45b18b948beb86b5f13b25e46b9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:37.951349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:38.131804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:38.295447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c29a45b18b948beb86b5f13b25e46b9', 'request_id': 'req-bb517717-c1bc-4449-9266-ae9a9ff593aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:38.325176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c29a45b18b948beb86b5f13b25e46b9', 'request_id': 'req-bb517717-c1bc-4449-9266-ae9a9ff593aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:38.350476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:38.482118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c29a45b18b948beb86b5f13b25e46b9', 'request_id': 'req-bb517717-c1bc-4449-9266-ae9a9ff593aa'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:38.526520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] The token cache is being invalidate because project 2c29a45b18b948beb86b5f13b25e46b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:59:38.527265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:38.528126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:38.536775 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3761/7562] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:59:37 2022] DELETE /identity/v3/projects/2c29a45b18b948beb86b5f13b25e46b9 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:38.547616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:38.559812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54777d-9fbd-4b85-9b19-86ff213a613f service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:38.802316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:38.803120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:38.803407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:38.803670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] PATH_INFO: `/v3/users/b473c35114134c2389b212e4dfa52428` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:38.805980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b473c35114134c2389b212e4dfa52428)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:38.811821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:39.193153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b473c35114134c2389b212e4dfa52428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:39.303200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b473c35114134c2389b212e4dfa52428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:39.335368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b473c35114134c2389b212e4dfa52428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:39.427789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b473c35114134c2389b212e4dfa52428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:39.429376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b473c35114134c2389b212e4dfa52428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:39.477473 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3802/7563] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:59:38 2022] DELETE /identity/v3/users/b473c35114134c2389b212e4dfa52428 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:39.752436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:40.452553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:40.644118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:40.645725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:40.693509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb517717-c1bc-4449-9266-ae9a9ff593aa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:40.963866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:40.965728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:40.971584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:40.972355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] PATH_INFO: `/v3/projects/f5d4e2cacfbe4a9d8c920edce17ab97d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:40.974935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5d4e2cacfbe4a9d8c920edce17ab97d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:40.981520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:41.271082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5d4e2cacfbe4a9d8c920edce17ab97d', 'request_id': 'req-31eba5c7-4130-414d-819b-96ef60a3d153'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:41.295311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5d4e2cacfbe4a9d8c920edce17ab97d', 'request_id': 'req-31eba5c7-4130-414d-819b-96ef60a3d153'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:41.455866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5d4e2cacfbe4a9d8c920edce17ab97d', 'request_id': 'req-31eba5c7-4130-414d-819b-96ef60a3d153'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:41.478398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] The token cache is being invalidate because project f5d4e2cacfbe4a9d8c920edce17ab97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:59:41.478713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:41.481133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:41.489179 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3762/7564] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:59:40 2022] DELETE /identity/v3/projects/f5d4e2cacfbe4a9d8c920edce17ab97d => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:41.489567 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:41.491251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:41.521496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7021a-42af-42cf-8347-203fb2774849 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:41.779015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:41.782096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:41.783775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:41.784183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] PATH_INFO: `/v3/users/8a46b9b2f81b452695d38c4731bb27e5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:41.789408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a46b9b2f81b452695d38c4731bb27e5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:41.799287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:41.872265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:42.313775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a46b9b2f81b452695d38c4731bb27e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:42.514142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a46b9b2f81b452695d38c4731bb27e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:42.554111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a46b9b2f81b452695d38c4731bb27e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:42.600957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a46b9b2f81b452695d38c4731bb27e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:42.608840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2a53a9a4-a7f2-4262-a5bb-e982e28c9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a46b9b2f81b452695d38c4731bb27e5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:42.658587 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3803/7565] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:59:41 2022] DELETE /identity/v3/users/8a46b9b2f81b452695d38c4731bb27e5 => generated 0 bytes in 1169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:42.913902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:43.451633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:44.470426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:44.857267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:45.044369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:45.047019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:45.069671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba5c7-4130-414d-819b-96ef60a3d153 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:45.187442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:45.188121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:45.189137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:45.189137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] PATH_INFO: `/v3/projects/f98bc8389d714e16a7aad5922acfd898` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:45.192662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98bc8389d714e16a7aad5922acfd898)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:45.196440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:45.508784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98bc8389d714e16a7aad5922acfd898', 'request_id': 'req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:45.527996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98bc8389d714e16a7aad5922acfd898', 'request_id': 'req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:45.644596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98bc8389d714e16a7aad5922acfd898', 'request_id': 'req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:45.672146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] The token cache is being invalidate because project f98bc8389d714e16a7aad5922acfd898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:59:45.673001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:45.674440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2ac4aacc-d69b-40a7-aa97-5b1147847fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:45.697370 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3763/7566] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:59:45 2022] DELETE /identity/v3/projects/f98bc8389d714e16a7aad5922acfd898 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:45.701737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:45.701737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:45.701737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:45.885178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:45.889599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:46.046585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3804/7567] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 12:59:46.053673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:46.054265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:46.054265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:46.116361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:46.118158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:46.197331 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3764/7568] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:46.201572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:46.230902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f23813-657e-4c7e-a7ca-b290ff34a923 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:46.253225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:46.256077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:46.256077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:46.256077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:46.261898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:59:46.262261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:46.268788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:46.348618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3805/7569] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 12:59:46.355582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:46.401944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549f4c1-7010-403f-ac50-b35a98d0dfcf None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:46.428416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:46.429671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:46.429958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:46.430237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:46.431937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:46.445698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:46.683419 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3765/7570] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:59:46 2022] POST /identity/v3/projects => generated 377 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:59:46.695637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:46.720457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af108c3-f98f-4c71-b936-d28961deaa49 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:46.776562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:47.050776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:47.052120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:47.052680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:47.053120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:47.054166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:47.056327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:47.222997 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3806/7571] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:59:46 2022] POST /identity/v3/users => generated 289 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:59:47.228150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:47.243574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011d9a7-568b-43d0-893d-1da0d065b731 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:47.296227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:47.296885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:47.302538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:47.324228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:47.330844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:47.342091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:47.395816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3766/7572] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:47.399949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:47.430635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ffb4f-22d5-44a3-af8e-a78bf9da5d7c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:47.437251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:47.444909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:47.444909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:47.444909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:47.444909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:47.444909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062a23-cb5f-4472-98a6-3f779cad14e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:47.482891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3807/7573] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:47.483024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:47.500972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae3b313-44f0-488c-89c6-0489a0c71eaa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:47.507567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:47.521358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:47.530443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:47.531123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:47.532056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] PATH_INFO: `/v3/projects/7acfadad50ce4521ae4e3d2ad73c0b1e/users/cc68e1cc8efe419eb71c94d43c6bd88e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:47.587835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7acfadad50ce4521ae4e3d2ad73c0b1e, user_id=cc68e1cc8efe419eb71c94d43c6bd88e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:47.592576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:47.748077 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3767/7574] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:59:47 2022] PUT /identity/v3/projects/7acfadad50ce4521ae4e3d2ad73c0b1e/users/cc68e1cc8efe419eb71c94d43c6bd88e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:47.753454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca111-174d-4bbd-b23f-05ff25ae0cbf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:47.754374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca111-174d-4bbd-b23f-05ff25ae0cbf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:47.754991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ca111-174d-4bbd-b23f-05ff25ae0cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:47.786182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-430ca111-174d-4bbd-b23f-05ff25ae0cbf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:47.790602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-430ca111-174d-4bbd-b23f-05ff25ae0cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:47.819280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:48.108892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3808/7575] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:48.113604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:48.116515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:48.411685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce6449-5739-4fbf-bf21-3dde3d9955f7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:48.433989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:48.434730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:48.435119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:48.435500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:48.466533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:48.477464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:48.484288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:48.542124 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3768/7576] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:59:49.227885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:49.548224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:49.650005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:50.250980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:50.590863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:50.758198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:51.627946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:52.621956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:52.725659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:52.726204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:52.726645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:52.787710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] MFA Rules not processed for user `cc68e1cc8efe419eb71c94d43c6bd88e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:52.789398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:53.007149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3809/7577] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:53.020532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:53.049466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9bcc8-b8bb-4e7b-bf8d-3183b74c1231 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:53.068770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:53.069613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:53.070177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:53.074716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:53.075685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:53.080290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:53.421350 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3769/7578] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:59:53 2022] POST /identity/v3/projects => generated 379 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:59:53.440710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:53.466242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575ce49-d3bd-4f1b-839e-d5bd57f51a87 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:53.582356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:53.584300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:53.584533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:53.584533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:53.584533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:53.585974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:53.589135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:53.703362 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3810/7579] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:59:53 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:59:53.707573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:53.723048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a95fde-4eed-4815-b0b3-5e7c13721ab9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:53.737228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:53.737874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:53.738157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:53.738447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:53.739115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:53.740872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:53.764335 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3770/7580] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:53.768834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:53.780976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98ecec-c225-42cd-80e4-1aac50e0806e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:53.797603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:53.798523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:53.798986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:53.799451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] PATH_INFO: `/v3/projects/6851a30bb47442b59924bb376b75e744/users/7184280db3884d6b8ffa9f264f858692/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:53.856047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6851a30bb47442b59924bb376b75e744, user_id=7184280db3884d6b8ffa9f264f858692, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:53.862753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:53.950278 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3811/7581] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:59:53 2022] PUT /identity/v3/projects/6851a30bb47442b59924bb376b75e744/users/7184280db3884d6b8ffa9f264f858692/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:53.955968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:54.035962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d5cd8-bd20-4f68-9dba-b55bcf13bb26 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:54.269819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:54.270388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:54.270791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:54.270924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:54.271589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:54.275932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:54.331954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:54.352224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00dbbb-6124-4505-b6e7-9394e7a8371c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:54.352413 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3771/7582] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:54.352562 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:54.379759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:54.380457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:54.380779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:54.381057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] PATH_INFO: `/v3/projects/6851a30bb47442b59924bb376b75e744/users/7184280db3884d6b8ffa9f264f858692/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:54.392428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6851a30bb47442b59924bb376b75e744, user_id=7184280db3884d6b8ffa9f264f858692, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:54.401760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298bf3c-b003-4119-9db3-f27be8eaba60 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:54.460653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3812/7583] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:59:54 2022] PUT /identity/v3/projects/6851a30bb47442b59924bb376b75e744/users/7184280db3884d6b8ffa9f264f858692/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:55.004317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:55.006138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:55.042930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244779fe-72c3-4c88-86b8-d4191c86e207 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:55.224618 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:55.225304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:55.225583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:55.225855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] PATH_INFO: `/v3/users/0b7ce807d41a410db636b249c3cb3e1c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:55.239482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:55.242949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7ce807d41a410db636b249c3cb3e1c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:55.244615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:55.562134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7ce807d41a410db636b249c3cb3e1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:55.701483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7ce807d41a410db636b249c3cb3e1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:55.744123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7ce807d41a410db636b249c3cb3e1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:55.746760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7ce807d41a410db636b249c3cb3e1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:55.749370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7ce807d41a410db636b249c3cb3e1c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:55.798674 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3772/7584] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:59:55 2022] DELETE /identity/v3/users/0b7ce807d41a410db636b249c3cb3e1c => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:55.802608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:55.802608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:55.802608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:55.875877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:55.877444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:55.996131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:56.149475 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3813/7585] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:56.164946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:56.167190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:56.198878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:56.401641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5334-bd64-411e-945f-1b81ab490960 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:56.408198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:56.419116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:56.419116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:56.419116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:56.436972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:56.440130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:56.503161 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3773/7586] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 12:59:56.938587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:57.121268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:57.264078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:57.788661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:57.791028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:57.859943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d514e-b81b-4022-b6f6-a9b094b3ca7e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:57.881124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:57.904606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:57.910262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:57.910742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] PATH_INFO: `/v3/projects/38ace51e7bf842f5a52c522047e5db9d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:57.922291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38ace51e7bf842f5a52c522047e5db9d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:57.929766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:57.977859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:57.980883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:57.991728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:58.268296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38ace51e7bf842f5a52c522047e5db9d', 'request_id': 'req-51834fab-c98f-4003-88bb-cd96f1150613'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:58.309703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38ace51e7bf842f5a52c522047e5db9d', 'request_id': 'req-51834fab-c98f-4003-88bb-cd96f1150613'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:58.317717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a76cf-7721-49ac-a849-f185e69014d2 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:58.334261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38ace51e7bf842f5a52c522047e5db9d', 'request_id': 'req-51834fab-c98f-4003-88bb-cd96f1150613'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:58.351740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:58.489013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] The token cache is being invalidate because project 38ace51e7bf842f5a52c522047e5db9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 12:59:58.490868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:58.491509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-51834fab-c98f-4003-88bb-cd96f1150613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 12:59:58.499221 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3814/7587] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:59:57 2022] DELETE /identity/v3/projects/38ace51e7bf842f5a52c522047e5db9d => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 12:59:58.506346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:58.506982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:58.507623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:58.508071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:58.515784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:58.530551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:58.530940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:58.532465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:58.590216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:58.597231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:58.640662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:58.643512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12b1a-4b13-4bdd-a975-b1ad12c32a12 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:58.658151 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3774/7588] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 12:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 12:59:58.755615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:58.813571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3815/7589] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:58.816254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:58.816559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:58.816837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:58.880125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:58.887011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:58.922344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:58.923318 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3775/7590] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 12:59:58.935780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f310ea-f159-407d-8f57-db48885e04cd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:58.956536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:58.957451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:58.957736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:58.958008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:58.973768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 12:59:58.973768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:58.981872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:58.995850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:59.021129 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3816/7591] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 12:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 12:59:59.026575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:59.041324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cd181-43cd-4841-9b9b-6aa08b530fcc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:59.066953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:59.067914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.069699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.071927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:59.074182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:59.077489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613a15e-694b-47d2-9413-f6f580495db8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:59.351134 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3776/7592] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 12:59:59 2022] POST /identity/v3/projects => generated 375 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 12:59:59.354509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:59.378043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f0928-3a70-43f5-813b-a6805df432a6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:59.549094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:59.551853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.552433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.553043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:59.555385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:59.557933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:59.616863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f9a7-604d-4c33-89f1-4702dac56e79 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.616863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f9a7-604d-4c33-89f1-4702dac56e79 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.617224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085f9a7-604d-4c33-89f1-4702dac56e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:59.734961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d085f9a7-604d-4c33-89f1-4702dac56e79 None None] MFA Rules not processed for user `7184280db3884d6b8ffa9f264f858692`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 12:59:59.737838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d085f9a7-604d-4c33-89f1-4702dac56e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 12:59:59.757166 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3817/7593] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 12:59:59 2022] POST /identity/v3/users => generated 288 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 12:59:59.764253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:59.796192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a103f10-7e38-4321-8479-9d2f9866db8f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:59.804171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:59.805454 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.805978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.810315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:59.810315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:59.812472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:59.829125 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3818/7594] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:59.834361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:59.849990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f06f2-8131-46df-a0c3-564c9191c986 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:59.858157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:59.859231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.859762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.860206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 12:59:59.861185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 12:59:59.863727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 12:59:59.881928 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3819/7595] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 12:59:59.901723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 12:59:59.933039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037917e-88d9-48fa-a3b6-345bb360068d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 12:59:59.972273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 12:59:59.973392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 12:59:59.973978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 12:59:59.974528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] PATH_INFO: `/v3/projects/8b2a8740e62546739e8aa1ba5ce38aed/users/c5941a1c8f324201ba8ac980d55ea942/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:00.010113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3777/7596] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:00.022865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:00.024668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:00.026577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:00.037698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b2a8740e62546739e8aa1ba5ce38aed, user_id=c5941a1c8f324201ba8ac980d55ea942, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:00.045966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedba6c-5743-4e64-8e9d-4dfb169651eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:00.078547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] MFA Rules not processed for user `cc68e1cc8efe419eb71c94d43c6bd88e`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:00.091285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:00.207352 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3778/7597] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:00.215554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:00.217688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:00.287759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3820/7598] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 12:59:59 2022] PUT /identity/v3/projects/8b2a8740e62546739e8aa1ba5ce38aed/users/c5941a1c8f324201ba8ac980d55ea942/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:00.313290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:00.313930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:00.314365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:00.402272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] MFA Rules not processed for user `c5941a1c8f324201ba8ac980d55ea942`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:00.404747 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:00.458056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecacf4b-898b-45c7-854b-3ef88ef17f21 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:00.513407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3821/7599] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:00.535696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:00.537657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:00.656120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:00.658654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:00.664966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:00.664966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:00.666435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:00.695217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3717921-a7b0-4e73-b44f-b4e52b69c000 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:00.705766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:00.709103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:00.710160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:00.711630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:00.751741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:00.759006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305768e-3b85-450a-8581-9ca8a4af6751 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:00.785929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3822/7600] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:00.812648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:00.814919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:00.843321 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3779/7601] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:00:01.122418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:01.976048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:01.976739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:01.976739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:00:01.991732 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:00:01.992927 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:00:01.999745 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3823/7602] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:00:01 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 25 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:00:02.686871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:04.275323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:05.299229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:05.301321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:05.504341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d08-95ed-4db2-abc7-8fcda35d6cac service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:05.543387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:05.544141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:05.544423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:05.544729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] PATH_INFO: `/v3/users/167004f9694344f1b595951ff2338753` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:05.549339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=167004f9694344f1b595951ff2338753)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:05.551464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:05.743856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e298c-2343-4a17-a235-841439559174 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:05.744681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e298c-2343-4a17-a235-841439559174 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:05.744681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e298c-2343-4a17-a235-841439559174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:05.784421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-026e298c-2343-4a17-a235-841439559174 None None] MFA Rules not processed for user `c5941a1c8f324201ba8ac980d55ea942`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:05.785896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-026e298c-2343-4a17-a235-841439559174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:05.806430 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3824/7603] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:06.044476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:06.045875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167004f9694344f1b595951ff2338753'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:06.177741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167004f9694344f1b595951ff2338753'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:06.203874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167004f9694344f1b595951ff2338753'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:06.206768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167004f9694344f1b595951ff2338753'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:06.206959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167004f9694344f1b595951ff2338753'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:06.243945 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3780/7604] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:05 2022] DELETE /identity/v3/users/167004f9694344f1b595951ff2338753 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:06.608168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e298c-2343-4a17-a235-841439559174 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:06.609755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-026e298c-2343-4a17-a235-841439559174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:06.640507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e298c-2343-4a17-a235-841439559174 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:06.751163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:06.751937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:06.752334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:06.752585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] PATH_INFO: `/v3/users/cc68e1cc8efe419eb71c94d43c6bd88e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:06.756296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc68e1cc8efe419eb71c94d43c6bd88e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:06.760802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:07.128266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:07.130046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:07.157801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa68ea-c972-4729-8203-22b4335423bb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:07.163853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:07.164732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:07.165105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:07.165449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] PATH_INFO: `/v3/projects/0496e97d046243a298cd6e60e13c289e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:07.166858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0496e97d046243a298cd6e60e13c289e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:07.170115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:07.434548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc68e1cc8efe419eb71c94d43c6bd88e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.506441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0496e97d046243a298cd6e60e13c289e', 'request_id': 'req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.523499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0496e97d046243a298cd6e60e13c289e', 'request_id': 'req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.598566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc68e1cc8efe419eb71c94d43c6bd88e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.633165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc68e1cc8efe419eb71c94d43c6bd88e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.663173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc68e1cc8efe419eb71c94d43c6bd88e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.664304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc68e1cc8efe419eb71c94d43c6bd88e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.687443 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3825/7605] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:06 2022] DELETE /identity/v3/users/cc68e1cc8efe419eb71c94d43c6bd88e => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:07.694627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:07.698976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:07.745883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0496e97d046243a298cd6e60e13c289e', 'request_id': 'req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.770411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] The token cache is being invalidate because project 0496e97d046243a298cd6e60e13c289e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:07.771006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.771884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:07.780166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3781/7606] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:07 2022] DELETE /identity/v3/projects/0496e97d046243a298cd6e60e13c289e => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:07.785732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:07.795786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:07.894858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb1db3-cc0d-401b-909e-5de45a374f14 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:07.919965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:07.921674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:07.923172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:07.924149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:07.928302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:07.959257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be0eca-e99b-49a7-b38b-6d770bd3eee7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:07.961016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:07.962997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:07.983145 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3826/7607] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:08.102409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:08.103608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:08.103902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:08.104174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] PATH_INFO: `/v3/users/05fe3432cccd4334b29d669b1de93cc2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:08.110951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fe3432cccd4334b29d669b1de93cc2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:08.113201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:08.731680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:08.733688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:08.766168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd0aaf-f67c-4cb2-bb3f-5549247a02dd service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:08.772348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:08.775018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:08.776106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:08.776664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:08.777268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] PATH_INFO: `/v3/projects/7acfadad50ce4521ae4e3d2ad73c0b1e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:08.778833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7acfadad50ce4521ae4e3d2ad73c0b1e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:08.783026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:08.799078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fe3432cccd4334b29d669b1de93cc2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.127385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fe3432cccd4334b29d669b1de93cc2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.170596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fe3432cccd4334b29d669b1de93cc2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.173355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fe3432cccd4334b29d669b1de93cc2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.179410 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fe3432cccd4334b29d669b1de93cc2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.179590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7acfadad50ce4521ae4e3d2ad73c0b1e', 'request_id': 'req-99540351-efb1-4f69-aa2d-d2655e8c2215'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.189150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7acfadad50ce4521ae4e3d2ad73c0b1e', 'request_id': 'req-99540351-efb1-4f69-aa2d-d2655e8c2215'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.198001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7acfadad50ce4521ae4e3d2ad73c0b1e', 'request_id': 'req-99540351-efb1-4f69-aa2d-d2655e8c2215'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.209230 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3782/7608] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:07 2022] DELETE /identity/v3/users/05fe3432cccd4334b29d669b1de93cc2 => generated 0 bytes in 1424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:09.438489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] The token cache is being invalidate because project 7acfadad50ce4521ae4e3d2ad73c0b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:09.439227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.441878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:09.444622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3827/7609] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:08 2022] DELETE /identity/v3/projects/7acfadad50ce4521ae4e3d2ad73c0b1e => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:09.449026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:09.451275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:09.616152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32ff25-d015-4ebf-a132-9d4b957d5348 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:09.631020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:09.637940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:09.638257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:09.642297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] PATH_INFO: `/v3/users/7184280db3884d6b8ffa9f264f858692` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:09.644644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7184280db3884d6b8ffa9f264f858692)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:09.648430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:09.848750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:09.848750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:09.969723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99540351-efb1-4f69-aa2d-d2655e8c2215 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:09.979819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:09.981523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:09.982173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:09.982774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] PATH_INFO: `/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:09.984447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefd1a0f53c244a0b03e8ba94a4ca7ca)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:09.991976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:10.245281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7184280db3884d6b8ffa9f264f858692'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.436691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefd1a0f53c244a0b03e8ba94a4ca7ca', 'request_id': 'req-d7376556-cc52-49e5-9fde-8138d2e2e7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.452753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7184280db3884d6b8ffa9f264f858692'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.475332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefd1a0f53c244a0b03e8ba94a4ca7ca', 'request_id': 'req-d7376556-cc52-49e5-9fde-8138d2e2e7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.495923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7184280db3884d6b8ffa9f264f858692'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.501602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7184280db3884d6b8ffa9f264f858692'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.501602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-d2afd385-894f-4217-a865-d09e8d922f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7184280db3884d6b8ffa9f264f858692'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.504479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefd1a0f53c244a0b03e8ba94a4ca7ca', 'request_id': 'req-d7376556-cc52-49e5-9fde-8138d2e2e7b3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.523319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3783/7610] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:09 2022] DELETE /identity/v3/users/7184280db3884d6b8ffa9f264f858692 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:10.720341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] The token cache is being invalidate because project aefd1a0f53c244a0b03e8ba94a4ca7ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:10.720706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.724978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d7376556-cc52-49e5-9fde-8138d2e2e7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:10.730757 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3828/7611] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:09 2022] DELETE /identity/v3/projects/aefd1a0f53c244a0b03e8ba94a4ca7ca => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:10.733035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:10.733377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:10.733661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:10.774537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:10.776106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:10.826708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:11.514989 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3784/7612] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:11.532593 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3829/7613] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:11.543933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:11.543933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967ceed-ef5e-49c9-b420-3d3cc3613307 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:11.543933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:11.543933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:11.545526 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3785/7614] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:11.553756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:11.553756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370339-50b9-4ed6-9cb0-56ec6c9db0f5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:11.553756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:11.553756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:11.555272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:11.555272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:11.555272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:11.555272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:11.555755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:11.555755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:11.555755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d58e-f518-4047-8282-e53ccd68a55d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:11.556102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:11.556102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:11.556102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:11.556102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] PATH_INFO: `/v3/projects/6851a30bb47442b59924bb376b75e744` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:11.556481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6851a30bb47442b59924bb376b75e744)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:11.556481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:11.556832 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3830/7615] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:11 2022] POST /identity/v3/projects => generated 359 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:11.556832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:11.695422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf4a73-219f-40e7-93ae-6f413aa80e54 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:11.706397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:11.707201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:11.707546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:11.707887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:11.708874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:11.711387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:11.858255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6851a30bb47442b59924bb376b75e744', 'request_id': 'req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:11.874803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6851a30bb47442b59924bb376b75e744', 'request_id': 'req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:12.050210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3831/7616] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:11 2022] POST /identity/v3/users => generated 280 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:12.054435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.074518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8606ec5-19f1-466d-ae7b-d3c511025b15 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.129307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6851a30bb47442b59924bb376b75e744', 'request_id': 'req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:12.151109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] The token cache is being invalidate because project 6851a30bb47442b59924bb376b75e744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:12.151597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:12.152842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56b8fdf0-999e-40c3-8f66-8951d8eb2a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:12.166780 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3786/7617] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:11 2022] DELETE /identity/v3/projects/6851a30bb47442b59924bb376b75e744 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:12.168654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9125-345c-435b-979c-95b598cf5991 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.169100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9125-345c-435b-979c-95b598cf5991 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.169497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9125-345c-435b-979c-95b598cf5991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.203565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-301e9125-345c-435b-979c-95b598cf5991 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:12.206154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-301e9125-345c-435b-979c-95b598cf5991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:12.241238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.243306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.243901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.245620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.250392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.252749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.267445 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3832/7618] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:12.310150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.310150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:12.310150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929992-bcca-4852-9506-cb91e0a9131c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.310565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.310565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.310565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.310565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.310854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.310854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.314272 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3833/7619] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:12.318526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.336568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f641b6d-dbc8-4de1-ad15-bf358d377066 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.344439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.344654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3787/7620] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:12.345629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.346190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.363282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] PATH_INFO: `/v3/projects/f1025cb550764f02aab83fedb23f8400/users/3d01b8d80a694390a7c2ab23e83eaf59/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.370100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.370390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.370667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.383922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1025cb550764f02aab83fedb23f8400, user_id=3d01b8d80a694390a7c2ab23e83eaf59, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.390464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770fd88-0657-4e5f-a849-90b87b373dbc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.402960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:12.404429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:12.416687 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3788/7621] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:12.431799 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.444164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a48a97-8a58-4111-a710-eca42d255d23 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.451101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.451865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.452201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.452721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.453897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:12.454434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.456473 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.471581 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3789/7622] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:12.475796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.495925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0553-022f-40d5-b4da-43d468b2de8a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.503293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.504182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.504601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.504933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.506183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.509723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.560641 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3834/7623] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:12 2022] PUT /identity/v3/projects/f1025cb550764f02aab83fedb23f8400/users/3d01b8d80a694390a7c2ab23e83eaf59/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:12.568141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.568429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.568756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.679761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] MFA Rules not processed for user `3d01b8d80a694390a7c2ab23e83eaf59`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:12.682906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:12.688030 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3790/7624] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:12 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:00:12.710295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.883791 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3835/7625] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:12.911633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf7cb-39b0-4ecc-8465-ea1335fe4f01 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:12.918118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:12.918990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:12.919476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:12.919934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:12.920794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:12.942137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:12.953380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:12.966407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:13.079024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1512972-775d-4136-82cc-7bbed1605076 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:13.090485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:13.091517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.095169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.095169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.108948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:13.111639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:13.140217 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3836/7626] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:00:13.148359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:13.166423 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3791/7627] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:12 2022] POST /identity/v3/users => generated 291 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:13.169657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bd499-9e9b-4b12-80fc-0eb3122f1bf6 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:13.170596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:13.185317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be701c98-4456-4fd9-b2f0-901f3ea1fee2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:13.186988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:13.187861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.188349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.188841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] PATH_INFO: `/v3/users/3d01b8d80a694390a7c2ab23e83eaf59` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.192619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d01b8d80a694390a7c2ab23e83eaf59)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:13.195648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:13.199695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:13.201018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.205368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.205924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.206949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:13.208943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:13.230600 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3792/7628] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:00:13.239884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:13.289281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489c026-3504-4694-8240-148d7ca5aeda admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:13.303747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:13.304717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.305132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.305569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.307639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:13.309449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:13.319866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:13.329991 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3793/7629] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:13.335384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:13.381013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa9cbd-88b9-492d-a6ad-bf7019907a6e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:13.408940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:13.409625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.415467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.415467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] PATH_INFO: `/v3/projects/9aa48be6894b4a5993e969472afe1396/users/10227f104b254a91b4f14e9818244d7d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.453756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa48be6894b4a5993e969472afe1396, user_id=10227f104b254a91b4f14e9818244d7d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:13.458770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de689e35-58db-4dea-9292-22981a80f19e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:13.549026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d01b8d80a694390a7c2ab23e83eaf59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:13.605064 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3794/7630] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:13 2022] PUT /identity/v3/projects/9aa48be6894b4a5993e969472afe1396/users/10227f104b254a91b4f14e9818244d7d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:13.610386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.610818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.611098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.669559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:13.675042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:13.681899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d01b8d80a694390a7c2ab23e83eaf59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:13.724586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d01b8d80a694390a7c2ab23e83eaf59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:13.743002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d01b8d80a694390a7c2ab23e83eaf59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:13.743424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da73e9b5-2223-4c0a-89ad-9a1c5e1fb944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d01b8d80a694390a7c2ab23e83eaf59'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:13.774903 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3837/7631] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:13 2022] DELETE /identity/v3/users/3d01b8d80a694390a7c2ab23e83eaf59 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:13.776601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:13.777096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:13.777473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:13.842092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:13.849711 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3795/7632] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:13.850583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:13.891271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:13.892796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:14.053759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3838/7633] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:14.061895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:14.062250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b0c7d-d98a-4ba4-9545-e6e787ae8fc9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:14.065608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:14.129239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:14.129916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:14.130191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:14.130458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:14.182553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:14.188674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:14.253994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3796/7634] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:00:14.287630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59e35a7-7f3a-4c52-9eb1-3d92eea08d40 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:14.331214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:14.332010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:14.334621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:14.334926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:14.359408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:14.361374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f92bf-a8fe-4157-8c78-e2689b0803c4 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:14.385646 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3839/7635] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:14.444253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:15.624211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:16.282082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:16.285369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:16.313961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a31928-2dc2-49ce-b4ea-5c9f49727eea service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:16.331842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:16.333935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:16.337068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:16.337068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] PATH_INFO: `/v3/projects/f1025cb550764f02aab83fedb23f8400` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:16.338219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1025cb550764f02aab83fedb23f8400)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:16.344989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:16.460363 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:16.523839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1025cb550764f02aab83fedb23f8400', 'request_id': 'req-483c8be9-bd41-4c38-a9f4-7736aead9a64'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:16.542617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1025cb550764f02aab83fedb23f8400', 'request_id': 'req-483c8be9-bd41-4c38-a9f4-7736aead9a64'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:16.666424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1025cb550764f02aab83fedb23f8400', 'request_id': 'req-483c8be9-bd41-4c38-a9f4-7736aead9a64'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:16.691160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] The token cache is being invalidate because project f1025cb550764f02aab83fedb23f8400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:16.691695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:16.694460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-483c8be9-bd41-4c38-a9f4-7736aead9a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:16.701662 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3797/7636] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:16 2022] DELETE /identity/v3/projects/f1025cb550764f02aab83fedb23f8400 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:16.704166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:16.704916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:16.705209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:16.780691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:16.782300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:16.875724 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3840/7637] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:16.886958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:16.887250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:16.887731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:16.948420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:16.950528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:16.960975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:16.964000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:17.006833 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3798/7638] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:17.017271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.050171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e0d15-ae48-4d16-82e2-e61144c13ad9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.066004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.072015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.072769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.075708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.078112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:17.078648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.086146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.135537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3799/7639] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:17.137001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.142128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:17.172423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d259dd-6c36-4f75-bf89-bac03976feb8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.175443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2a548-4a61-408b-a061-6ca1cb2abd9e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.208320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.209369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.209653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.209927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.211604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.212263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.214305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.215463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.220229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.224609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:17.227451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.262110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.263585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.292235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3841/7640] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:00:17.405426 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3800/7641] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:17 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:17.410656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.439216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40472d41-375b-4ed9-b608-02d84446958d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.551343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.551971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.552167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.552991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.553873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.558386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.585914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:17.706006 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3842/7642] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:17 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:17.710128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.727549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d171c-efb4-4705-bf05-de53297af632 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.741298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.742515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.742515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.742515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.747226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.750982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.778655 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3801/7643] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:17.782753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.798560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0add3-235c-4488-adfe-92b927611bb4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.811006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.813031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.813031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.813209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:17.813904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:17.818223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f22fc9-f30e-4267-8b37-d1578c57f5b8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:17.875445 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3843/7644] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:17.878537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:17.895417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf1196-110b-495e-8183-1cb8b4e1fc75 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:17.933177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:17.938498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:17.938824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:17.939114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] PATH_INFO: `/v3/projects/035290b5f1d349998b051b1d27e4e607/users/b255fbfd913b497cae2bdc7fae2d2fc5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:18.002521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035290b5f1d349998b051b1d27e4e607, user_id=b255fbfd913b497cae2bdc7fae2d2fc5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:18.012910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:18.135920 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3802/7645] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:17 2022] PUT /identity/v3/projects/035290b5f1d349998b051b1d27e4e607/users/b255fbfd913b497cae2bdc7fae2d2fc5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:18.137763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:18.138062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:18.138346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:18.240548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] MFA Rules not processed for user `b255fbfd913b497cae2bdc7fae2d2fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:18.247722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:18.532927 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3844/7646] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:18.537210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:18.695388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c40af1-6e15-4cd6-9874-c667632df1e1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:18.715252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:18.715901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:18.716188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:18.718872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:18.721855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:18.721855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:18.925167 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3803/7647] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:18 2022] POST /identity/v3/projects => generated 375 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:18.929453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:18.983020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f260542-a774-4f5e-87ce-329fd8e2ad07 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:19.219405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:19.221365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.222155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.222155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:19.222659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:19.229886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:19.235558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:19.335829 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3845/7648] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:18 2022] POST /identity/v3/users => generated 294 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:19.339712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:19.359514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11516e4-b3b3-4af8-9bd5-83edf9b27dbd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:19.387294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:19.388546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.390274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.392234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:19.392360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:19.393247 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:19.403184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:19.429024 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3804/7649] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:19.433217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:19.452907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaabb0e-d8bc-4084-9b6f-9085dd5281e6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:19.486045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:19.487064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.487525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.487999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] PATH_INFO: `/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178/users/7ef37d45591b48db8109bcbd7668fbe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:19.530780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c90ddc1f52c4f2c8fef4ee3b58a9178, user_id=7ef37d45591b48db8109bcbd7668fbe7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:19.536025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:19.631783 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3846/7650] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:19 2022] PUT /identity/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178/users/7ef37d45591b48db8109bcbd7668fbe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:19.633169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:19.647411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644535b-27fc-4b30-b72c-9ce6de3dedeb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:19.751050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:19.752048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.752800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.753395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:19.754225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:19.756268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:19.771881 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3805/7651] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:19.777609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:19.794980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084f045-9cde-4567-8905-6c4f3567f68b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:19.810572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:19.831828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:19.834151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:19.842469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.842469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.842720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] PATH_INFO: `/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178/users/7ef37d45591b48db8109bcbd7668fbe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:19.862417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c90ddc1f52c4f2c8fef4ee3b58a9178, user_id=7ef37d45591b48db8109bcbd7668fbe7, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:19.869510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d662b4c-c7ca-42da-95b4-ebc3bd662b38 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:19.956566 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3847/7652] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:19 2022] PUT /identity/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178/users/7ef37d45591b48db8109bcbd7668fbe7/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:19.958878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:19.961622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:19.963633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:20.109521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] MFA Rules not processed for user `7ef37d45591b48db8109bcbd7668fbe7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:20.112788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:20.164536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377f176-8244-4ea1-acbe-3d04ea0af36b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:20.355769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:20.356635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:20.362916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:20.362916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:20.362916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:20.409821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:20.411739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:20.433289 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3806/7653] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:20.456227 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3848/7654] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:20.456935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:20.458527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:20.718450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829eba7c-e32a-408b-8b0e-c0c5f6b7a2fe service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:20.725658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:20.726563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:20.726995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:20.728836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:20.972212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:20.973779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:21.002128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3807/7655] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:21.163359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:21.405658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:23.798310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:24.037779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:25.092103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:25.345323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:26.731912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:27.408897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:28.781143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:29.173659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:29.723256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:30.144406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:31.140214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:31.323551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:31.813885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:31.835916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2855-dcfc-4456-b8a4-6a437e9fe294 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:31.866162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:31.866982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:31.867292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:31.871738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:31.880688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:31.930230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:31.937214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e2426-da89-4569-a7bd-52a4a777bb84 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:31.991672 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3849/7656] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:33.515422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:33.548007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:33.594144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:33.740159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0089a46-63f7-4870-a9c3-f6cfc055d17e service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:33.755701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:33.755701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:33.755701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:33.755701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] PATH_INFO: `/v3/users/b255fbfd913b497cae2bdc7fae2d2fc5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:33.765504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b255fbfd913b497cae2bdc7fae2d2fc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:33.767530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:34.076509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b255fbfd913b497cae2bdc7fae2d2fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:34.230972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b255fbfd913b497cae2bdc7fae2d2fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:34.253933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b255fbfd913b497cae2bdc7fae2d2fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:34.258671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b255fbfd913b497cae2bdc7fae2d2fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:34.265171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b255fbfd913b497cae2bdc7fae2d2fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:34.309338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3808/7657] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:33 2022] DELETE /identity/v3/users/b255fbfd913b497cae2bdc7fae2d2fc5 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:34.310613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:34.311018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:34.311255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:34.347376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:34.352156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:34.355736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:34.501447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:34.504201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:34.512663 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3850/7658] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:34.577256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:34.729507 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39485157-3aec-432e-8855-7f211e7d2713 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:34.734651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:34.735417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:34.735761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:34.739327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:34.791724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:34.795821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1594b95-2ccb-49b3-9f65-a4492d295d29 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:34.838602 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3809/7659] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:35.149629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:35.153514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:35.184837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5d3e0-3b6f-4c21-84be-d02bfa24b361 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:35.203222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:35.205609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:35.206827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:35.207280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] PATH_INFO: `/v3/users/45c736b7ac1c4303b764761b2254e9d7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:35.218247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c736b7ac1c4303b764761b2254e9d7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:35.226255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:35.287334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:35.287959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:35.288469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:35.399501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] MFA Rules not processed for user `10227f104b254a91b4f14e9818244d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:35.407418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:35.623477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c736b7ac1c4303b764761b2254e9d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:35.638102 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3810/7660] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:35.639306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:35.647717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:35.707769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d484e3-89d9-42f9-841d-0ef85ecdd1c3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:35.723610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c736b7ac1c4303b764761b2254e9d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:35.728827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:35.731876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:35.732598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:35.738188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:35.739454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:35.744267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:35.774796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c736b7ac1c4303b764761b2254e9d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:35.815320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c736b7ac1c4303b764761b2254e9d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:35.818922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5c243484-1e2b-463c-8d82-ce79fcc7fb8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c736b7ac1c4303b764761b2254e9d7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:35.841059 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3851/7661] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:35 2022] DELETE /identity/v3/users/45c736b7ac1c4303b764761b2254e9d7 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:35.857557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:35.858010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:35.860261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:35.918883 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3811/7662] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:35 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:35.920018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:35.929505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:35.934730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:35.942481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:36.142185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bcd25-246e-414b-b6c4-b5d34d9ce8c5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:36.161616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:36.162615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:36.165139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:36.165680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:36.166568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:36.169001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:36.259515 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3852/7663] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:36.300595 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3812/7664] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:35 2022] POST /identity/v3/users => generated 297 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:36.310374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:36.332384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:36.332384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:36.332384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:36.333609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa2332-9fce-4792-87d0-2da0a5f579bd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:36.365478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:36.365478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:36.365746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:36.365829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:36.366506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:36.373995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:36.422118 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3853/7665] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:36.423107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:36.475915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0f28b-34ca-43d7-826a-c12113c41fdc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:36.501283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:36.501991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:36.502276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:36.502554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] PATH_INFO: `/v3/projects/af21b0a3be4b48368cfade99cec6b57c/users/92cebcd11f264b638182090f5c57a02b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:36.569620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af21b0a3be4b48368cfade99cec6b57c, user_id=92cebcd11f264b638182090f5c57a02b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:36.579816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:36.625567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4805-8133-46b9-989c-259d4d215ce7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:36.636277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:36.637343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:36.637893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:36.638226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:36.664275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:36.668887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:36.701490 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3813/7666] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:36.703881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:36.709386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:36.746069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d9f7b-6a9a-4641-978f-f8b72ee4ee8c service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:36.753953 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3854/7667] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:36 2022] PUT /identity/v3/projects/af21b0a3be4b48368cfade99cec6b57c/users/92cebcd11f264b638182090f5c57a02b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:36.758044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:36.916790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:36.917687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:36.918121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:36.918578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] PATH_INFO: `/v3/projects/035290b5f1d349998b051b1d27e4e607` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:36.921255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035290b5f1d349998b051b1d27e4e607)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:36.924384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:36.940619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d81e-8fff-4930-93d1-3660490797e3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:37.000669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:37.001799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:37.002776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:37.005986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:37.007514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:37.010757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:37.030229 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3855/7668] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:37.034355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:37.066322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44a421-0ef4-4f2f-991a-9372606073e3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:37.085357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:37.087449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:37.089517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:37.089991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] PATH_INFO: `/v3/projects/af21b0a3be4b48368cfade99cec6b57c/users/92cebcd11f264b638182090f5c57a02b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:37.102519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af21b0a3be4b48368cfade99cec6b57c, user_id=92cebcd11f264b638182090f5c57a02b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:37.109184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:37.163333 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3856/7669] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:37 2022] PUT /identity/v3/projects/af21b0a3be4b48368cfade99cec6b57c/users/92cebcd11f264b638182090f5c57a02b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:37.198961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:37.267298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035290b5f1d349998b051b1d27e4e607', 'request_id': 'req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:37.297645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035290b5f1d349998b051b1d27e4e607', 'request_id': 'req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:37.382791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035290b5f1d349998b051b1d27e4e607', 'request_id': 'req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:37.425898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] The token cache is being invalidate because project 035290b5f1d349998b051b1d27e4e607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:37.426451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:37.429295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:37.433071 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3814/7670] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:36 2022] DELETE /identity/v3/projects/035290b5f1d349998b051b1d27e4e607 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:37.436708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:37.438581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:37.619496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae878b5-8944-4d65-9b7d-5e96ed95c7f6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:37.743446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:37.744707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:37.745202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:37.745735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] PATH_INFO: `/v3/users/7ef37d45591b48db8109bcbd7668fbe7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:37.747967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef37d45591b48db8109bcbd7668fbe7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:37.751576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:38.078451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef37d45591b48db8109bcbd7668fbe7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:38.163680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef37d45591b48db8109bcbd7668fbe7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:38.199631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef37d45591b48db8109bcbd7668fbe7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:38.212859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef37d45591b48db8109bcbd7668fbe7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:38.213785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ab4b82c0-4c91-40fc-b9a9-b1a44511d3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef37d45591b48db8109bcbd7668fbe7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:38.227548 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3857/7671] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:37 2022] DELETE /identity/v3/users/7ef37d45591b48db8109bcbd7668fbe7 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:38.505986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:38.507619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:38.594951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ac69e-b30d-4546-b338-02ab4f8ebb37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:38.848517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:38.850622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:38.853622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:38.854401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] PATH_INFO: `/v3/projects/6790a6bdc3bd43eb9b393a49e206d97e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:38.864522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6790a6bdc3bd43eb9b393a49e206d97e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:38.874535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:38.993788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:39.158691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6790a6bdc3bd43eb9b393a49e206d97e', 'request_id': 'req-214d4082-6ef1-419c-b8f7-23f13e0e0516'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.178936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6790a6bdc3bd43eb9b393a49e206d97e', 'request_id': 'req-214d4082-6ef1-419c-b8f7-23f13e0e0516'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.262895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:39.313465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6790a6bdc3bd43eb9b393a49e206d97e', 'request_id': 'req-214d4082-6ef1-419c-b8f7-23f13e0e0516'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.337526 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] The token cache is being invalidate because project 6790a6bdc3bd43eb9b393a49e206d97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:39.338175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.376257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.379936 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3815/7672] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:38 2022] DELETE /identity/v3/projects/6790a6bdc3bd43eb9b393a49e206d97e => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:39.389423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2efb2-4c74-4de2-baed-306e52736e44 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:39.389423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2efb2-4c74-4de2-baed-306e52736e44 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:39.400882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2efb2-4c74-4de2-baed-306e52736e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:39.414585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:39.419556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:39.511167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-84d2efb2-4c74-4de2-baed-306e52736e44 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:39.516818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-84d2efb2-4c74-4de2-baed-306e52736e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:39.651320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d4082-6ef1-419c-b8f7-23f13e0e0516 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:39.671279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:39.672047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:39.672325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:39.672622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] PATH_INFO: `/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:39.674036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c90ddc1f52c4f2c8fef4ee3b58a9178)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:39.676021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:39.718348 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3858/7673] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:39.727105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:39.727971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:39.728561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:39.812303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:39.813813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:39.848109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3859/7674] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:39.855964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:39.869108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ef346-7914-4bc0-8703-a3df06f678af None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:39.885825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:39.887652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:39.887967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:39.888304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:39.889261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:39.889571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:39.909034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c90ddc1f52c4f2c8fef4ee3b58a9178', 'request_id': 'req-ea1a3042-a956-4867-ab43-910c57a0e3da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.918370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:39.943658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c90ddc1f52c4f2c8fef4ee3b58a9178', 'request_id': 'req-ea1a3042-a956-4867-ab43-910c57a0e3da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:39.943833 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3860/7675] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:39.955742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:39.969830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201030b-1b90-475e-9bb1-b5526cd9d874 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:40.073759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c90ddc1f52c4f2c8fef4ee3b58a9178', 'request_id': 'req-ea1a3042-a956-4867-ab43-910c57a0e3da'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:40.089859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] The token cache is being invalidate because project 6c90ddc1f52c4f2c8fef4ee3b58a9178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:40.090389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:40.092745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ea1a3042-a956-4867-ab43-910c57a0e3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:40.100265 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3816/7676] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:39 2022] DELETE /identity/v3/projects/6c90ddc1f52c4f2c8fef4ee3b58a9178 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:40.108012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9932d8-9d8b-405b-9a71-e0a019afe5c4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.109429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9932d8-9d8b-405b-9a71-e0a019afe5c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.110122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9932d8-9d8b-405b-9a71-e0a019afe5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.163089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:40.164292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.165626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.166394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.167218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:40.173224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:40.224254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1e9932d8-9d8b-405b-9a71-e0a019afe5c4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:40.225767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e9932d8-9d8b-405b-9a71-e0a019afe5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:40.259661 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3817/7677] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:40.267316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.267770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.268189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.346150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:40.347408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:40.375304 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3818/7678] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:40.380058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:40.414601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c121f5-95af-4a01-9503-9e141fa22e69 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:40.438747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:40.439389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.439674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.439998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.440633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:40.440940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:40.442639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:40.489374 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3861/7680] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:39 2022] POST /identity/v3/projects => generated 377 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:00:40.490308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:40.492941 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3819/7680] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:40.494057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:40.535049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:40.574661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1975f-ce38-4c2a-9658-3818d93b7679 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:40.708120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f70235-b4ff-4664-a205-4d0429ab07c2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:40.728942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:40.732328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.732328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.732328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.732328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:40.732792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:40.792532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:40.794491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:40.796147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:40.796662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:40.797510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:40.800411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:40.973756 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3862/7681] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:40 2022] POST /identity/v3/projects => generated 377 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:40.978835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.042025 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3820/7682] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:40 2022] POST /identity/v3/users => generated 289 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:41.045877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.079806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581755-0e08-48da-81a2-05f39b7d27d9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.106263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1967b3-9cab-458e-932d-51fedf67d6b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.119724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.120633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.121237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.121614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.122555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.132134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.259569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.263227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.263562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.263846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.267046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.278201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.353816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3821/7683] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:41.357017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.393992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034e67c-e075-4219-8a6f-6cced10de8a3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.411627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:41.416264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.420317 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3863/7684] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:40 2022] POST /identity/v3/users => generated 289 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:00:41.421445 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.422465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.423660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.424127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.427109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.431963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.459381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0854e-ff0d-42b7-b331-e6705d9477b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.472375 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3822/7685] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:41.474803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.475704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.476424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.477538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.477959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.480713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.481693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.504255 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3864/7686] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:00:41.516605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2b6c9-0903-48d9-abda-1882ce5c75ec admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.525678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.537478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.538420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.539265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.543151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] PATH_INFO: `/v3/projects/3ae048e335c44f9fa6025b89b443a92e/users/002f6d4732b946a18c57eb62e4702489/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.572531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff4fa8-e229-48c4-aaa6-ce2a0c2bcb5c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.583316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae048e335c44f9fa6025b89b443a92e, user_id=002f6d4732b946a18c57eb62e4702489, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.591179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01dfa9-2040-4b32-b873-a43751d01fef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.600023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.600776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.601245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.602233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.603495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.606325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.630632 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3865/7687] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:41.630999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.661331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329dea61-511d-4ded-85cb-0890962b03a0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:41.670736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:41.671890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.672380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.672975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] PATH_INFO: `/v3/projects/c3d6e73fbbe5461096b833912e3fc5d6/users/dc6d8e68d42541ca9d60f6d4142867ec/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.716373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d6e73fbbe5461096b833912e3fc5d6, user_id=dc6d8e68d42541ca9d60f6d4142867ec, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:41.732256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:41.733310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:41.745335 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3823/7688] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:41 2022] PUT /identity/v3/projects/3ae048e335c44f9fa6025b89b443a92e/users/002f6d4732b946a18c57eb62e4702489/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:41.757361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6371-fd1a-4b7e-b359-af30faa2ee31 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:41.757943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6371-fd1a-4b7e-b359-af30faa2ee31 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:41.758470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e6371-fd1a-4b7e-b359-af30faa2ee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:41.834383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-605e6371-fd1a-4b7e-b359-af30faa2ee31 None None] MFA Rules not processed for user `002f6d4732b946a18c57eb62e4702489`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:41.836076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-605e6371-fd1a-4b7e-b359-af30faa2ee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:41.949846 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3866/7689] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:41 2022] PUT /identity/v3/projects/c3d6e73fbbe5461096b833912e3fc5d6/users/dc6d8e68d42541ca9d60f6d4142867ec/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:41.950991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:41.963642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:42.059741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3824/7690] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:42.062021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.062486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.062942 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.141020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] MFA Rules not processed for user `dc6d8e68d42541ca9d60f6d4142867ec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:42.142065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:42.179032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1350167-0bca-42b3-97f4-a032ad5baaac admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:42.195713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:42.196633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.196864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.197210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] PATH_INFO: `/v3/users/23176dd8ee394e4a93ccf4eac51f406e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.207205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23176dd8ee394e4a93ccf4eac51f406e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:42.209643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:42.391512 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3825/7691] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:42.392804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:42.394530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:42.556534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6bcb-6a62-41b0-8620-09c86c8a2ffc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:42.571070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:42.575043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.575043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.575043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.585021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23176dd8ee394e4a93ccf4eac51f406e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:42.720730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:42.724177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:42.752166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3826/7692] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:42.754140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:42.798674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31decf18-5407-46d4-83fc-84f8a2e2b7e0 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:42.805243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23176dd8ee394e4a93ccf4eac51f406e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:42.833419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:42.833905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.834421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.834421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.836972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23176dd8ee394e4a93ccf4eac51f406e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:42.839029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:42.844798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:42.856976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23176dd8ee394e4a93ccf4eac51f406e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:42.864171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a33dc4cc-9413-4eb5-8106-042ecea4550e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23176dd8ee394e4a93ccf4eac51f406e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:42.872828 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3867/7693] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:00:41 2022] DELETE /identity/v3/users/23176dd8ee394e4a93ccf4eac51f406e => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:42.877164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:42.877890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:42.878313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:42.926706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:42.928603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:43.044349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3827/7694] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:42 2022] POST /identity/v3/projects => generated 377 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:43.051201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:43.054349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:43.093083 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3868/7695] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:43.120277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:43.124044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:43.237484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210300d-d8c8-455e-8177-b53ee840c43e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:43.251196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:43.251985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:43.255194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:43.255194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:43.258069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:43.265979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:43.423496 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885b1db-a4d7-4177-be1b-569b0a1f96d9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:43.521791 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3828/7696] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:43 2022] POST /identity/v3/users => generated 289 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:43.538235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:43.575661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50d5d3-eb8c-4826-9e58-47c220cdb391 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:43.602846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:43.603818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:43.604252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:43.604701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:43.605544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:43.610111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:43.645317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:43.645972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:43.646660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:43.647070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:43.658892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3829/7697] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:43.664256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:43.674935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:43.676566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:43.689960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87834b1f-54cb-4ac4-ba15-4864be4f0c36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:43.703431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:43.704230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:43.704649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:43.705636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:43.706408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:43.722637 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3869/7698] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:00:43.733132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fd4e28-3f06-4f99-ba9f-c933aae5ddcf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:43.754047 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3830/7699] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:43.759238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:43.775691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d3b37-ddb3-4f34-b82f-deb4ea39290d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:43.794830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:43.796145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:43.796680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:43.797149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] PATH_INFO: `/v3/projects/d9ea7dfc11c4464693a46b3f68e871d1/users/7bcad614ae9746068ed9bf505474d917/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:43.849298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ea7dfc11c4464693a46b3f68e871d1, user_id=7bcad614ae9746068ed9bf505474d917, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:43.853170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:44.040181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3870/7700] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:43 2022] PUT /identity/v3/projects/d9ea7dfc11c4464693a46b3f68e871d1/users/7bcad614ae9746068ed9bf505474d917/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:44.056623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:44.057578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:44.058072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:44.116662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] MFA Rules not processed for user `7bcad614ae9746068ed9bf505474d917`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:44.119003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:44.227044 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3831/7701] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:44.232270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:44.392350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb176a3f-aadf-4148-8747-bc0c8f320235 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:44.406438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:44.406639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:44.407059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:44.407458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:44.408430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:44.412418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:44.598941 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3871/7702] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:44 2022] POST /identity/v3/projects => generated 375 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:44.603894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:44.615782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dca67-4361-4c9c-97a2-8a62d67403f3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:44.741051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:44.743813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:44.744849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:44.745516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:44.746374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:44.750005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:44.911477 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3832/7703] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:44 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:44.918064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:44.935168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594fd76-b76c-4318-ab72-bf57266adf4e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:44.941720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:44.943646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:44.944546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:44.945453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:44.946613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:44.948872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:44.971009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:44.982363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3872/7704] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:44.984336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76008ac-64ea-4199-b2b2-b8bb4d44a221 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:44.990975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:44.992962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:44.993502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:44.994004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] PATH_INFO: `/v3/projects/af3e7b6e13954dbf98e3c5698abceca3/users/246ef2e50b6749839ac9f577acbeb14b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:45.042491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3e7b6e13954dbf98e3c5698abceca3, user_id=246ef2e50b6749839ac9f577acbeb14b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:45.045892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:45.228171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:45.237584 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3833/7705] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:44 2022] PUT /identity/v3/projects/af3e7b6e13954dbf98e3c5698abceca3/users/246ef2e50b6749839ac9f577acbeb14b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:45.245409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99482e4-f6b7-4a0f-bc40-5d0cc2b5677e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:45.370265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:45.371126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:45.371660 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:45.372072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:45.372898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:45.374691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a368-5364-4626-827c-3a33fb24cdfa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:45.394453 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3873/7706] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:45.395354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:45.411449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b223d47-20ba-4efd-a7ed-5aea9a43d045 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:45.418459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:45.420241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:45.420568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:45.420855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] PATH_INFO: `/v3/projects/af3e7b6e13954dbf98e3c5698abceca3/users/246ef2e50b6749839ac9f577acbeb14b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:45.424177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3e7b6e13954dbf98e3c5698abceca3, user_id=246ef2e50b6749839ac9f577acbeb14b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:45.428384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:45.456157 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3834/7707] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:45 2022] PUT /identity/v3/projects/af3e7b6e13954dbf98e3c5698abceca3/users/246ef2e50b6749839ac9f577acbeb14b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] MFA Rules not processed for user `246ef2e50b6749839ac9f577acbeb14b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:45.692754 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3874/7708] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:45.712639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:45.712639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:45.805765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6272d8-8113-4324-b63b-24fac9a6bf30 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:45.826210 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:45.827663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:45.828122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:45.828575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:45.833001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:45.918630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:45.922107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:46.009386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:46.011085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997321dd-0c91-4c78-87fe-1a7a1b417648 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:46.012621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:46.041636 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3835/7709] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:46.118747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:46.178111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd51e-77ca-4aae-811f-79589d0b14ab None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:46.192229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:46.194699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:46.195752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:46.206272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] PATH_INFO: `/v3/projects/a9cd102e94b44d1094c6d82f97d738b6` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:46.206272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cd102e94b44d1094c6d82f97d738b6)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:46.206272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:46.376366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba673d8-2b13-4873-b77a-ef9f8be8c152 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:46.376848 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba673d8-2b13-4873-b77a-ef9f8be8c152 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:46.377124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba673d8-2b13-4873-b77a-ef9f8be8c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:46.477654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cd102e94b44d1094c6d82f97d738b6', 'request_id': 'req-da4599f0-3f84-4da3-93e7-a512f1b604d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:46.493510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cd102e94b44d1094c6d82f97d738b6', 'request_id': 'req-da4599f0-3f84-4da3-93e7-a512f1b604d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:46.520249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cd102e94b44d1094c6d82f97d738b6', 'request_id': 'req-da4599f0-3f84-4da3-93e7-a512f1b604d5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:46.544449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-dba673d8-2b13-4873-b77a-ef9f8be8c152 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:46.548941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dba673d8-2b13-4873-b77a-ef9f8be8c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:46.714221 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3836/7710] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:46.762909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] The token cache is being invalidate because project a9cd102e94b44d1094c6d82f97d738b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:00:46.763399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:46.764662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:00:46.767520 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3875/7711] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:00:45 2022] DELETE /identity/v3/projects/a9cd102e94b44d1094c6d82f97d738b6 => generated 0 bytes in 850 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:00:46.774222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3e78-330e-4370-b5df-4185500e1a58 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:46.774505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3e78-330e-4370-b5df-4185500e1a58 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:46.785284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff3e78-330e-4370-b5df-4185500e1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:46.842896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2cff3e78-330e-4370-b5df-4185500e1a58 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:46.844811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2cff3e78-330e-4370-b5df-4185500e1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:46.977935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:46.980140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:47.122333 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3837/7712] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:47.133139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:47.133749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:47.134156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:47.221797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:47.227370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:47.255200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4599f0-3f84-4da3-93e7-a512f1b604d5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:47.261648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3838/7713] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:47.263203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:47.269655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:47.270301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:47.270763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:47.271032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:47.278806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:47.286693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee3be7-350b-4d23-8617-14cdc3616c09 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:47.297638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:47.301082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:47.303394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:47.303857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:47.307002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:47.308850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:00:47.311050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:47.315962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:47.317717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:47.333713 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3876/7714] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:00:47.361320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3839/7715] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:00:47.365920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:47.370975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:47.464245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880142d-bc0d-418e-a5f0-9da6547a1832 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:47.484368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:47.485137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:47.485358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:47.485721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:47.486447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:47.488997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:47.764269 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3877/7716] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:00:47 2022] POST /identity/v3/projects => generated 373 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:00:47.764720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:47.790029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0b959-975e-4f25-82ad-be491c060bc3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:47.980252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:47.981233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:47.982019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:47.982496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:47.983369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:47.991367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:48.200575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3840/7717] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:00:47 2022] POST /identity/v3/users => generated 287 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:00:48.204652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:48.259278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4620-8d8e-4306-9e20-b08b870135d8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:48.276261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:48.276424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:48.279593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:48.280056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:48.280807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:48.292310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:48.352605 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3878/7718] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:48.352831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:48.367625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03650c1f-30e7-444a-af68-aaca450366b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:48.391787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:48.398788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:48.398788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:48.398788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:48.398788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:48.400963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b041e1ac-1541-4034-a8fc-23f2ce4a18a0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:48.445381 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3841/7719] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:00:48.450400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:48.497978 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be7634-0060-4376-bda9-623d769f3301 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:48.517912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:48.526339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:48.526339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:48.526339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] PATH_INFO: `/v3/projects/2ebef82c406a4578acb8c58c8b070f2e/users/a7bc921653a44d9fbf33f3d0fb197500/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:48.577436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebef82c406a4578acb8c58c8b070f2e, user_id=a7bc921653a44d9fbf33f3d0fb197500, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:48.580833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:48.751883 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3879/7720] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:00:48 2022] PUT /identity/v3/projects/2ebef82c406a4578acb8c58c8b070f2e/users/a7bc921653a44d9fbf33f3d0fb197500/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:00:48.757201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d94fe-2e44-42d8-b750-f9e4d7951a3a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:48.757616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d94fe-2e44-42d8-b750-f9e4d7951a3a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:48.758074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d94fe-2e44-42d8-b750-f9e4d7951a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:48.798567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9d9d94fe-2e44-42d8-b750-f9e4d7951a3a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:48.800929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9d9d94fe-2e44-42d8-b750-f9e4d7951a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:48.946103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3842/7721] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:49.004901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:49.006888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:49.261322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899818f8-2e89-4961-b372-1f9e6d9ef1d7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:49.273472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea598-85cf-405a-b215-9f53e7a2da85 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:49.273756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea598-85cf-405a-b215-9f53e7a2da85 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:49.274025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ea598-85cf-405a-b215-9f53e7a2da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:49.275585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:49.276225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:49.276584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:49.276827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:49.312020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:49.313517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:49.324684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:49.329761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0b9ea598-85cf-405a-b215-9f53e7a2da85 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:49.332727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0b9ea598-85cf-405a-b215-9f53e7a2da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:49.347477 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3880/7722] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:49.539555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3843/7723] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 13:00:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:00:49.556132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:49.789523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996b304-ba37-4374-8662-fe90e321b1bd service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:49.796921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:49.798202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:49.798652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:49.799080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:49.812025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:49.814225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:49.828610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3881/7724] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:50.125288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:51.140640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:51.141481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:51.141481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:51.194187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:51.197903 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:51.222229 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3844/7725] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:00:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:51.243928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:51.262447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aedba5-dc53-494a-8fdc-138e67d7461c service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:51.271068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:51.272008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:51.272516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:51.273438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:51.287719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:51.291056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ca3b4-f214-4d97-845d-a5fc2b6d0e0f service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:51.319273 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3882/7726] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:00:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:00:51.494466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:51.773831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:52.544465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:52.544465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:52.676703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:52.679750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:52.680356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:52.719262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:52.722202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:52.727263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409785bd-42bd-4725-9afc-9d050fe0bce1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:52.736037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:52.736717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:52.736995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:52.737264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:52.738590 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3883/7727] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:52.758349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:52.762214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:52.818153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bfcae-ede2-4442-b1e5-c46784a15a70 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:52.844786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:52.849505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:52.850325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:52.859056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:52.866212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:52.868183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:52.878936 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3884/7728] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:00:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:00:52.884011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:52.885873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3e7b4-6eea-4988-a66a-744926619cb4 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:52.944078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3845/7729] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:52.950911 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:53.451197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:54.603293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:55.563872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:55.812203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:55.837284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df92bd4-4cd5-4500-a89e-27569593ba06 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:55.849678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:55.853570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:55.854574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:55.855008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:55.858956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:56.125031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:56.130309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:56.181058 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3885/7730] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:56.925222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:57.235992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:57.236348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:57.236713 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:57.355249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] MFA Rules not processed for user `92cebcd11f264b638182090f5c57a02b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:00:57.356720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:57.550819 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3846/7731] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:00:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:00:57.564106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:00:57.565631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:57.743324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6e6e-7fad-4f28-968b-e8186162c104 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:00:57.755928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:00:57.759156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:00:57.759602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:00:57.760020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:00:57.768925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:00:58.009312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:00:58.011082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc5b37-de84-47e3-8019-e74c502f469b service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:00:58.041439 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3886/7732] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:00:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:00:58.436520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:58.573420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:59.929737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:00.719947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:02.242186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:03.147854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:04.535218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:04.626005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:05.013354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:05.071479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:05.290095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:05.367439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:05.876257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:06.616905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:06.618440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:06.656913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fe135-6ab2-4c57-a33f-24266d601507 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:06.684764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:06.701830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:06.702114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:06.702393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] PATH_INFO: `/v3/users/c5941a1c8f324201ba8ac980d55ea942` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:06.706416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5941a1c8f324201ba8ac980d55ea942)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:06.717680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:07.146655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5941a1c8f324201ba8ac980d55ea942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:07.254409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5941a1c8f324201ba8ac980d55ea942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:07.286591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5941a1c8f324201ba8ac980d55ea942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:07.287586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5941a1c8f324201ba8ac980d55ea942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:07.288354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5941a1c8f324201ba8ac980d55ea942'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:07.333669 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3847/7733] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:06 2022] DELETE /identity/v3/users/c5941a1c8f324201ba8ac980d55ea942 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:07.339211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:07.340020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:07.340300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:07.413780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:07.415034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:07.608408 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3887/7734] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:07.658540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:07.660460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:07.678811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:07.810491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcd13d-5648-4b2f-9775-2a3acf41b07e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:07.829751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:07.830646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:07.831102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:07.831519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:07.869600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:07.871115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee00c6-3615-4efe-bca0-6d46933fd224 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:07.892975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3848/7735] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:08.363292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:08.758885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:09.265720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:09.267935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:09.331294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc6433-c0f9-41e4-a7ca-d73e7d435542 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:09.348786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:09.355768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:09.357247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:09.357592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] PATH_INFO: `/v3/projects/8b2a8740e62546739e8aa1ba5ce38aed` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:09.360868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b2a8740e62546739e8aa1ba5ce38aed)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:09.362844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:09.560321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b2a8740e62546739e8aa1ba5ce38aed', 'request_id': 'req-b6539d98-f185-4089-bca4-ccc505c00d66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:09.571422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b2a8740e62546739e8aa1ba5ce38aed', 'request_id': 'req-b6539d98-f185-4089-bca4-ccc505c00d66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:09.580480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b2a8740e62546739e8aa1ba5ce38aed', 'request_id': 'req-b6539d98-f185-4089-bca4-ccc505c00d66'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:09.725027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] The token cache is being invalidate because project 8b2a8740e62546739e8aa1ba5ce38aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:09.725332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:09.726512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b6539d98-f185-4089-bca4-ccc505c00d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:09.730804 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3888/7736] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:09 2022] DELETE /identity/v3/projects/8b2a8740e62546739e8aa1ba5ce38aed => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:09.736714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:09.737188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:09.737280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:09.807140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:09.809107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:09.893547 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3849/7737] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:09.912936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:09.913520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:09.913637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:09.944914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:09.946200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:09.966216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:09.977094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3889/7738] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:09.993535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173abf7-267a-45a9-9b04-4263a329d111 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.020041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.021575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.021959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.022304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.023054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:10.025574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:10.054491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:10.084031 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3850/7739] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:10.090246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:10.091983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:10.123969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d8205-26f5-4007-b522-60cbae610775 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.133094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.136758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.145190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.150229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.150229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:10.150229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf2d37-9d97-4290-9160-246ae8e4b1f7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:10.250481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3890/7740] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:10 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:10.251542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:10.265067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:10.268509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb993b-c1d3-4825-a4ab-805f3bf1a874 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.419735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.420684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.421162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.421587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.424722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:10.427274 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:10.571581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.571865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.572134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.599839 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3851/7741] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:10 2022] POST /identity/v3/users => generated 287 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:10.605629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:10.646268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] MFA Rules not processed for user `0373f7b34b984b07b8ab3f3965a7ea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:10.652315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:10.680823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9f3f6-4510-424e-a734-e3842b57bbbf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.718249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.718771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.720016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.720556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.722179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:10.725517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:10.764700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:10.798281 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3852/7742] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:10.799458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:10.846543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a087c3e-2707-4304-a042-bfdf15489c55 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.862799 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3891/7743] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:10.868831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.868831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.868831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.868831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:10.870322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:10.874391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d12a52-3de0-410f-801d-4c432184e39c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:10.923480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:10.933084 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3853/7744] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:10.951015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa1bb6-04af-4a9e-96e7-790fb0fe823e None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:10.963266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:10.967403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:10.967403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:10.967403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] PATH_INFO: `/v3/projects/859fa6a598e940adb04b27af754ebff8/users/bd516028846c4337ab3d9b3d8b18ac66/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.018435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859fa6a598e940adb04b27af754ebff8, user_id=bd516028846c4337ab3d9b3d8b18ac66, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:11.033824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0e83b-7bf1-4a12-82b8-3d6ceeb52ef7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:11.083144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:11.147722 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3892/7745] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:10 2022] PUT /identity/v3/projects/859fa6a598e940adb04b27af754ebff8/users/bd516028846c4337ab3d9b3d8b18ac66/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:11.172684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:11.173077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:11.173249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.236567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] MFA Rules not processed for user `bd516028846c4337ab3d9b3d8b18ac66`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:11.240035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:11.416334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef413-27b7-4df4-9d0b-4e97dff912d7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:11.418366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef413-27b7-4df4-9d0b-4e97dff912d7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:11.418366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ef413-27b7-4df4-9d0b-4e97dff912d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.502088 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3854/7746] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:11.504037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5c4ef413-27b7-4df4-9d0b-4e97dff912d7 None None] MFA Rules not processed for user `a7bc921653a44d9fbf33f3d0fb197500`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:11.505605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c4ef413-27b7-4df4-9d0b-4e97dff912d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:11.507251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:11.592616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:11.769511 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3893/7747] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:11.771297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f334b81-a625-473b-9e5c-bb37e1b7aa88 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:11.773798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:11.774225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:11.774663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.788809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:11.790263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:11.790810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:11.791181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:01:11.792538 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:11.794238 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:01:11.796217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:11.798577 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3894/7748] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:01:11 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:01:11.800423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:11.801237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:11.819789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:11.895402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:11.931250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:11.932990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:11.933783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:11.934517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] PATH_INFO: `/v3/users/002f6d4732b946a18c57eb62e4702489` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:11.937704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=002f6d4732b946a18c57eb62e4702489)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:11.942894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:12.139495 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3855/7749] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:11 2022] POST /identity/v3/projects => generated 373 bytes in 633 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:12.148307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:12.164673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:12.169088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:12.225863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002f6d4732b946a18c57eb62e4702489'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:12.352040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002f6d4732b946a18c57eb62e4702489'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:12.431638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002f6d4732b946a18c57eb62e4702489'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:12.436941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002f6d4732b946a18c57eb62e4702489'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:12.438534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002f6d4732b946a18c57eb62e4702489'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:12.447975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3895/7750] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:11 2022] DELETE /identity/v3/users/002f6d4732b946a18c57eb62e4702489 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:12.449183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:12.450778 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:12.574169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c635d9-e2c7-4beb-a2d6-7a47d913908e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:12.799787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e047e0-7e23-4909-b3e4-7df90c5a66eb admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:12.806935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:12.807952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:12.808374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:12.808841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:12.812865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:12.822420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:12.822956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ef198-71ec-4a39-bacf-6c7825c344d5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:12.823732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:12.833694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:12.833694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:12.833694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:12.833694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:12.986759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:13.039565 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3896/7751] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:12 2022] POST /identity/v3/users => generated 293 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:13.041907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.042377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.042486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3856/7752] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:12 2022] POST /identity/v3/projects => generated 373 bytes in 895 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:13.042992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.043902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.100718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:13.106078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:13.260993 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3897/7753] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:13.262137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.267397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d9b4d-9815-40bf-a151-9e558a0771bd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.267528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:13.291177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.291669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bc6ae7-9ffa-46aa-ac08-bf8cf5470c9b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.296099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.296099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.296099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.296099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.296099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.308000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.308611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.308874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.309154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.309804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.312027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.340441 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3857/7754] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:13.345588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.351557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:13.440961 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3898/7755] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:13 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:13.440961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.470387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835c008-9359-4333-89dd-24c4ab27e998 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.493449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.494154 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.494441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.494968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] PATH_INFO: `/v3/projects/f067e43049a74abf94534893be019e19/users/8124df4a3765449cba4194edd9131e95/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.564378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f067e43049a74abf94534893be019e19, user_id=8124df4a3765449cba4194edd9131e95, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.564378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.580224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:13.589406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b0102f-c154-401c-8d9a-f862a410f5c4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.606540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.607443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.607913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.608349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.632925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.634919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.661975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3858/7756] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:13.665793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3899/7757] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:13 2022] PUT /identity/v3/projects/f067e43049a74abf94534893be019e19/users/8124df4a3765449cba4194edd9131e95/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:13.666838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.670681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:13.672327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:13.709853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bae0df-5e74-4f17-9e83-79a9254afc6b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.895714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:13.917355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f4e5d-f3b1-421c-bbb4-4243c6d6ca19 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:13.930525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.933139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:13.933624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.934106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.935440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:13.935702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] PATH_INFO: `/v3/users/21b3db1875d34bdab006e56bc58bc055` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.936671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:13.938123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b3db1875d34bdab006e56bc58bc055)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.938439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:13.939291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:13.946419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.947553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:13.986664 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3859/7758] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:13.990915 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:14.074149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc60ae-1f3e-4111-aee6-b0a98e8f21fe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:14.086076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:14.086873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:14.087156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:14.087470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:14.089350 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:14.093221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:14.112972 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3860/7759] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:14.114411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:14.184614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44102d4f-fc89-4ef7-acab-a752e83ad3f0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:14.201923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:14.205689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:14.208741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:14.209767 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] PATH_INFO: `/v3/projects/83bd5e13a5e54740918cf5924a14886b/users/f75d319e5f924947bffd03b1d55affd2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:14.220263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:14.229610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b3db1875d34bdab006e56bc58bc055'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:14.264883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bd5e13a5e54740918cf5924a14886b, user_id=f75d319e5f924947bffd03b1d55affd2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:14.273017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:14.389519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b3db1875d34bdab006e56bc58bc055'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:14.412935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b3db1875d34bdab006e56bc58bc055'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:14.429720 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3861/7760] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:14 2022] PUT /identity/v3/projects/83bd5e13a5e54740918cf5924a14886b/users/f75d319e5f924947bffd03b1d55affd2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:14.429720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:14.447339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b3db1875d34bdab006e56bc58bc055'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:14.452198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b3db1875d34bdab006e56bc58bc055'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:14.478601 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3900/7761] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:13 2022] DELETE /identity/v3/users/21b3db1875d34bdab006e56bc58bc055 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:14.478601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:14.482129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:14.650804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7100-33f1-4140-98c9-dad016fa83de admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:14.745240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572aebaf-aab2-4800-b1b6-6b34d11386e7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:14.767628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:14.768720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:14.770538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:14.770962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] PATH_INFO: `/v3/projects/3ae048e335c44f9fa6025b89b443a92e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:14.795723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae048e335c44f9fa6025b89b443a92e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:14.795723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:14.804204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:14.805522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:14.808062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:14.808635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] PATH_INFO: `/v3/projects/f067e43049a74abf94534893be019e19/users/8124df4a3765449cba4194edd9131e95/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:14.815824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f067e43049a74abf94534893be019e19, user_id=8124df4a3765449cba4194edd9131e95, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:14.821481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:14.842148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3862/7762] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:14 2022] PUT /identity/v3/projects/f067e43049a74abf94534893be019e19/users/8124df4a3765449cba4194edd9131e95/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:14.843345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:14.845651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:14.861804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:14.979603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:15.018336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae048e335c44f9fa6025b89b443a92e', 'request_id': 'req-99caff63-0d5d-4331-a792-0f4907b85391'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:15.044965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae048e335c44f9fa6025b89b443a92e', 'request_id': 'req-99caff63-0d5d-4331-a792-0f4907b85391'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:15.062999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae048e335c44f9fa6025b89b443a92e', 'request_id': 'req-99caff63-0d5d-4331-a792-0f4907b85391'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:15.074372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9a1f1-c7d8-4fc4-9d54-62c68a431dc6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:15.173177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:15.174404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.174919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.175964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.177131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:15.180127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35cbf-dff8-484c-9081-56022e27eb67 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:15.186494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] The token cache is being invalidate because project 3ae048e335c44f9fa6025b89b443a92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:15.186805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:15.188367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-99caff63-0d5d-4331-a792-0f4907b85391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:15.194274 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3901/7763] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:14 2022] DELETE /identity/v3/projects/3ae048e335c44f9fa6025b89b443a92e => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:15.198119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde527-0c36-4cfb-8727-a4c54a27b13f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.198413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde527-0c36-4cfb-8727-a4c54a27b13f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.198722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddde527-0c36-4cfb-8727-a4c54a27b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.266892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-eddde527-0c36-4cfb-8727-a4c54a27b13f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:15.273291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-eddde527-0c36-4cfb-8727-a4c54a27b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.278009 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3863/7764] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:15.284300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a30b-0c0b-4257-853c-9ccbb7d78a30 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.285431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a30b-0c0b-4257-853c-9ccbb7d78a30 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.285431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a30b-0c0b-4257-853c-9ccbb7d78a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.295471 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3902/7765] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:15.299910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.300457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.301005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.366527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:15.371846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.409451 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3903/7766] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:15.410550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:15.411650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-96d2a30b-0c0b-4257-853c-9ccbb7d78a30 None None] MFA Rules not processed for user `8124df4a3765449cba4194edd9131e95`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:15.414108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-96d2a30b-0c0b-4257-853c-9ccbb7d78a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.415192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.474558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ebff-d609-466d-a70a-8ae5bd1b1769 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:15.493521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:15.494275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.494739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.495034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] PATH_INFO: `/v3/projects/83bd5e13a5e54740918cf5924a14886b/users/f75d319e5f924947bffd03b1d55affd2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.501379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bd5e13a5e54740918cf5924a14886b, user_id=f75d319e5f924947bffd03b1d55affd2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:15.509171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:15.543254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3904/7767] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:15 2022] PUT /identity/v3/projects/83bd5e13a5e54740918cf5924a14886b/users/f75d319e5f924947bffd03b1d55affd2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:15.546033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:15.550871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.651739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:15.665784 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3864/7768] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:15.670276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.670679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.670997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.731817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:15.736638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:15.783902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9f0fa-8b10-41f4-a6f1-91d7385b6f69 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:15.797403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:15.810733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:15.812583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:15.813026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:15.963237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:15.989334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:15.991752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:16.005611 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3865/7769] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:16.006206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:16.013975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3905/7770] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:16.015110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:16.029598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704b7ac-7e0c-45c4-a16c-bcf2df09cf7a service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:16.036266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:16.039651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:16.039651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:16.039651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:16.039651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:16.040263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:16.042707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:16.060817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f24d6-402b-4538-9701-be7c575e5f36 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:16.070482 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3906/7771] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:16.071827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:16.074050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:16.074460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:16.075322 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:16.075730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:16.084295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:16.098720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a375bd-240a-47dc-9092-ec4bcafa52e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:16.106826 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:16.107718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:16.108147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:16.108606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:16.109463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:16.113158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:16.232454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3907/7772] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:16 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:16.233473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:16.353440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:16.366143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:16.415851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3866/7773] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:16.609859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ed82-fea0-4d3f-9abf-07bba138000f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:16.609859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:16.609859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:16.609859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:16.612239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:16.612239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:16.612239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:16.804602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3908/7774] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:16 2022] POST /identity/v3/users => generated 284 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:16.814127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:16.837377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a509bc-f6e4-469d-8438-585c1f471ea1 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:16.898294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:16.947775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:16.955184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:16.955184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:16.955184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:16.967189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:16.974076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:17.016619 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3867/7775] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:17.020902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:17.094816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4fc52-042b-4b3a-82ad-f03fcf45491e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:17.122130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:17.123122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:17.123556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:17.124009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:17.124836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:17.129976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b879d43-290c-45f9-9998-c140d55bd5a5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:17.148252 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3909/7776] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:17.148728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:17.179129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ad7b-9c05-4189-8f34-f3a32145c95d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:17.208543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:17.210055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:17.211262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:17.211709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] PATH_INFO: `/v3/projects/2129b773afcd4f68961eaadb37241319/users/ef03c9c416d74059b2d0b55623aa9117/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:17.262857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2129b773afcd4f68961eaadb37241319, user_id=ef03c9c416d74059b2d0b55623aa9117, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:17.266501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:17.415435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3868/7777] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:17 2022] PUT /identity/v3/projects/2129b773afcd4f68961eaadb37241319/users/ef03c9c416d74059b2d0b55623aa9117/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:17.417530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:17.417816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:17.418088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:17.482871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] MFA Rules not processed for user `ef03c9c416d74059b2d0b55623aa9117`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:17.484190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:17.557752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:17.647596 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3910/7778] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:17.652249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:17.833030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cee2f5-0e44-48dc-a92a-a2c0dc01aaa5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:17.849214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:17.850707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:17.851166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:17.851762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:17.852742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:17.860046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:17.925001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:17.926713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:17.955348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960c6f4-ac96-486f-9fc8-c48026b1b381 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:17.991965 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3869/7779] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:17 2022] POST /identity/v3/projects => generated 367 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:17.996334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:18.006866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:18.006866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:18.006866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:18.006866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] PATH_INFO: `/v3/projects/84c6e219ae45464bbd62598e997ebbd7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:18.012742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c6e219ae45464bbd62598e997ebbd7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:18.019565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:18.173402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d3e9-70eb-44d9-9bf2-5b781caf78e4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:18.190370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:18.200959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:18.201304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:18.201584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:18.206007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:18.210844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:18.273372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c6e219ae45464bbd62598e997ebbd7', 'request_id': 'req-88fb2af1-b91a-4588-9e63-35982cd2fbc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:18.288193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c6e219ae45464bbd62598e997ebbd7', 'request_id': 'req-88fb2af1-b91a-4588-9e63-35982cd2fbc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:18.309209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c6e219ae45464bbd62598e997ebbd7', 'request_id': 'req-88fb2af1-b91a-4588-9e63-35982cd2fbc4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:18.433325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] The token cache is being invalidate because project 84c6e219ae45464bbd62598e997ebbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:18.434577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:18.439322 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3870/7780] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:17 2022] POST /identity/v3/users => generated 290 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:18.439485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:18.449680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:18.450235 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3911/7781] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:17 2022] DELETE /identity/v3/projects/84c6e219ae45464bbd62598e997ebbd7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:18.456432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:18.456805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:18.456900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:18.493687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c216c75-be32-4416-86ad-de42d4e2867b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:18.593602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:18.635100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb2af1-b91a-4588-9e63-35982cd2fbc4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:18.646183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:18.646183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:18.646183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:18.646538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] PATH_INFO: `/v3/users/242ed94f903646ff89e0b92e457111c7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:18.648931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=242ed94f903646ff89e0b92e457111c7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:18.651285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:18.690153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:18.691286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:18.697067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:18.697067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:18.697067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:18.714076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:18.787775 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3871/7782] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:18.793016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:18.855990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff78d9-e83f-47e6-b415-7ee5d09af1e6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:18.872645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:18.873341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:18.875936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:18.876405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] PATH_INFO: `/v3/projects/bffd985386b944639d34bd4edcd9501d/users/d17df1e5bcb943c9b1571f7d21f3757c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:18.945735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffd985386b944639d34bd4edcd9501d, user_id=d17df1e5bcb943c9b1571f7d21f3757c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:18.957315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:18.960989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242ed94f903646ff89e0b92e457111c7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:19.096214 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3872/7783] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:18 2022] PUT /identity/v3/projects/bffd985386b944639d34bd4edcd9501d/users/d17df1e5bcb943c9b1571f7d21f3757c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:19.098514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:19.102893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:19.118260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242ed94f903646ff89e0b92e457111c7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:19.163972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242ed94f903646ff89e0b92e457111c7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:19.190858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242ed94f903646ff89e0b92e457111c7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:19.192795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242ed94f903646ff89e0b92e457111c7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:19.221343 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3912/7784] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:18 2022] DELETE /identity/v3/users/242ed94f903646ff89e0b92e457111c7 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:19.230003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:19.233976 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:19.322340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd2004-5fb0-47f2-ab29-d6e09d574d31 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:19.468470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8535c9f-f2a4-4315-956e-6a85256bb06f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:19.489606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:19.494274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:19.499939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:19.500125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:19.500125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:19.500308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:19.500308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:19.500308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] PATH_INFO: `/v3/users/dc6d8e68d42541ca9d60f6d4142867ec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:19.500575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:19.501685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6d8e68d42541ca9d60f6d4142867ec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:19.505030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:19.513811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:19.578031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3913/7785] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:19.580720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:19.623350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc6fa3-c623-4456-96bd-45981b8a5be9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:19.639341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:19.640041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:19.640325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:19.642853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] PATH_INFO: `/v3/projects/bffd985386b944639d34bd4edcd9501d/users/d17df1e5bcb943c9b1571f7d21f3757c/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:19.651723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffd985386b944639d34bd4edcd9501d, user_id=d17df1e5bcb943c9b1571f7d21f3757c, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:19.657095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ef6ef-1277-48b2-99bc-85a1b63042c6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:19.677764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:19.685800 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3914/7786] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:19 2022] PUT /identity/v3/projects/bffd985386b944639d34bd4edcd9501d/users/d17df1e5bcb943c9b1571f7d21f3757c/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:19.696340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:19.696696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:19.696968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:19.778744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] MFA Rules not processed for user `d17df1e5bcb943c9b1571f7d21f3757c`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:19.780264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:19.852152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6d8e68d42541ca9d60f6d4142867ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:20.011261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6d8e68d42541ca9d60f6d4142867ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:20.072245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6d8e68d42541ca9d60f6d4142867ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:20.073143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6d8e68d42541ca9d60f6d4142867ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:20.075840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3d29df9d-ce91-464b-8bda-7cf0642ee076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6d8e68d42541ca9d60f6d4142867ec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:20.085744 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3915/7787] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:20.095483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:20.098137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:20.135858 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3873/7788] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:19 2022] DELETE /identity/v3/users/dc6d8e68d42541ca9d60f6d4142867ec => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:20.140268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:20.140583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:20.140863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:20.245442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:20.249463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:20.348240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee85eb-20c3-4cbd-901f-67b06e889295 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:20.357859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:20.435709 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3874/7789] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:20.506807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:20.508771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:20.513991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:20.514671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:20.514960 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:20.525564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:20.529677 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:20.679096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662fdc7-5b8a-4ae8-90cf-8d7ba73fb529 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:20.692982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:20.693641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:20.693927 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:20.694202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:20.716727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:20.718214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:20.746210 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3875/7790] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:20.766327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:20.769460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:20.814120 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3916/7791] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:21.124423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:21.126652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:21.163177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1824c1-0cce-48aa-998d-c8d59f7e4d76 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:21.169454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:21.170614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:21.173481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:21.173978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:21.176673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:21.435352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:21.456136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:21.459666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e8110-887b-4f37-b795-c82ada58537c service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:21.515927 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3876/7792] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:22.234453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:22.237924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:22.286276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f2e8a-eb96-44eb-9868-3c3bb885c7e6 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:22.299834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:22.300632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:22.300917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:22.301684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] PATH_INFO: `/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:22.307018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0bdd6dece34045bf63bd4b2c93c59a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:22.315792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:22.551879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:22.592297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0bdd6dece34045bf63bd4b2c93c59a', 'request_id': 'req-9f83d29a-3d53-4b07-adbc-91592be49db7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:22.613945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0bdd6dece34045bf63bd4b2c93c59a', 'request_id': 'req-9f83d29a-3d53-4b07-adbc-91592be49db7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:22.641188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0bdd6dece34045bf63bd4b2c93c59a', 'request_id': 'req-9f83d29a-3d53-4b07-adbc-91592be49db7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:22.775234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] The token cache is being invalidate because project 5e0bdd6dece34045bf63bd4b2c93c59a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:22.775584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:22.779214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9f83d29a-3d53-4b07-adbc-91592be49db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:22.811063 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3917/7793] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:22 2022] DELETE /identity/v3/projects/5e0bdd6dece34045bf63bd4b2c93c59a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:22.812290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:22.812426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:22.812872 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:22.869988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:22.874965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:23.233591 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3877/7794] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:23.242324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:23.242324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:23.242324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:23.293112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:23.300357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:23.334953 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3918/7795] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:23.335923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:23.369576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b29d2-3f69-45c7-aed0-9766cbf2a325 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:23.388396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:23.389250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:23.389531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:23.389807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:23.390475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:23.390779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:23.398020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:23.436528 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3878/7796] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:23.438945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:23.450132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67b68-7c1e-476a-993c-925fa37e9a1b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:23.461021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:23.461774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:23.462259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:23.462712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:23.463531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:23.465985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:23.633224 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3919/7797] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:23 2022] POST /identity/v3/projects => generated 369 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:23.634522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:23.649103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:23.653511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7b5a8-f2de-491c-a9de-133e5e4db88a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:23.813347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:23.814050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:23.814495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:23.814777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:23.815437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:23.823384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:23.966697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3879/7798] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:23 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:23.970968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:23.986621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:23.988578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:24.007293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ad102-0934-4b0b-9148-2b15e38dfd74 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:24.019557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6505556-d21f-44c2-8c5b-1296f66a6b4b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:24.024501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:24.025424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.025918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.026409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.027280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:24.029314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:24.049244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:24.050168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.050459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.050731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] PATH_INFO: `/v3/projects/c3d6e73fbbe5461096b833912e3fc5d6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.061924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d6e73fbbe5461096b833912e3fc5d6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:24.066190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:24.074085 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3920/7799] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:24.082884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:24.106041 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945c9be-c3e1-4395-9b9d-d5d3b6957f3e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:24.117238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:24.118151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.121026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.121319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.122085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:24.131871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:24.165898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3921/7800] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:24.167191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:24.188693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067a25a-d7a2-4f6e-9b1c-fb3e7c007a79 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:24.196120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:24.197246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.197904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.198324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] PATH_INFO: `/v3/projects/34bf3744309d4381acf25152b0225203/users/cfc554a51c084c45805c44333f345b8d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.222759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34bf3744309d4381acf25152b0225203, user_id=cfc554a51c084c45805c44333f345b8d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:24.226093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654cb02-1249-460f-bafd-b36642716ee6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:24.343944 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3922/7801] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:24 2022] PUT /identity/v3/projects/34bf3744309d4381acf25152b0225203/users/cfc554a51c084c45805c44333f345b8d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:24.344579 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d6e73fbbe5461096b833912e3fc5d6', 'request_id': 'req-75770932-4b0e-45fd-b1f8-eb830494e1ee'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:24.351640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.351640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.351640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.373543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d6e73fbbe5461096b833912e3fc5d6', 'request_id': 'req-75770932-4b0e-45fd-b1f8-eb830494e1ee'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:24.417783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] MFA Rules not processed for user `cfc554a51c084c45805c44333f345b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:24.419209 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:24.493351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d6e73fbbe5461096b833912e3fc5d6', 'request_id': 'req-75770932-4b0e-45fd-b1f8-eb830494e1ee'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:24.523465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] The token cache is being invalidate because project c3d6e73fbbe5461096b833912e3fc5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:24.525696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:24.528477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:24.541795 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3880/7802] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:23 2022] DELETE /identity/v3/projects/c3d6e73fbbe5461096b833912e3fc5d6 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:24.549998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:24.551559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:24.554131 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3923/7803] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:24.672141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75770932-4b0e-45fd-b1f8-eb830494e1ee admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:24.681475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:24.685206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:24.686404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:24.686775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] PATH_INFO: `/v3/users/7bcad614ae9746068ed9bf505474d917` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:24.689887 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcad614ae9746068ed9bf505474d917)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:24.693880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:24.913798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:24.916108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:25.025104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcad614ae9746068ed9bf505474d917'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:25.069406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d8fe7-e60c-4c47-8dfb-4638f404ef33 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:25.074588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:25.075520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:25.075798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:25.076071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:25.078942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:25.106570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:25.108770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:25.117408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcad614ae9746068ed9bf505474d917'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:25.150373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3924/7804] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:25.151343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcad614ae9746068ed9bf505474d917'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:25.152365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcad614ae9746068ed9bf505474d917'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:25.153257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcad614ae9746068ed9bf505474d917'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:25.173672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3881/7805] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:24 2022] DELETE /identity/v3/users/7bcad614ae9746068ed9bf505474d917 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:25.460148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:26.654093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:26.745598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:26.786227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345e182-c94c-4666-9184-3aae9c589cd3 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:26.930933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:26.932334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:26.933641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:26.934022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] PATH_INFO: `/v3/projects/d9ea7dfc11c4464693a46b3f68e871d1` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:26.936781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ea7dfc11c4464693a46b3f68e871d1)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:26.942318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:28.051330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:28.052428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:28.108804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ea7dfc11c4464693a46b3f68e871d1', 'request_id': 'req-74ba3792-83e7-4efe-b3ba-f70735ec7569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:28.134332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ea7dfc11c4464693a46b3f68e871d1', 'request_id': 'req-74ba3792-83e7-4efe-b3ba-f70735ec7569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:28.157893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ea7dfc11c4464693a46b3f68e871d1', 'request_id': 'req-74ba3792-83e7-4efe-b3ba-f70735ec7569'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:28.257355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52f391-473a-4f3b-8b46-6ed1ec7640a6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:28.390479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] The token cache is being invalidate because project d9ea7dfc11c4464693a46b3f68e871d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:28.392539 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:28.398622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:28.410613 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3925/7806] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:26 2022] DELETE /identity/v3/projects/d9ea7dfc11c4464693a46b3f68e871d1 => generated 0 bytes in 1666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:28.416289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:28.421419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:28.495957 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:28.497329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:28.499992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:28.501203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:28.507950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:28.711774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba3792-83e7-4efe-b3ba-f70735ec7569 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:28.765830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:28.773849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:28.777655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:28.778810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] PATH_INFO: `/v3/users/246ef2e50b6749839ac9f577acbeb14b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:28.784756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] RBAC: Authorizing `identity:delete_user(user_id=246ef2e50b6749839ac9f577acbeb14b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:28.789746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:28.876518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:28.879587 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2db96-529b-4d1a-b42b-1fcf21216e90 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:28.904768 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3882/7807] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:29.150579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246ef2e50b6749839ac9f577acbeb14b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:29.233441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246ef2e50b6749839ac9f577acbeb14b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:29.259383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246ef2e50b6749839ac9f577acbeb14b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:29.271182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246ef2e50b6749839ac9f577acbeb14b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:29.272279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-65b8740b-bb37-4810-aa0d-97a0d9d6459f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246ef2e50b6749839ac9f577acbeb14b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:29.284845 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3926/7808] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:28 2022] DELETE /identity/v3/users/246ef2e50b6749839ac9f577acbeb14b => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:29.568429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:29.761895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:29.763039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:29.763525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:29.836324 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] MFA Rules not processed for user `cfc554a51c084c45805c44333f345b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:29.840416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:29.890426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90f57e-f2ad-4194-b449-4e9212e507ad None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:29.891476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90f57e-f2ad-4194-b449-4e9212e507ad None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:29.891476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90f57e-f2ad-4194-b449-4e9212e507ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:29.955696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-dd90f57e-f2ad-4194-b449-4e9212e507ad None None] MFA Rules not processed for user `0373f7b34b984b07b8ab3f3965a7ea6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:29.961855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-dd90f57e-f2ad-4194-b449-4e9212e507ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:30.024089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3883/7809] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:30.033021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:30.034610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:30.175759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3927/7810] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:30.334516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52559493-ca2e-4bdc-b23c-ccdfc6783b40 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:30.348241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:30.349391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:30.351760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:30.352075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] PATH_INFO: `/v3/users/ef03c9c416d74059b2d0b55623aa9117` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:30.357348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef03c9c416d74059b2d0b55623aa9117)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:30.361293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:30.687582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:30.706543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef03c9c416d74059b2d0b55623aa9117'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:30.837467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef03c9c416d74059b2d0b55623aa9117'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:30.886180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef03c9c416d74059b2d0b55623aa9117'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:30.891181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef03c9c416d74059b2d0b55623aa9117'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:30.893267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef03c9c416d74059b2d0b55623aa9117'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:30.947153 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3884/7811] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:30 2022] DELETE /identity/v3/users/ef03c9c416d74059b2d0b55623aa9117 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:30.953410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:30.954260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:30.956263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:31.014756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:31.016426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:31.226624 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3928/7812] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:31.261220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:31.263695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:31.341046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:31.343333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:31.396548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:31.409731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02bb34-0aff-4fbc-8a1e-b9a32d2801e1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:31.425354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:31.427612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:31.428023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:31.428674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] PATH_INFO: `/v3/projects/af3e7b6e13954dbf98e3c5698abceca3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:31.452112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3e7b6e13954dbf98e3c5698abceca3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:31.455734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:31.483119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9ce295-8625-4727-a803-08f7829cf8e5 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:31.496135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:31.497110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:31.497408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:31.497684 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:31.524598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:31.531039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb75ff1-f374-4dc3-a98d-a63edf084a07 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:31.613010 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3885/7813] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:31.802843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3e7b6e13954dbf98e3c5698abceca3', 'request_id': 'req-4f26bb82-f95b-4181-a1d9-b133677eb8a4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:31.841156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3e7b6e13954dbf98e3c5698abceca3', 'request_id': 'req-4f26bb82-f95b-4181-a1d9-b133677eb8a4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:31.866636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3e7b6e13954dbf98e3c5698abceca3', 'request_id': 'req-4f26bb82-f95b-4181-a1d9-b133677eb8a4'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:31.935573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] The token cache is being invalidate because project af3e7b6e13954dbf98e3c5698abceca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:31.937759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:31.937759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-4f26bb82-f95b-4181-a1d9-b133677eb8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:31.943774 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3929/7814] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:31 2022] DELETE /identity/v3/projects/af3e7b6e13954dbf98e3c5698abceca3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:31.946764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:31.947220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:31.947313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.006669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:32.007402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:32.127264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:32.127805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:32.128234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:01:32.135314 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:32.136323 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:01:32.141898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3930/7815] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:01:32 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:01:32.245603 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3886/7816] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:32.257933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:32.258696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:32.259132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.320139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:32.325789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:32.354505 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3931/7817] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:32.362601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:32.379343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e09c1-b2e0-4cba-a4f8-a239a75b620b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:32.390310 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:32.401992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:32.402642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:32.402921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:32.403189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.403851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:32.404328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:32.408930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:32.452621 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3887/7818] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:32.460526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:32.475895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e89146-730d-4843-be67-b76fe2b525fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:32.494206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:32.494837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:32.495115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:32.497974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.500431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:32.507156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:32.724468 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3932/7819] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:32 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:32.729080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:32.750817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05493d-a3be-4533-ab79-cc60aaa835a1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:32.978491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:32.979855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:32.980294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:32.980826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:32.981656 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:32.983819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:33.230032 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3888/7820] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:32 2022] POST /identity/v3/users => generated 293 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:33.236446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:33.259428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a05d-7eb0-4054-80e5-7f683f259f48 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:33.285224 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:33.286674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:33.287199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:33.287617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:33.288550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:33.290113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:33.336331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:33.342429 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3933/7821] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:33.355080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e802aa-b341-419d-97c0-6bfb82e04fef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:33.378209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:33.378837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:33.379106 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:33.379544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:33.380378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:33.382175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:33.429308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:33.439662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a938f3f-f8e9-4f33-af36-9e63266b215f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:33.445865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:33.446820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:33.447100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:33.447373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] PATH_INFO: `/v3/projects/3dcae3b40855433e85445ec44676d902/users/5ef30e797e144c4cae3254129d69add3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:33.451914 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3889/7822] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:33.512690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dcae3b40855433e85445ec44676d902, user_id=5ef30e797e144c4cae3254129d69add3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:33.523430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd943a0-0c52-4484-95ec-e5b22cc71fb9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:33.594093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:33.599461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:33.624782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a329f4-f6aa-4eec-9195-c10d45b36e7c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:33.637290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:33.638299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:33.638766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:33.639241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] PATH_INFO: `/v3/projects/2129b773afcd4f68961eaadb37241319` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:33.640853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2129b773afcd4f68961eaadb37241319)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:33.644530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:33.674200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:33.674520 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3934/7823] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:33 2022] PUT /identity/v3/projects/3dcae3b40855433e85445ec44676d902/users/5ef30e797e144c4cae3254129d69add3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:33.675085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:33.675377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:33.675654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:33.743116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] MFA Rules not processed for user `5ef30e797e144c4cae3254129d69add3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:33.745329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:33.835002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:33.857549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2129b773afcd4f68961eaadb37241319', 'request_id': 'req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:33.890245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2129b773afcd4f68961eaadb37241319', 'request_id': 'req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:33.904161 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3935/7824] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:33.909862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:34.002755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2129b773afcd4f68961eaadb37241319', 'request_id': 'req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.044745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] The token cache is being invalidate because project 2129b773afcd4f68961eaadb37241319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:34.045200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.046639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-73c9f395-9b58-4d4c-9c2f-a0adad9851c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.053629 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3890/7825] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:33 2022] DELETE /identity/v3/projects/2129b773afcd4f68961eaadb37241319 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:34.056062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:34.057320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:34.057683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:34.070151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad626a87-928a-4987-96c4-87cab5c0b916 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:34.133159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] MFA Rules not processed for user `f75d319e5f924947bffd03b1d55affd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:34.136830 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:34.265970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:34.269830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:34.273136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:34.273640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:34.277134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:34.283657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:34.320375 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3891/7826] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:34.323511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:34.334914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:34.366564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f801d16-dcd1-4518-b918-13fff6d2b3fb None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:34.380940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:34.381860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:34.382269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:34.382721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] PATH_INFO: `/v3/users/d17df1e5bcb943c9b1571f7d21f3757c` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:34.385183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d17df1e5bcb943c9b1571f7d21f3757c)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:34.389265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:34.463759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3936/7827] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:33 2022] POST /identity/v3/projects => generated 383 bytes in 555 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:34.465139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:34.471690 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:34.647835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd17df1e5bcb943c9b1571f7d21f3757c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.673658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d6a77-78aa-4c5e-b24c-c66e6f96dc0e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:34.691614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:34.692277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:34.692584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:34.692858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:34.727936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd17df1e5bcb943c9b1571f7d21f3757c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.773471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd17df1e5bcb943c9b1571f7d21f3757c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.780320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd17df1e5bcb943c9b1571f7d21f3757c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.781191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd17df1e5bcb943c9b1571f7d21f3757c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:34.808262 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3892/7828] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:34 2022] DELETE /identity/v3/users/d17df1e5bcb943c9b1571f7d21f3757c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:34.809335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:34.812276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:34.835046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:34.836736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91172ee-f31b-4a9d-baa1-57028a49b934 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:34.870257 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3937/7829] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:34.893177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:35.034254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.034553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.035492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.043289 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402284f-1cc9-48a5-b696-e00d40266151 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:35.059260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:35.060421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.061059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.062840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.066373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:35.071829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:35.074062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] MFA Rules not processed for user `a7bc921653a44d9fbf33f3d0fb197500`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:35.077909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:35.237770 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3938/7830] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:35.357078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3893/7831] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:34 2022] POST /identity/v3/users => generated 292 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:35.357912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:35.379195 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63029a03-d4f4-44c9-b540-bb87fbc7f645 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:35.395283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:35.396394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.396777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.397063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.397901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:35.400723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:35.577488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3939/7832] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:35.657534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:35.657534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bd66b-ea51-46d3-a780-4fb68e93477c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:35.657534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:35.657534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.659890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.659890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.659890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:35.659890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b13b7-f05f-44bd-8227-b2c266e70ff0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:35.659890 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3894/7833] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:35.661516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:35.661516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55994f09-6450-4f53-846a-2e6606b869ab admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:35.661516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:35.661516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.662113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.662113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] PATH_INFO: `/v3/projects/46a52fd99cc24083997167df7e4755f0/users/518979f70a184edbaa52e614a2294dde/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.675861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a52fd99cc24083997167df7e4755f0, user_id=518979f70a184edbaa52e614a2294dde, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:35.679276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:35.722404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:35.808078 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3940/7834] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:35 2022] PUT /identity/v3/projects/46a52fd99cc24083997167df7e4755f0/users/518979f70a184edbaa52e614a2294dde/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:35.819141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:35.822260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:35.824291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:35.920367 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] MFA Rules not processed for user `518979f70a184edbaa52e614a2294dde`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:35.922514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:36.046700 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3895/7835] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:36.050969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:36.160284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:36.162707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:36.246102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8295b0-7397-47e5-8392-5b6dcf0d3c94 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:36.286920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:36.297138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:36.302069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:36.303851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:36.303851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:36.307837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9497e90-1cdd-4af0-85af-63919e7671b2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:36.316318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:36.383270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94f884-b0a6-459f-b2b5-cc7189888411 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:36.398187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:36.399080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:36.399492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:36.399989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] PATH_INFO: `/v3/projects/bffd985386b944639d34bd4edcd9501d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:36.404063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffd985386b944639d34bd4edcd9501d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:36.406218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:36.464538 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3941/7836] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:36 2022] POST /identity/v3/projects => generated 385 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:36.468657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:36.468657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:36.468657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:01:36.500253 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:36.504121 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:01:36.515829 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3942/7837] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:01:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 26 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:01:36.515829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:36.643054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffd985386b944639d34bd4edcd9501d', 'request_id': 'req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:36.652515 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffd985386b944639d34bd4edcd9501d', 'request_id': 'req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:36.724070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09567fed-5f7b-4f18-8362-48ba27d889fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:36.733162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffd985386b944639d34bd4edcd9501d', 'request_id': 'req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:36.761233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] The token cache is being invalidate because project bffd985386b944639d34bd4edcd9501d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:36.761550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:36.764842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-a1d2ac6c-f1b6-451c-bd46-14c4b752c745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:36.771511 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3896/7838] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:36 2022] DELETE /identity/v3/projects/bffd985386b944639d34bd4edcd9501d => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:36.775603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa229-0546-406d-9450-f8f4af40153e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:36.775895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa229-0546-406d-9450-f8f4af40153e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:36.776272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0aa229-0546-406d-9450-f8f4af40153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:36.850413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ca0aa229-0546-406d-9450-f8f4af40153e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:36.860427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca0aa229-0546-406d-9450-f8f4af40153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:36.955576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:36.956731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:36.957440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:36.959944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:36.960752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:36.976848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.061464 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3897/7839] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:37.094588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.096797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.097740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.162185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:37.167157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:37.188604 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3898/7840] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:37.190174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.219886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb98b5-8bb0-416e-b5fd-8ea0505a538b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.252335 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3943/7841] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:36 2022] POST /identity/v3/users => generated 299 bytes in 761 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:37.254601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.261915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:37.269998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.269998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.269998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.269998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.271225 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:37.271708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.273700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.297774 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3899/7842] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:37.302738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.331051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c77e95-4abb-4885-a94b-dc756d2dbc37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.334542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19de49-45e2-4d8b-ae98-58bb96007690 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.345531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.346365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.346744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.347119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.348461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.349339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.350091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.350709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.351850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.353485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.355533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.358910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.368158 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3944/7843] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:37.374717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.396392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1251c-720a-42cb-ae88-a9c03413ecc2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.403215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.406062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.406062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.406062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] PATH_INFO: `/v3/projects/895b83762d9d4db8bb084c1476915930/users/2b485fcc519242e4b15230c8f9d79360/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.428907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] RBAC: Authorizing `identity:create_grant(project_id=895b83762d9d4db8bb084c1476915930, user_id=2b485fcc519242e4b15230c8f9d79360, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.434700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.500954 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3900/7844] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:37 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:37.506500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.586541 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3945/7845] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:37 2022] PUT /identity/v3/projects/895b83762d9d4db8bb084c1476915930/users/2b485fcc519242e4b15230c8f9d79360/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:37.591225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.707166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a25aa-62b4-4210-9621-3b594ee79620 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.799279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47205457-9bee-460a-a2ee-82872630952d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.827208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.828299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.828766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.829356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.830229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.836781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.866863 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3946/7846] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:01:37.871137 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:37.873682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:37.879267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.881680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.881680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.881680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.881954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.883920 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f96d0-839c-4d8c-9fb2-d54a8c3a4200 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.892085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ec35e-960a-4733-a339-417489455746 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:37.906600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:37.910481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:37.910481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:37.910481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] PATH_INFO: `/v3/projects/895b83762d9d4db8bb084c1476915930/users/2b485fcc519242e4b15230c8f9d79360/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:37.917683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=895b83762d9d4db8bb084c1476915930, user_id=2b485fcc519242e4b15230c8f9d79360, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:37.921220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:37.961993 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3947/7847] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:37 2022] PUT /identity/v3/projects/895b83762d9d4db8bb084c1476915930/users/2b485fcc519242e4b15230c8f9d79360/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:38.074406 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3901/7848] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:37 2022] POST /identity/v3/users => generated 293 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:38.079476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:38.103451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.104182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.104907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.162250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:38.194786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] MFA Rules not processed for user `2b485fcc519242e4b15230c8f9d79360`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:38.195697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:38.282894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b1919-c837-49de-8f13-d584e66bfad7 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:38.297542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:38.298622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.299118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.299645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.300764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:38.303995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:38.338360 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3948/7849] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:38.341407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:38.369953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d16d5-7a6c-4353-9f85-53a1c8136688 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:38.397734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:38.398623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.399009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.399387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.400988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:38.405307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:38.418825 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3902/7850] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:38.427591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:38.431614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:38.441045 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3949/7851] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:38.450633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:38.503048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c06131-f32e-42cd-aa3c-167b1a634a78 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:38.521490 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:38.522326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.522611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.522886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] PATH_INFO: `/v3/projects/b6f6f3c32bac45039e2128f807f63125/users/91526215ab9848e289b5c345354b26b0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.579367 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f6f3c32bac45039e2128f807f63125, user_id=91526215ab9848e289b5c345354b26b0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:38.592697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd037d42-0019-4019-af47-3ed8779fb2a4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:38.646396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f359f81-298c-447b-ba6d-26cb3eda3196 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:38.657343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:38.657986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.658269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.658543 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.665695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:38.677575 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3950/7852] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:38 2022] PUT /identity/v3/projects/b6f6f3c32bac45039e2128f807f63125/users/91526215ab9848e289b5c345354b26b0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:38.690069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:38.690358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:38.690634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:38.741835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:38.788680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] MFA Rules not processed for user `91526215ab9848e289b5c345354b26b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:38.789354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:38.820611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:38.893385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:38.901084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:38.946083 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3903/7853] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:39.010042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:39.022814 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3951/7854] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:39.027588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ac9ed-28a8-4d48-aaa6-03d742189118 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:39.167913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:39.168597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:39.168888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:39.169459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:39.170179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:39.175730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:39.217537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:39.346640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:39.353416 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3904/7855] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:39 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:39.376146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aefd3c-e327-496d-a560-ca86b54daad0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:39.481903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:39.558489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:39.559469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:39.559924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:39.560369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:39.561241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:39.563691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:39.701222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:39.708638 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3952/7856] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:39 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:39.727376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd71c6-b879-421a-ada1-f08a65a48c9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:39.744001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:39.744882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:39.746030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:39.746030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:39.746332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:39.747916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:39.776775 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3905/7857] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:39 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:01:39.783259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:39.811521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae5186-416c-4c3b-93ae-bdb4e4803697 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:39.830107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:39.830853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:39.831138 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:39.831408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] PATH_INFO: `/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec/users/25ba71e5066949608c97ea59ce6022b6/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:39.904267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8a8f8d51b54f5db5231f5f0cc31eec, user_id=25ba71e5066949608c97ea59ce6022b6, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:39.917667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:40.026379 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3953/7858] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:39 2022] PUT /identity/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec/users/25ba71e5066949608c97ea59ce6022b6/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:40.030311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:40.062567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478878b-cca2-456c-9188-c0f1f5d586da admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:40.373256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:40.373895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:40.374251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:40.374525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:40.375192 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:40.381922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f59bc4-5d26-4f91-9fa2-67c0bed05062 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:40.418979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:40.440606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:40.450309 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3906/7859] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:40.477167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4387f-ab2c-42bc-9eb4-eea3f8947ef0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:40.503088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:40.505507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:40.510999 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:40.515477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] PATH_INFO: `/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec/users/25ba71e5066949608c97ea59ce6022b6/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:40.552760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd8a8f8d51b54f5db5231f5f0cc31eec, user_id=25ba71e5066949608c97ea59ce6022b6, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:40.569099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:40.598824 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3954/7860] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:40 2022] PUT /identity/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec/users/25ba71e5066949608c97ea59ce6022b6/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:40.609980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:40.610308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:40.610560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:40.680258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] MFA Rules not processed for user `25ba71e5066949608c97ea59ce6022b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:40.685815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:40.693296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:40.888464 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3907/7861] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:40.905882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:41.155260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19afe2-8763-4fbc-a022-c3de14ef93b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:41.173771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:41.174784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:41.177693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:41.177693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:41.222714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:41.228213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfa72c-c80d-4085-a73e-d2476e4a2519 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:41.301911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3955/7862] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:41.601909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:42.026558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:42.064596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:42.169345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ad74b-a860-4937-81ca-24bdc7cb15f1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:42.182925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:42.183590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.183864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.184315 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] PATH_INFO: `/v3/users/91526215ab9848e289b5c345354b26b0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.185689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=91526215ab9848e289b5c345354b26b0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:42.187831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:42.564636 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91526215ab9848e289b5c345354b26b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:42.647383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91526215ab9848e289b5c345354b26b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:42.677312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91526215ab9848e289b5c345354b26b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:42.678403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91526215ab9848e289b5c345354b26b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:42.680710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91526215ab9848e289b5c345354b26b0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:42.715465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3908/7863] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:42 2022] DELETE /identity/v3/users/91526215ab9848e289b5c345354b26b0 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:42.716920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:42.717378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:42.717848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:42.775973 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:42.777593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:43.101552 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3956/7864] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:43.262464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:43.265513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:43.396514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:43.613141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4eeb-a3c2-4e42-b494-cb162ebba6ab admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:43.635492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:43.639186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:43.640146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:43.640437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:43.675707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:43.680808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:43.731241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3909/7865] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:43.859059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:44.070184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:44.619905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:44.621379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:44.816883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d327ad1-c4f7-4ada-87f2-19aeb978ab6f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:44.832198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:44.832967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:44.833241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:44.833504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:44.835652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:45.062694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:45.071549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:45.129068 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3957/7866] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:45.264207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:46.007661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:47.446447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:47.741161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:47.743883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:47.834007 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5d858-fb79-4d29-907d-a54b07e2e3fa service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:47.853259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:47.855355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:47.856976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:47.857628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] PATH_INFO: `/v3/projects/b6f6f3c32bac45039e2128f807f63125` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:47.859480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f6f3c32bac45039e2128f807f63125)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:47.873396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.191287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f6f3c32bac45039e2128f807f63125', 'request_id': 'req-4835ac63-62ac-4ea0-bd54-190fb8b4e207'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:48.208214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f6f3c32bac45039e2128f807f63125', 'request_id': 'req-4835ac63-62ac-4ea0-bd54-190fb8b4e207'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:48.296725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.327533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f6f3c32bac45039e2128f807f63125', 'request_id': 'req-4835ac63-62ac-4ea0-bd54-190fb8b4e207'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:48.354711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c61127-eb4f-4dcc-a072-17d1d0c8a0c4 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.362147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] The token cache is being invalidate because project b6f6f3c32bac45039e2128f807f63125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:48.362858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:48.366937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:48.372114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3910/7867] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:47 2022] DELETE /identity/v3/projects/b6f6f3c32bac45039e2128f807f63125 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:48.380908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:48.384343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:48.499303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.503253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.503920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.505145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.508020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:48.550329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:48.670748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.676572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:48.690780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835ac63-62ac-4ea0-bd54-190fb8b4e207 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:48.710396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:48.724231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:48.724231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:48.724231 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] PATH_INFO: `/v3/users/25ba71e5066949608c97ea59ce6022b6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:48.724698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3958/7868] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:48 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:01:48.724840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ba71e5066949608c97ea59ce6022b6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:48.724840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:49.079928 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ba71e5066949608c97ea59ce6022b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:49.274889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ba71e5066949608c97ea59ce6022b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:49.300065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ba71e5066949608c97ea59ce6022b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:49.303264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ba71e5066949608c97ea59ce6022b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:49.304857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1516a92e-e0e3-4de0-8b4a-3b1a5635a9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ba71e5066949608c97ea59ce6022b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:49.345650 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3911/7869] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:01:48 2022] DELETE /identity/v3/users/25ba71e5066949608c97ea59ce6022b6 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:49.852707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:50.555868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:50.843575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:50.859386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3c791-4708-4ee3-aab1-a97384cc1089 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:51.036459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:51.037051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:51.037542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:51.037998 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] PATH_INFO: `/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:51.042249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd8a8f8d51b54f5db5231f5f0cc31eec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:51.044529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:51.453584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd8a8f8d51b54f5db5231f5f0cc31eec', 'request_id': 'req-6f65aca3-8f44-4768-bbf7-3909a39fe428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:51.465139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd8a8f8d51b54f5db5231f5f0cc31eec', 'request_id': 'req-6f65aca3-8f44-4768-bbf7-3909a39fe428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:51.481617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd8a8f8d51b54f5db5231f5f0cc31eec', 'request_id': 'req-6f65aca3-8f44-4768-bbf7-3909a39fe428'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:51.631127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] The token cache is being invalidate because project cd8a8f8d51b54f5db5231f5f0cc31eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:01:51.631974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:51.634289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6f65aca3-8f44-4768-bbf7-3909a39fe428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:01:51.645236 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3959/7870] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:01:50 2022] DELETE /identity/v3/projects/cd8a8f8d51b54f5db5231f5f0cc31eec => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:01:51.652940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:51.653999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:51.654991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:51.691840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:51.697256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:51.947433 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:51.948369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:51.948877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:51.951275 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3912/7871] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:51.997001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:51.998486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:52.031048 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3960/7872] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:01:52.035967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.062857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ac77-447f-4f50-887b-122e1fe0d7b8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.079840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.081089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.082797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.083310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.086127 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:01:52.087645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:52.093436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:52.134803 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3913/7873] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:01:52.142275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.159659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177727c-b6eb-4c4a-94b4-8b6e8caf55c4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.177489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.178317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.178702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.179093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.179845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:52.185232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:52.388344 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3961/7874] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:01:52 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:01:52.392869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.407924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1eb2c-4ef3-4bef-9484-1865716d2045 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.671717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.673208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.673659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.674201 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.674998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:52.678751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:52.817426 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3914/7875] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:01:52 2022] POST /identity/v3/users => generated 287 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:01:52.819907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.845842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e388224-3d7e-48d7-8ac1-7b05d0107e31 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.862990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.864065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.864523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.864992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.865652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:52.867359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:52.878615 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3962/7876] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:52.888431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.905128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871dd9e-74b4-44e5-88ca-805f32e9d8dc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.922697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.923388 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.923893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.926002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:52.928777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:52.930609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f06db0-7da2-4384-89d1-46c01be3de91 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:52.946712 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3915/7877] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:01:52.947665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:52.965132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a04b31-f8d5-4cda-adc8-19f4bab1c4ad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:52.977953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:52.978665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:52.979067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:52.979371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] PATH_INFO: `/v3/projects/937290d5f0bd4196bda74c9aa579263c/users/c16db83915c14a298c3446472b25329d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:53.025555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] RBAC: Authorizing `identity:create_grant(project_id=937290d5f0bd4196bda74c9aa579263c, user_id=c16db83915c14a298c3446472b25329d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:53.028293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:53.293513 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3963/7878] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:01:52 2022] PUT /identity/v3/projects/937290d5f0bd4196bda74c9aa579263c/users/c16db83915c14a298c3446472b25329d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:01:53.306149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58dd3-b757-408e-a123-6af7d20c1b44 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:53.306606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58dd3-b757-408e-a123-6af7d20c1b44 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:53.306976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b58dd3-b757-408e-a123-6af7d20c1b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:53.421895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-66b58dd3-b757-408e-a123-6af7d20c1b44 None None] MFA Rules not processed for user `c16db83915c14a298c3446472b25329d`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:53.423168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-66b58dd3-b757-408e-a123-6af7d20c1b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:53.635444 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3916/7879] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:53.636465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:01:53.639086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:53.657438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:53.909061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefcdfd-d4d7-42c2-b29b-868c6f93124d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:01:53.935306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:01:53.945196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:53.946769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:53.947056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:53.998501 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:01:54.012028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586083-78e2-4d62-bdb8-4ab801ada6fe service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:01:54.064714 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3964/7880] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:01:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:01:54.367091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:55.549654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:55.780747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:55.781326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:55.781487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:55.889403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] MFA Rules not processed for user `bd516028846c4337ab3d9b3d8b18ac66`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:01:55.890655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:01:56.081735 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3917/7881] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:01:56.377818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:56.874740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:56.978523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:58.256580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:01:58.257215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:01:58.257215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:01:58.264326 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:01:58.265368 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:01:58.268109 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3965/7882] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:01:58 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:01:58.687271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:59.132428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:59.983714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:01.094560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:01.302123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:02.287115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:02.440514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:03.477849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:04.351681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:04.353976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:04.510640 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:04.565133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6417f-3d47-4e40-9b61-5507466eb9fc None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:04.581348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:04.582596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:04.582880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:04.583159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] PATH_INFO: `/v3/users/a7bc921653a44d9fbf33f3d0fb197500` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:04.585195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bc921653a44d9fbf33f3d0fb197500)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:04.587513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:04.625527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:04.885599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bc921653a44d9fbf33f3d0fb197500'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.018332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bc921653a44d9fbf33f3d0fb197500'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.079372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bc921653a44d9fbf33f3d0fb197500'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.083983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bc921653a44d9fbf33f3d0fb197500'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.085361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bc921653a44d9fbf33f3d0fb197500'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:05.133656 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3918/7883] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:04 2022] DELETE /identity/v3/users/a7bc921653a44d9fbf33f3d0fb197500 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:05.705824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:05.708069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:05.851981 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:05.891983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:05.958658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc3014-3561-47e5-a85f-b289ee526ba2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:05.977416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:05.977416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:05.977416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:05.977416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] PATH_INFO: `/v3/projects/2ebef82c406a4578acb8c58c8b070f2e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:05.984409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebef82c406a4578acb8c58c8b070f2e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:05.995228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:06.145547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:06.145547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:06.173493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d443005-0648-4b17-86fe-f98a02d16e19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:06.201814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:06.202486 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:06.208996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:06.208996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] PATH_INFO: `/v3/users/5ef30e797e144c4cae3254129d69add3` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:06.213058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef30e797e144c4cae3254129d69add3)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:06.215649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:06.257372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:06.275084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebef82c406a4578acb8c58c8b070f2e', 'request_id': 'req-02278e28-033c-446c-b6ca-7b0fddc66b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.312961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebef82c406a4578acb8c58c8b070f2e', 'request_id': 'req-02278e28-033c-446c-b6ca-7b0fddc66b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.323809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:06.324005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebef82c406a4578acb8c58c8b070f2e', 'request_id': 'req-02278e28-033c-446c-b6ca-7b0fddc66b8b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.441147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] The token cache is being invalidate because project 2ebef82c406a4578acb8c58c8b070f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:06.441512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.442630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.450354 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3966/7884] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:05 2022] DELETE /identity/v3/projects/2ebef82c406a4578acb8c58c8b070f2e => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:06.454841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:06.457714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:06.549221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef30e797e144c4cae3254129d69add3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.657755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef30e797e144c4cae3254129d69add3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.696393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef30e797e144c4cae3254129d69add3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.697642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef30e797e144c4cae3254129d69add3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.699167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c9082bb6-23a6-4a5c-91d4-440d5ee52b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef30e797e144c4cae3254129d69add3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:06.731337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278e28-033c-446c-b6ca-7b0fddc66b8b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:06.746019 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3919/7885] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:06 2022] DELETE /identity/v3/users/5ef30e797e144c4cae3254129d69add3 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:02:06.757353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:06.757353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:06.757353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:06.765909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:06.767420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:06.769710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:06.771078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] PATH_INFO: `/v3/users/f75d319e5f924947bffd03b1d55affd2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:06.773793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75d319e5f924947bffd03b1d55affd2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:06.776716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:06.853738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:06.857455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:07.039682 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3920/7886] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:07.047013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:07.048858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:07.179033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75d319e5f924947bffd03b1d55affd2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:07.192277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b973bd1-e566-48e6-8121-c58f45b2bb37 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:07.219346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:07.220009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:07.220297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:07.227069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:07.263107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:07.264660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:07.290298 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3921/7887] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:07.297717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75d319e5f924947bffd03b1d55affd2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:07.339292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75d319e5f924947bffd03b1d55affd2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:07.369891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75d319e5f924947bffd03b1d55affd2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:07.373265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75d319e5f924947bffd03b1d55affd2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:07.407363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3967/7888] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:06 2022] DELETE /identity/v3/users/f75d319e5f924947bffd03b1d55affd2 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:07.795055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:08.102548 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:08.105531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:08.113216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:08.145751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36e8b4-b1b9-4ccf-a328-4a639da76534 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:08.417246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:08.417951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:08.418229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:08.418501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] PATH_INFO: `/v3/projects/83bd5e13a5e54740918cf5924a14886b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:08.421662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bd5e13a5e54740918cf5924a14886b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:08.428033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:08.676236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bd5e13a5e54740918cf5924a14886b', 'request_id': 'req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:08.694006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bd5e13a5e54740918cf5924a14886b', 'request_id': 'req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:08.766773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bd5e13a5e54740918cf5924a14886b', 'request_id': 'req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:08.784054 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] The token cache is being invalidate because project 83bd5e13a5e54740918cf5924a14886b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:08.787820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:08.789950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:08.794361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3922/7889] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:08 2022] DELETE /identity/v3/projects/83bd5e13a5e54740918cf5924a14886b => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:08.864933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:09.087978 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:09.100452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:09.113608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:09.140355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc9334-fa09-4269-8af4-9662647de085 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:09.321802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:09.322748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:09.323181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:09.323606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] PATH_INFO: `/v3/projects/3dcae3b40855433e85445ec44676d902` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:09.325307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dcae3b40855433e85445ec44676d902)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:09.327876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:09.577247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dcae3b40855433e85445ec44676d902', 'request_id': 'req-438dca1d-170d-4c67-8e14-7e07aac57c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:09.591703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dcae3b40855433e85445ec44676d902', 'request_id': 'req-438dca1d-170d-4c67-8e14-7e07aac57c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:09.609181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dcae3b40855433e85445ec44676d902', 'request_id': 'req-438dca1d-170d-4c67-8e14-7e07aac57c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:09.711347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] The token cache is being invalidate because project 3dcae3b40855433e85445ec44676d902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:09.711647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:09.712349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:09.718091 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3968/7890] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:09 2022] DELETE /identity/v3/projects/3dcae3b40855433e85445ec44676d902 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:09.719728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:09.721260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:09.758033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf827d35-8de4-4972-bf8e-7c6ab49c9e9b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:09.931103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:09.931763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:09.932045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:09.932325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] PATH_INFO: `/v3/users/518979f70a184edbaa52e614a2294dde` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:09.938308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=518979f70a184edbaa52e614a2294dde)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:09.941774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:10.240331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:10.315833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '518979f70a184edbaa52e614a2294dde'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:10.405428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '518979f70a184edbaa52e614a2294dde'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:10.433977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '518979f70a184edbaa52e614a2294dde'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:10.438437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '518979f70a184edbaa52e614a2294dde'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:10.442969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '518979f70a184edbaa52e614a2294dde'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:10.547634 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3923/7891] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:09 2022] DELETE /identity/v3/users/518979f70a184edbaa52e614a2294dde => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:11.245930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:12.336854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:12.338941 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:12.379476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dca1d-170d-4c67-8e14-7e07aac57c1a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:12.481598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:12.614716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:12.615815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:12.616159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:12.616437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] PATH_INFO: `/v3/projects/46a52fd99cc24083997167df7e4755f0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:12.617924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a52fd99cc24083997167df7e4755f0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:12.620257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:12.764645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a52fd99cc24083997167df7e4755f0', 'request_id': 'req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:12.777113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a52fd99cc24083997167df7e4755f0', 'request_id': 'req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:12.788201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a52fd99cc24083997167df7e4755f0', 'request_id': 'req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:12.906931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] The token cache is being invalidate because project 46a52fd99cc24083997167df7e4755f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:12.907426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:12.909008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:12.932103 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3969/7892] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:12 2022] DELETE /identity/v3/projects/46a52fd99cc24083997167df7e4755f0 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:12.936278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:12.937809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:12.969217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070d686-5ea0-41d5-ac0e-ee4d5c298d37 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:13.111786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:13.113626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:13.114441 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:13.114719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] PATH_INFO: `/v3/users/2b485fcc519242e4b15230c8f9d79360` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:13.118461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b485fcc519242e4b15230c8f9d79360)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:13.123050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:13.125228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:13.486921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b485fcc519242e4b15230c8f9d79360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:14.074492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b485fcc519242e4b15230c8f9d79360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:14.147503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b485fcc519242e4b15230c8f9d79360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:14.152341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b485fcc519242e4b15230c8f9d79360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:14.156910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c5f2250a-14eb-45e3-b412-92ef29c18270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b485fcc519242e4b15230c8f9d79360'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:14.219731 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3924/7893] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:12 2022] DELETE /identity/v3/users/2b485fcc519242e4b15230c8f9d79360 => generated 0 bytes in 1281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:14.899269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:14.942588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:15.480864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:15.482631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:15.504928 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cd4a1-bf1f-412c-b944-dfae2a8bc231 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:15.684139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:15.684905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:15.685190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:15.685468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] PATH_INFO: `/v3/projects/895b83762d9d4db8bb084c1476915930` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:15.687955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=895b83762d9d4db8bb084c1476915930)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:15.692231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:15.961661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '895b83762d9d4db8bb084c1476915930', 'request_id': 'req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:15.978181 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '895b83762d9d4db8bb084c1476915930', 'request_id': 'req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:15.999200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '895b83762d9d4db8bb084c1476915930', 'request_id': 'req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:16.189897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] The token cache is being invalidate because project 895b83762d9d4db8bb084c1476915930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:16.190712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:16.191513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-8fc9da9d-509b-4c1a-ade3-cc0a3a30a1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:16.194311 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3970/7894] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:15 2022] DELETE /identity/v3/projects/895b83762d9d4db8bb084c1476915930 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:16.199653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:16.200176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:16.200272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:16.240774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:16.272135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:16.427949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:16.427949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:16.427949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:16.430753 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3925/7895] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:16.452688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:16.454394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:16.470156 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3971/7896] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:16.472528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:16.485678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b6a54-6902-4bcf-bfa0-ca7fcc3f2cc7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:16.501910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:16.503059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:16.503506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:16.503943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:16.504788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:16.505271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:16.507182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:16.553036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:16.559497 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3926/7897] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:02:16.563289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea638c11-f093-4c53-9f45-1df52defa95b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:16.577670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:16.580196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:16.582341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:16.583977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:16.584985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:16.586191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:16.590062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:16.593830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:16.635372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:16.688969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa1dfc-6a01-4624-8db7-c3e6d606d988 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:16.694293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:16.695081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:16.695372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:16.695701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:16.697991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:16.729639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:16.783480 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3972/7898] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:16 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:16.785934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:16.797434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:16.800731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:16.818251 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3927/7899] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:02:17.009701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dcf27-028c-4722-b97e-35bfd8fac785 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:17.024082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:17.026929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:17.027582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:17.029273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:17.030333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:17.037886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:17.247638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:17.248167 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3973/7900] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:16 2022] POST /identity/v3/users => generated 294 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:17.267228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c443ce-d620-4898-bebe-8017a0dcdd1f service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:17.286827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:17.288032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:17.289194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:17.289844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:17.290777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:17.298619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:17.373858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:17.375123 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3928/7901] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:17.435997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb1292-f704-445c-8112-bdab532cfaae admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:17.466393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:17.467211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:17.474411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:17.474750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:17.475713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:17.486294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061baa1-2e12-4667-ae3e-d56f19727022 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:17.527853 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3974/7902] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:17.532475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:17.574937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e34bd-13c5-44b7-84dd-b2b75df9b9dc admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:17.592185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:17.593626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:17.593921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:17.594200 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] PATH_INFO: `/v3/projects/4eee0255399e4f49bd72766a52252549/users/0f8aa47bc64d4653bea64278f52af3ae/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:17.633139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eee0255399e4f49bd72766a52252549, user_id=0f8aa47bc64d4653bea64278f52af3ae, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:17.636306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:17.770994 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3929/7903] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:17 2022] PUT /identity/v3/projects/4eee0255399e4f49bd72766a52252549/users/0f8aa47bc64d4653bea64278f52af3ae/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:17.785411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:17.786540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:17.791186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:17.853892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] MFA Rules not processed for user `0f8aa47bc64d4653bea64278f52af3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:17.855952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:18.026833 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3975/7904] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:18.030568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:18.233617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651254fc-c887-43ae-868a-c076c78d71b8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:18.268251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:18.269406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:18.269696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:18.269976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:18.270701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:18.275561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:18.497322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:18.511977 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3930/7905] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:18 2022] POST /identity/v3/projects => generated 387 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:18.517783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:18.536641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb937ae-c909-4812-8996-d9b3695fc67f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:18.726397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:18.729579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:18.729579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:18.729579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:18.729579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:18.730311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:18.753839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:18.916245 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3976/7906] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:18 2022] POST /identity/v3/users => generated 301 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:02:18.967731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:19.005060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0006e4-52e7-412d-bfb1-60b88b4e3b0d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:19.025692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:19.026496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:19.026984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:19.027358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:19.028116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:19.030573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb243b8c-518c-4179-ba27-edbd0183986b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:19.068472 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3931/7907] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:19.072814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:19.086741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2ace4-5554-4170-aa72-7c57640d8aa8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:19.109210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:19.109919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:19.110206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:19.110482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] PATH_INFO: `/v3/projects/cc01e60185e94050872de5569de16127/users/85d3936e63a54a2ba9be4c9a7708b515/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:19.137074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc01e60185e94050872de5569de16127, user_id=85d3936e63a54a2ba9be4c9a7708b515, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:19.140027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:19.749704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3977/7908] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:19 2022] PUT /identity/v3/projects/cc01e60185e94050872de5569de16127/users/85d3936e63a54a2ba9be4c9a7708b515/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:19.761445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:19.761948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:19.762068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:19.841983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] MFA Rules not processed for user `85d3936e63a54a2ba9be4c9a7708b515`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:19.845913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:19.965616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:19.967817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:20.186985 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3932/7909] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:19 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:20.244801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2a7df-0494-4b5d-953f-374c478974f5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:20.255447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:20.260260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:20.260887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:20.264817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:20.265104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:20.273616 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:20.295662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab73f-9c8a-4af6-977d-e0c68626dd4d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:20.312283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:20.313135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:20.314567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:20.315794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:20.353746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:20.355769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:20.379232 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3933/7910] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:02:20.433986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:20.435968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71531-32aa-45b9-ab97-730698066064 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:20.479616 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3978/7911] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:02:20.634025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:21.776979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:22.125282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:23.384645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:23.463556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:24.463076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:24.969518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:25.049731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:25.120291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:25.232987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9d2ba-5ce2-4dac-a597-931f81d9ed49 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:25.257181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:25.258392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.258392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.263613 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] PATH_INFO: `/v3/users/0f8aa47bc64d4653bea64278f52af3ae` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.265538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8aa47bc64d4653bea64278f52af3ae)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:25.273778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:25.603569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8aa47bc64d4653bea64278f52af3ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:25.714068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8aa47bc64d4653bea64278f52af3ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:25.754446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8aa47bc64d4653bea64278f52af3ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:25.759798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8aa47bc64d4653bea64278f52af3ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:25.759798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8aa47bc64d4653bea64278f52af3ae'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:25.782091 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3934/7912] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:25 2022] DELETE /identity/v3/users/0f8aa47bc64d4653bea64278f52af3ae => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:25.784319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:25.784829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:25.789583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:25.818778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:25.833174 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:25.834464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:26.028112 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3979/7913] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:26.053536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:26.055118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:26.198913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edd00c-4919-496a-a66e-5e33def2256f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:26.209582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:26.212003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:26.212306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:26.216408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:26.240162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:26.245228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:26.283238 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3935/7914] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:26.287080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:26.308329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:27.107923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:27.348873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:27.673948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:27.902801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:28.226285 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:28.229572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:28.284384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bada0b-d548-4727-9db1-eeea23889cdf None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:28.328217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:28.332590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:28.332894 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:28.338802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] PATH_INFO: `/v3/projects/4eee0255399e4f49bd72766a52252549` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:28.347964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eee0255399e4f49bd72766a52252549)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:28.355694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:28.686866 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eee0255399e4f49bd72766a52252549', 'request_id': 'req-5dd07015-68a6-4348-9971-5c2dc4ee9c64'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.715307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eee0255399e4f49bd72766a52252549', 'request_id': 'req-5dd07015-68a6-4348-9971-5c2dc4ee9c64'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.743409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eee0255399e4f49bd72766a52252549', 'request_id': 'req-5dd07015-68a6-4348-9971-5c2dc4ee9c64'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.927750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] The token cache is being invalidate because project 4eee0255399e4f49bd72766a52252549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:28.928164 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.929451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:28.935557 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3980/7915] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:28 2022] DELETE /identity/v3/projects/4eee0255399e4f49bd72766a52252549 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:28.937739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:28.976884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4cf0f-3116-41b7-9df5-94e918ba2902 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:29.115202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:29.116409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:29.116409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:29.117226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] PATH_INFO: `/v3/users/85d3936e63a54a2ba9be4c9a7708b515` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:29.127991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d3936e63a54a2ba9be4c9a7708b515)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:29.152984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:29.479494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:29.638594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d3936e63a54a2ba9be4c9a7708b515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.776001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d3936e63a54a2ba9be4c9a7708b515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.818217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d3936e63a54a2ba9be4c9a7708b515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.819062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d3936e63a54a2ba9be4c9a7708b515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.819759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-46a86477-0dda-4d36-82e0-2c3beef0be56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d3936e63a54a2ba9be4c9a7708b515'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:29.849463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3936/7916] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:28 2022] DELETE /identity/v3/users/85d3936e63a54a2ba9be4c9a7708b515 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:30.505550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:30.999247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:31.000290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:31.047669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd07015-68a6-4348-9971-5c2dc4ee9c64 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:31.223801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:31.225958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:31.226242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:31.227697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] PATH_INFO: `/v3/projects/cc01e60185e94050872de5569de16127` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:31.232139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc01e60185e94050872de5569de16127)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:31.235157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:31.580787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc01e60185e94050872de5569de16127', 'request_id': 'req-762582fc-dd1e-4fd6-b63d-3ffc9e351126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:31.607331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc01e60185e94050872de5569de16127', 'request_id': 'req-762582fc-dd1e-4fd6-b63d-3ffc9e351126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:31.650819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc01e60185e94050872de5569de16127', 'request_id': 'req-762582fc-dd1e-4fd6-b63d-3ffc9e351126'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:31.800823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] The token cache is being invalidate because project cc01e60185e94050872de5569de16127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:31.801218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:31.810307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-762582fc-dd1e-4fd6-b63d-3ffc9e351126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:31.810307 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3981/7917] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:30 2022] DELETE /identity/v3/projects/cc01e60185e94050872de5569de16127 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:31.813553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:31.813553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:31.813553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:31.874006 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:31.879775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:32.135747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3937/7918] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:32.143905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:32.144456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:32.144931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:32.193704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:32.196402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:32.233290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:32.244073 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3982/7919] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:32.247047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce88517-9efa-4e16-a71c-41c7c9acbd32 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:32.263898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:32.265143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:32.265143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:32.265143 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:32.265709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:32.271546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:32.277603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:32.352781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:32.353869 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3938/7920] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:02:32.368339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17904ee2-1e7e-421c-b0c3-d7cfd8f69847 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:32.384000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:32.385187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:32.385702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:32.386217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:32.387131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:32.390125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:32.647767 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3983/7921] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:32 2022] POST /identity/v3/projects => generated 371 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:32.652633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:32.664343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a783-d732-44fe-860e-44ae172ebebe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:32.905056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:32.908634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:32.909860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:32.910382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:32.911997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:32.919622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:33.334705 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3939/7922] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:32 2022] POST /identity/v3/users => generated 286 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:33.347171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:33.374834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78f4e-43fc-4988-ba0d-5784fb6d5ae5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:33.390215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:33.391156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:33.391663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:33.392176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:33.393314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:33.395173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:33.436171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:33.446026 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3984/7923] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:33.464539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbbd77-d5a9-4adf-a07b-e9dd040fdaaa admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:33.482262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:33.482897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:33.483177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:33.483451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:33.488217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:33.489917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61b6a3-7549-4a0a-8412-56bbdd48b325 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:33.554467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:33.564948 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3940/7924] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:33.575290 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:33.599120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c3c5-fbbf-4a1f-803b-418e7a5742d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:33.615610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:33.616303 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:33.639672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:33.639672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] PATH_INFO: `/v3/projects/1ac4313709954b2e9e651cb26814df74/users/a1be68d931534659a269ae57717e47d2/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:33.670263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac4313709954b2e9e651cb26814df74, user_id=a1be68d931534659a269ae57717e47d2, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:33.673151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:33.880061 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3985/7925] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:33 2022] PUT /identity/v3/projects/1ac4313709954b2e9e651cb26814df74/users/a1be68d931534659a269ae57717e47d2/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:33.882382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046060-52c3-44fa-bba1-ccf63c70376d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:33.882855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046060-52c3-44fa-bba1-ccf63c70376d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:33.896028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c046060-52c3-44fa-bba1-ccf63c70376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:33.946295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2c046060-52c3-44fa-bba1-ccf63c70376d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:33.967414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2c046060-52c3-44fa-bba1-ccf63c70376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:34.266851 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3941/7926] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:34.321603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:34.323459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:34.614823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:34.676070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81748f-e9b9-43f2-84af-7dfb36b43e5e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:34.696702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:34.701260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:34.701260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:34.701260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:34.748258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:34.757216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:34.804421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3986/7927] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:35.593541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.312840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e2c1-7dce-4b49-a5bf-52bc24944852 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:36.313293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e2c1-7dce-4b49-a5bf-52bc24944852 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:36.313820 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72e2c1-7dce-4b49-a5bf-52bc24944852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:36.404337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1b72e2c1-7dce-4b49-a5bf-52bc24944852 None None] MFA Rules not processed for user `bd516028846c4337ab3d9b3d8b18ac66`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:36.405851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1b72e2c1-7dce-4b49-a5bf-52bc24944852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:36.421789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:36.425185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:36.449712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae912-eaf0-4575-9855-21cf90a2553b service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:36.508453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:36.509361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:36.509758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:36.525115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] PATH_INFO: `/v3/users/88ccaba4c6704a60a4a3eacc1231e34c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:36.537696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ccaba4c6704a60a4a3eacc1231e34c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:36.556794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:36.590108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.700218 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3942/7928] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:36.983523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ccaba4c6704a60a4a3eacc1231e34c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:37.113811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:37.221854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ccaba4c6704a60a4a3eacc1231e34c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:37.270307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ccaba4c6704a60a4a3eacc1231e34c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:37.286259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ccaba4c6704a60a4a3eacc1231e34c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:37.287025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ccaba4c6704a60a4a3eacc1231e34c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:37.322624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5917-8316-4a06-aaf2-4d9de4d2dc0b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:37.323152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5917-8316-4a06-aaf2-4d9de4d2dc0b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:37.323591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c5917-8316-4a06-aaf2-4d9de4d2dc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:37.326535 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3987/7929] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:36 2022] DELETE /identity/v3/users/88ccaba4c6704a60a4a3eacc1231e34c => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:37.369387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ea0c5917-8316-4a06-aaf2-4d9de4d2dc0b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:37.371741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ea0c5917-8316-4a06-aaf2-4d9de4d2dc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:37.578410 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3943/7930] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:37.713210 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:37.717651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:37.763295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:37.763880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:37.763880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:02:37.771552 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:02:37.772547 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:02:37.778563 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3944/7931] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:02:37 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 13:02:37.865697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444126e-cb1e-4090-8581-55e07926d9c8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:37.882275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:37.882925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:37.883202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:37.883476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:37.926329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:37.928263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830a2cd6-bb38-498a-b200-4515a46ca3ee service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:37.949806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3988/7932] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:38.363308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:38.366132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:38.404345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f48c0a-353d-429d-b38e-d8ddb6f578c4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:38.436756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:38.436756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:38.436756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:38.436756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] PATH_INFO: `/v3/projects/687a0c3a36ab4f619c4f80743fcdd9fc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:38.447273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] RBAC: Authorizing `identity:delete_project(project_id=687a0c3a36ab4f619c4f80743fcdd9fc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:38.449519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:38.722546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687a0c3a36ab4f619c4f80743fcdd9fc', 'request_id': 'req-e08420ee-3df6-47b6-88b7-cc9caf50333a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:38.736950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687a0c3a36ab4f619c4f80743fcdd9fc', 'request_id': 'req-e08420ee-3df6-47b6-88b7-cc9caf50333a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:38.947470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687a0c3a36ab4f619c4f80743fcdd9fc', 'request_id': 'req-e08420ee-3df6-47b6-88b7-cc9caf50333a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:38.967130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] The token cache is being invalidate because project 687a0c3a36ab4f619c4f80743fcdd9fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:38.967415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:38.968241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e08420ee-3df6-47b6-88b7-cc9caf50333a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:38.971963 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3945/7933] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:38 2022] DELETE /identity/v3/projects/687a0c3a36ab4f619c4f80743fcdd9fc => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:38.977324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:38.978049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:38.978049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:39.016202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:39.018021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:39.178609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:39.179260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:39.179407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3989/7934] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:39.179918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:39.222276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:39.224364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:39.235350 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3946/7935] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:02:39.240833 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:39.256075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4abb7-dfc7-48eb-ae32-b9bb384bb35c None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:39.268294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:39.269511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:39.270062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:39.270891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:39.272355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:02:39.273705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:39.276401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:39.304891 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3990/7936] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:02:39.305113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:39.317535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fc567-6657-4f99-b5a1-42eac8435a4e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:39.324592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:39.325364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:39.325719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:39.326065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:39.326933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:39.329152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:39.515313 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3947/7937] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:39 2022] POST /identity/v3/projects => generated 391 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:02:39.521141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:39.564370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9ccf-d910-4134-8099-a27dda1f81ad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:39.645269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:39.734565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:39.735612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:39.736707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:39.737196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:39.738102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:39.740413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:39.973680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:39.981321 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3991/7938] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:39 2022] POST /identity/v3/users => generated 296 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:02:39.987270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390781ae-3623-4eff-8f12-4bbf6b2d80e9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:40.002085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:40.003258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.003703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.004137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.005094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:40.007151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:40.053955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:40.054626 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3948/7939] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:40.066455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870500d-272b-4bab-9035-7629508f3eba admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:40.074231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:40.075217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.075687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.076198 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.077144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:40.080341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4a021-f4eb-4c04-9b8f-9dbc28e9f6df admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:40.100605 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3992/7940] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:02:40.132056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:40.149943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fab65-88cc-4970-bd32-401ed49842ce admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:40.170366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:40.174967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.175606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.176115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] PATH_INFO: `/v3/projects/6f4abd840fe748a08ba2e6ad90771bd4/users/c772d3bf82ce407c9f8490d1a3a31845/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.215589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4abd840fe748a08ba2e6ad90771bd4, user_id=c772d3bf82ce407c9f8490d1a3a31845, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:40.218719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:40.228093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:40.402433 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3949/7941] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:40 2022] PUT /identity/v3/projects/6f4abd840fe748a08ba2e6ad90771bd4/users/c772d3bf82ce407c9f8490d1a3a31845/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:40.415426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:40.416017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:40.416625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:40.523579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] MFA Rules not processed for user `c772d3bf82ce407c9f8490d1a3a31845`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:40.524937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:40.717403 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3993/7942] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:40.732017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:40.734781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:40.987165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf35dc5-0b2b-4c2e-9a92-d15a00d3197b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:41.003971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:41.005418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:41.005945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:41.006909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:41.037995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:41.040138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:41.077296 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3950/7943] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:02:42.022227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:42.325753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:43.701742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:44.061143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:44.063196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:44.278503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53db801-15c5-40ae-875b-68b6f69abc41 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:44.284882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:44.285748 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:44.286570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:44.286951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:44.289674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:44.314269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:44.316201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8523127-cb87-489b-976c-534475fafd2b service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:44.344505 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3994/7944] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:02:44.730686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:47.919457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:49.227979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:49.230312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:49.372774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4599-dcc6-4c13-8144-60ca43499db8 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:49.386036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:49.386703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:49.386987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:49.387261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] PATH_INFO: `/v3/users/bd516028846c4337ab3d9b3d8b18ac66` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:49.388574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd516028846c4337ab3d9b3d8b18ac66)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:49.390716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:50.017696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd516028846c4337ab3d9b3d8b18ac66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:50.223411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd516028846c4337ab3d9b3d8b18ac66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:50.374592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd516028846c4337ab3d9b3d8b18ac66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:50.382004 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd516028846c4337ab3d9b3d8b18ac66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:50.387885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b9ccb8c9-a902-45a9-bc24-697b47971789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd516028846c4337ab3d9b3d8b18ac66'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:50.431148 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3951/7945] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:49 2022] DELETE /identity/v3/users/bd516028846c4337ab3d9b3d8b18ac66 => generated 0 bytes in 1204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:50.435584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:50.436719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:50.444853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:50.505927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:50.540105 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:50.621899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:50.764073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:50.764514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:50.764917 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:50.779126 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3995/7946] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:02:50.791109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:50.793854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:50.822470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] MFA Rules not processed for user `a1be68d931534659a269ae57717e47d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:02:50.826132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:50.997835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adeb81-7d76-4eb4-b8a9-c7e0879f72f3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:51.005503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:51.006453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:51.007176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:51.008275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:51.027697 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3952/7947] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:02:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:02:51.032337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:51.033296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:51.034997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:51.037744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:51.071285 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3996/7948] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:02:51.078431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954e7e1-c6e4-430e-831e-a79ba4c7b647 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:51.093556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:51.094779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:51.095129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:51.095706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:51.097395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:51.101444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:51.422715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3953/7949] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:02:51 2022] POST /identity/v3/projects => generated 373 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:02:51.427731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:51.447289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54223719-3c58-4b12-91b4-acf58132365e service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:51.733740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:51.734795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:51.735255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:51.738111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:51.738111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:51.831160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:51.880162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:51.888551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:51.956238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af757d2d-608d-4d34-98a8-4731f264f444 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:51.984416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:51.985419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:51.986343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:51.986843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] PATH_INFO: `/v3/projects/859fa6a598e940adb04b27af754ebff8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:51.997863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859fa6a598e940adb04b27af754ebff8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:52.004815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:52.088871 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3997/7950] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:02:51 2022] POST /identity/v3/users => generated 293 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:02:52.092399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:52.135228 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215aab5-417f-4864-ab1f-e5f5dc30ee52 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:52.150150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:52.151769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:52.165016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:52.168364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:52.175095 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:52.178346 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:52.223374 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3998/7951] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:52.224672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:52.270150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859fa6a598e940adb04b27af754ebff8', 'request_id': 'req-40b85753-1be8-4806-86bf-9a5377ed1f41'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.281529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491a5f-44f7-41cc-b19d-8d1e21ca6805 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:52.283905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859fa6a598e940adb04b27af754ebff8', 'request_id': 'req-40b85753-1be8-4806-86bf-9a5377ed1f41'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.393470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859fa6a598e940adb04b27af754ebff8', 'request_id': 'req-40b85753-1be8-4806-86bf-9a5377ed1f41'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.454389 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] The token cache is being invalidate because project 859fa6a598e940adb04b27af754ebff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:52.461290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.464080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.469762 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3954/7952] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:51 2022] DELETE /identity/v3/projects/859fa6a598e940adb04b27af754ebff8 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:52.479608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:52.482121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:52.492679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:52.494398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:52.496512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:52.497019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] PATH_INFO: `/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f/users/ba5adb911f7545239cd9db71f78333c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:52.546875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85753-1be8-4806-86bf-9a5377ed1f41 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:52.568645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe3c3f159e14c2bb0cba6debd69ec1f, user_id=ba5adb911f7545239cd9db71f78333c2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:52.575898 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:52.585488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:52.585488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:52.585488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] PATH_INFO: `/v3/users/8124df4a3765449cba4194edd9131e95` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:52.585488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8124df4a3765449cba4194edd9131e95)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:52.593564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:52.597063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:52.676910 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 3999/7953] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:52 2022] PUT /identity/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f/users/ba5adb911f7545239cd9db71f78333c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:52.681407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:52.685593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:52.911803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea077f8f-ac12-48ef-9f82-b1ff4eb53b85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:52.919041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8124df4a3765449cba4194edd9131e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:52.927741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:52.933293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:52.933600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:52.934131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:52.935932 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:52.937812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:52.968350 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4000/7954] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:02:52.975512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:52.993209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:53.000783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ea1b9-4968-4d9f-ab83-1ab1c1a7eee5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:53.009725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8124df4a3765449cba4194edd9131e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:53.018906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:53.024332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:53.025132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:53.026319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] PATH_INFO: `/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f/users/ba5adb911f7545239cd9db71f78333c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:53.029943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe3c3f159e14c2bb0cba6debd69ec1f, user_id=ba5adb911f7545239cd9db71f78333c2, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:53.038673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:53.042809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8124df4a3765449cba4194edd9131e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:53.043875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8124df4a3765449cba4194edd9131e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:53.046581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8124df4a3765449cba4194edd9131e95'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:53.080525 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4001/7955] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:02:52 2022] PUT /identity/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f/users/ba5adb911f7545239cd9db71f78333c2/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:53.107592 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3955/7956] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:02:52 2022] DELETE /identity/v3/users/8124df4a3765449cba4194edd9131e95 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:53.368888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:54.387390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:54.764301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:02:54.773970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:02:55.051262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d2201-1167-4760-a2d8-3ca2fa7fcf46 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:02:55.303707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:02:55.304437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:02:55.304897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:02:55.305296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] PATH_INFO: `/v3/projects/f067e43049a74abf94534893be019e19` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:02:55.306676 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f067e43049a74abf94534893be019e19)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:02:55.309183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:02:55.339865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:55.509547 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f067e43049a74abf94534893be019e19', 'request_id': 'req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:55.554431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f067e43049a74abf94534893be019e19', 'request_id': 'req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:55.572733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f067e43049a74abf94534893be019e19', 'request_id': 'req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:55.681407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] The token cache is being invalidate because project f067e43049a74abf94534893be019e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:02:55.681407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:55.682475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:02:55.702230 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4002/7957] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:02:54 2022] DELETE /identity/v3/projects/f067e43049a74abf94534893be019e19 => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:02:55.841570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:56.912929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:57.359178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:57.695551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:58.638450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:59.055690 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:59.622114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:00.124159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:00.502230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:00.632925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:01.256243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:01.398859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:02.012816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:02.470337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:03.342760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:03.526964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:03.534406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:03.605933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb94f3-e925-454c-8c98-c5347670490a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:03.835395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:03.837128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:03.837503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:03.840791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] PATH_INFO: `/v3/users/c16db83915c14a298c3446472b25329d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:03.842838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16db83915c14a298c3446472b25329d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:03.845596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:03.989684 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:03.991620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.192512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9ecbd-dfff-4ac4-8b40-47904fd34c1a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:04.198523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:04.209103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.209103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.209103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.209624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16db83915c14a298c3446472b25329d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.209802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.237146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:04.237342 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:04.242343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:04.272297 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4003/7958] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:04.274902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:04.279526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.283946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16db83915c14a298c3446472b25329d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.312244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a632e2-97c9-4615-b8d2-b7ff6ecf3904 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:04.330205 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:04.330984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.331265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.331540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] PATH_INFO: `/v3/users/c772d3bf82ce407c9f8490d1a3a31845` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.332815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c772d3bf82ce407c9f8490d1a3a31845)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:04.334813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:04.369681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16db83915c14a298c3446472b25329d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.371583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16db83915c14a298c3446472b25329d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.373855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-19663f59-2e50-4150-9722-21e16c7f1bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16db83915c14a298c3446472b25329d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.420086 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3956/7959] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:03 2022] DELETE /identity/v3/users/c16db83915c14a298c3446472b25329d => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:04.424279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996c48-5943-4142-b394-d4a1f334557b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.426327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996c48-5943-4142-b394-d4a1f334557b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.426787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49996c48-5943-4142-b394-d4a1f334557b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.484257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-49996c48-5943-4142-b394-d4a1f334557b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:04.486807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49996c48-5943-4142-b394-d4a1f334557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.555815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c772d3bf82ce407c9f8490d1a3a31845'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.662877 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3957/7960] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:04.666629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c772d3bf82ce407c9f8490d1a3a31845'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.673469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996c48-5943-4142-b394-d4a1f334557b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:04.676466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-49996c48-5943-4142-b394-d4a1f334557b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.694263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c772d3bf82ce407c9f8490d1a3a31845'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.704542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c772d3bf82ce407c9f8490d1a3a31845'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.706400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-befd10ad-9c69-494d-991d-596fd7fba4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c772d3bf82ce407c9f8490d1a3a31845'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:04.720417 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4004/7961] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:04 2022] DELETE /identity/v3/users/c772d3bf82ce407c9f8490d1a3a31845 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:04.724661 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.724958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.725236 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.796750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:04.798049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:04.819236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49996c48-5943-4142-b394-d4a1f334557b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:04.946927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:04.994336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:04.994958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:04.995092 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4005/7962] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:04.995267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:04.995512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:04.998881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:05.007933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:05.012119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:05.028330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:05.029996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:05.033013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a57a-efb6-497c-90fe-61f0d2c66274 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:05.038971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:05.039624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:05.039906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:05.040278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:05.050827 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3958/7963] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:05.053819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:05.055591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:05.071701 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4006/7964] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:05.215476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:05.698334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:05.789219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:05.791564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:05.835642 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31e2fe-c5e7-45ae-9517-c463575fcbd1 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:05.850105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:05.851398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:05.851710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:05.855781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] PATH_INFO: `/v3/projects/6f4abd840fe748a08ba2e6ad90771bd4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:05.876417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4abd840fe748a08ba2e6ad90771bd4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:05.879237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:06.078161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4abd840fe748a08ba2e6ad90771bd4', 'request_id': 'req-9d001293-8775-46c8-81d5-8709301974b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.085424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4abd840fe748a08ba2e6ad90771bd4', 'request_id': 'req-9d001293-8775-46c8-81d5-8709301974b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.185115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:06.187271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:06.203711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4abd840fe748a08ba2e6ad90771bd4', 'request_id': 'req-9d001293-8775-46c8-81d5-8709301974b6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.229127 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cce0d7-deb7-45bf-a44e-6d3a23ab2176 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:06.237040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] The token cache is being invalidate because project 6f4abd840fe748a08ba2e6ad90771bd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:06.237648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.239323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9d001293-8775-46c8-81d5-8709301974b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.243424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3959/7965] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:05 2022] DELETE /identity/v3/projects/6f4abd840fe748a08ba2e6ad90771bd4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:06.253743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9b023-59ee-4f7d-9d6c-8f07310e34dc None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.254619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9b023-59ee-4f7d-9d6c-8f07310e34dc None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.256080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9b023-59ee-4f7d-9d6c-8f07310e34dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.306627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:06.322211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-1aa9b023-59ee-4f7d-9d6c-8f07310e34dc None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:06.323464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1aa9b023-59ee-4f7d-9d6c-8f07310e34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:06.445239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:06.446175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.446639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.447092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] PATH_INFO: `/v3/projects/937290d5f0bd4196bda74c9aa579263c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.457516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937290d5f0bd4196bda74c9aa579263c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:06.460987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:06.565951 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3960/7966] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:06.576399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.576399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.576399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.617353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:06.624084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:06.642337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937290d5f0bd4196bda74c9aa579263c', 'request_id': 'req-6cdcf075-0db4-4d6d-880f-47627041a0c5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.651352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937290d5f0bd4196bda74c9aa579263c', 'request_id': 'req-6cdcf075-0db4-4d6d-880f-47627041a0c5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.674997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937290d5f0bd4196bda74c9aa579263c', 'request_id': 'req-6cdcf075-0db4-4d6d-880f-47627041a0c5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.763753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] The token cache is being invalidate because project 937290d5f0bd4196bda74c9aa579263c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:06.764075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.767358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6cdcf075-0db4-4d6d-880f-47627041a0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:06.770543 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4007/7967] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:06 2022] DELETE /identity/v3/projects/937290d5f0bd4196bda74c9aa579263c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:06.777014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.777365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.777564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.808499 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3961/7968] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:06.810451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:06.819676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:06.825770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:06.827949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:06.828128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b62be-160d-40ee-88e6-9cc985c16489 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:06.837950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:06.838993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.839860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.840173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.841329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:03:06.841795 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:06.843597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ac10f-4b0a-4a92-b92e-7a24b57f58f5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:06.857511 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3962/7969] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:03:06.866687 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4008/7970] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:06.870260 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.877110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.877110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.881619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:06.905508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595a20-3417-4b8e-a267-7af8de011012 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:06.913211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:06.914206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:06.943263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:06.943263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:06.943263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:06.943263 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:06.945262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:06.945262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:06.970525 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3963/7971] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:06.974738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:06.986558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c7c0d-5f3c-41c8-9957-9561902d1bd7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:06.996028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.000833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.021129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.021436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.022418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:03:07.032594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.032594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.075693 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4009/7972] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:06 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:07.077180 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3964/7973] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:03:07.083829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.089826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.123166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c23d4-fe6c-4f99-8257-1e6ea7288086 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.270874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c401d-e763-46fb-bc19-caac6fec455a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.271308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.271308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.271308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.271772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.272990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.275522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.282957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.283597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.283921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.284368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.286968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.289901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.296664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:07.430887 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4010/7974] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:07 2022] POST /identity/v3/users => generated 287 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:07.436733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.439900 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3965/7975] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:07 2022] POST /identity/v3/projects => generated 373 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:07.450572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.462819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ee768-d986-46ba-b272-ba0cf3468fad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.621940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c9429-09fb-4632-a678-9b6386013464 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.636422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.637322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.638524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.638801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.639069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.639800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.643132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.644675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.645082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.645525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.646234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.648187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.675142 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4011/7976] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:07.677214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.694488 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7488b1e-c069-4cee-b112-28ba80fe28f0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.700426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.701202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.702256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.702581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.703247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.705474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.724844 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4012/7977] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:07.726289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.744306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d155a-0553-4448-899a-4f44000bf609 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.768402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.771815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.772099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.772371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] PATH_INFO: `/v3/projects/cf13747783784374a0341b0652d7a08d/users/96883e95e61946c49c4564f7c9a7709d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.800084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf13747783784374a0341b0652d7a08d, user_id=96883e95e61946c49c4564f7c9a7709d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.804749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35462c1c-06e6-4506-b541-a4a221f0a3fc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.827723 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3966/7978] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:07 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:07.839047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.859802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ae89b-8087-4817-8da7-bdb69af8f43e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.867668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:07.868622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.869211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.869624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.877879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:07.877879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:07.896296 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3967/7979] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:07.897358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:07.917365 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4013/7980] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:07 2022] PUT /identity/v3/projects/cf13747783784374a0341b0652d7a08d/users/96883e95e61946c49c4564f7c9a7709d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:07.919658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:07.919949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:07.920226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:07.966103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a872da0-3725-4b39-a07c-5691dae28535 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:07.983121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:08.019767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] MFA Rules not processed for user `96883e95e61946c49c4564f7c9a7709d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:08.021193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.101593 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:08.137155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:08.137790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.138077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.138357 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.142901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:08.165683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:08.208617 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3968/7981] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:08.213154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:08.230811 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4014/7982] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:08.241859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:08.243476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.259547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68de07-67f2-4321-8597-741ba12c0645 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:08.275340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:08.276034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.276339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.281888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] PATH_INFO: `/v3/projects/ba304b8b59ef40f2bf199d31de5c20cc/users/a759fc81b82347a989508b060dc28451/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.349294 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba304b8b59ef40f2bf199d31de5c20cc, user_id=a759fc81b82347a989508b060dc28451, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:08.355293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbae091-5eaf-45b9-8664-8c049b8b63ab admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:08.441342 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae762-8bed-432c-a1b9-0df02108f854 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:08.452990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:08.453785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.454068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.454538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.476789 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3969/7983] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:08 2022] PUT /identity/v3/projects/ba304b8b59ef40f2bf199d31de5c20cc/users/a759fc81b82347a989508b060dc28451/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:08.490083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7120-3b03-4537-85db-d026787baf29 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.490457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7120-3b03-4537-85db-d026787baf29 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.490895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f7120-3b03-4537-85db-d026787baf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.495287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:08.496863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cea19-7e5f-4dd6-91eb-cc9565c2b9f1 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:08.540152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-581f7120-3b03-4537-85db-d026787baf29 None None] MFA Rules not processed for user `a759fc81b82347a989508b060dc28451`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:08.540858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4015/7984] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:08.541724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-581f7120-3b03-4537-85db-d026787baf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.637271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.637271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.637271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.723329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] MFA Rules not processed for user `ba5adb911f7545239cd9db71f78333c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:08.725482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.739040 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3970/7985] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:08.762912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7120-3b03-4537-85db-d026787baf29 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:08.768992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-581f7120-3b03-4537-85db-d026787baf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:08.878792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:08.885776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f7120-3b03-4537-85db-d026787baf29 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:08.894452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:08.895540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:08.895827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:08.896117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:08.924178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:08.926495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:08.976052 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3971/7986] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:08.988751 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4016/7987] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:09.009910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:09.012021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:09.152030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf52ed-d4d3-4e84-b3e2-53ed61de7d5a service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:09.168937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:09.169671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:09.170022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:09.170368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:09.176292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:09.347508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:09.353125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375820ad-151c-4bf2-8e1c-4e2ce1848ba0 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:09.397206 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3972/7988] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:09.416118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:10.216764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:10.592894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:10.661889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:11.701508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:12.089929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:12.612855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:12.624340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:12.925804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c217f4-e4e5-427b-9f90-114162424579 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:12.935945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:12.944284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:12.945119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:12.945399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:12.958717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:13.063560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:13.096803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:13.098487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4d648-ac40-4fa6-ac82-8d1a7c9cd2d8 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:13.109611 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4017/7989] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:03:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:03:14.228465 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:14.390998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:14.392172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:14.392689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:14.434185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] MFA Rules not processed for user `a1be68d931534659a269ae57717e47d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:14.438291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:14.454124 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3973/7990] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:14.640016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:15.190347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:15.190931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:15.192304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:03:15.202800 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:03:15.204466 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:03:15.212927 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4018/7991] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:03:15 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 13:03:15.712869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:17.140377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:17.792245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:18.597338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:19.213065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:19.553180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:20.176660 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:20.178630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:20.201564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3951a-4ba1-494f-a221-a0953c54a8b4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:20.206663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:20.207715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:20.208435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:20.209003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:20.216097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:20.345572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:20.345572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:20.366388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3974/7992] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:21.218524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:21.712664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:22.655605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:22.771814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3271c-211a-4a81-b56b-83639e7a23d4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:22.777868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:22.779350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:22.780004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:22.780509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:22.783467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:22.992944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:22.998094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:23.001493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:23.077183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4019/7993] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:23.518351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:24.249064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:24.895150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:25.047659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:25.050296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:25.103065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf3a96-b1fc-4334-8c7f-16bf7c48d25a service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:25.113091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:25.113741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:25.114016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:25.114290 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] PATH_INFO: `/v3/users/0373f7b34b984b07b8ab3f3965a7ea6d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:25.118468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0373f7b34b984b07b8ab3f3965a7ea6d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:25.128522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:25.424862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0373f7b34b984b07b8ab3f3965a7ea6d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:25.574530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0373f7b34b984b07b8ab3f3965a7ea6d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:25.591557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:25.613662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0373f7b34b984b07b8ab3f3965a7ea6d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:25.614533 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0373f7b34b984b07b8ab3f3965a7ea6d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:25.615239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-17d4c6ab-1968-4da1-a9f6-6b0785c00ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0373f7b34b984b07b8ab3f3965a7ea6d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:25.652504 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3975/7994] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:25 2022] DELETE /identity/v3/users/0373f7b34b984b07b8ab3f3965a7ea6d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:26.409351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:26.439208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:26.965460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:26.980638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4991573-0487-4971-a201-d92a5dd0ba35 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:27.156924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:27.158143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:27.158559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:27.158847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] PATH_INFO: `/v3/projects/2688c21d1c2446738e30f08d35853087` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:27.160743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2688c21d1c2446738e30f08d35853087)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:27.164464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:27.192938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:27.395045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2688c21d1c2446738e30f08d35853087', 'request_id': 'req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:27.423344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2688c21d1c2446738e30f08d35853087', 'request_id': 'req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:27.440950 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2688c21d1c2446738e30f08d35853087', 'request_id': 'req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:27.517519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:27.558094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] The token cache is being invalidate because project 2688c21d1c2446738e30f08d35853087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:27.558094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:27.558094 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-42a6f5dd-a1e9-40f7-b36e-f917bffdcac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:27.563610 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4020/7995] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:26 2022] DELETE /identity/v3/projects/2688c21d1c2446738e30f08d35853087 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:27.565585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:27.565862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:27.566131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:27.618353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:27.619761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:27.824892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:27.825183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:27.825462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:27.847350 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3976/7996] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:27.894619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:27.896322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:27.945847 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4021/7997] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:27.947241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:27.968623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4bc73-0dcd-49f5-bd3a-ba110b071a72 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:27.969734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:27.989409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:27.990933 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:27.991451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:27.991936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:27.992983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:03:27.993517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:27.995446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:28.012777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.033358 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3977/7998] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:03:28.037927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:28.049486 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ec6d2-187d-4e35-ba16-9f184958deb9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:28.083160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:28.084082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:28.084362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:28.084735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:28.087264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:28.092761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:28.139710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.238163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:28.239054 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4022/7999] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:28 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:28.251877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47253-8f1b-4826-9cea-7e80530d7b24 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:28.386369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.411122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:28.411765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:28.412047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:28.412329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:28.419711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:28.421871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:28.649654 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3978/8000] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:28 2022] POST /identity/v3/users => generated 289 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:03:28.653899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:28.665556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:28.725314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a592a7-1335-434e-86fe-53b52e70d6ca admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:28.754892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:28.755516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:28.755796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:28.756064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:28.756742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:28.758361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:28.805655 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4023/8001] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:28.806695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:28.831700 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d46b68-e9a8-4d0f-bedc-9141a5e615c2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:28.867853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:28.868905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:28.870428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:28.870894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:28.871715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:28.883181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93249b98-9c3c-413c-a451-a143966e1ebc admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:28.926987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3979/8002] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:28.929007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:28.953113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fbb41-d5f1-41eb-afb4-4e676fc0e7f1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:28.982688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:28.983507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:28.989596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:28.992601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] PATH_INFO: `/v3/projects/8b0011d992e047aba24e133bd4d3218e/users/d7c9b5ba6ee94cc6af97216ec70fbec7/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:29.048120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0011d992e047aba24e133bd4d3218e, user_id=d7c9b5ba6ee94cc6af97216ec70fbec7, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:29.052001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:29.132530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:29.192086 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4024/8003] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:28 2022] PUT /identity/v3/projects/8b0011d992e047aba24e133bd4d3218e/users/d7c9b5ba6ee94cc6af97216ec70fbec7/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:29.196977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:29.197443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:29.197895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:29.245792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:29.248635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:29.346624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3980/8004] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:29.366075 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:29.367946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:29.498742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec294b-0e46-4f81-8660-df6a2f2f4f3f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:29.507558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:29.509032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:29.509430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:29.509815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:29.543150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:29.547166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:29.603739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4025/8005] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:29.959575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:30.552148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:30.914721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:31.420866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:32.117650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:32.603308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:33.570363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:33.572230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:33.596334 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b7685-f234-4725-8dd4-6201fc8895b2 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:33.611617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:33.613195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:33.613780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:33.615521 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] PATH_INFO: `/v3/users/96883e95e61946c49c4564f7c9a7709d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:33.617074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96883e95e61946c49c4564f7c9a7709d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:33.624193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:33.850478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96883e95e61946c49c4564f7c9a7709d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:33.859115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:33.873796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:33.875991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:33.901321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ba143-90af-4796-ae18-9c69aaaa99b8 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:33.922829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:33.922829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:33.922829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:33.922829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] PATH_INFO: `/v3/users/a1be68d931534659a269ae57717e47d2` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:33.923400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1be68d931534659a269ae57717e47d2)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:33.924366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:33.969269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96883e95e61946c49c4564f7c9a7709d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:33.988694 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96883e95e61946c49c4564f7c9a7709d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:33.993865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96883e95e61946c49c4564f7c9a7709d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:33.994737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0f00e020-0d49-4d4c-928c-42520460f53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96883e95e61946c49c4564f7c9a7709d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.003921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:34.027616 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3981/8006] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:33 2022] DELETE /identity/v3/users/96883e95e61946c49c4564f7c9a7709d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:34.032396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:34.032711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:34.032986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:34.063564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:34.076118 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:34.201642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1be68d931534659a269ae57717e47d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.276984 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3982/8007] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:34.286710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:34.289535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:34.312010 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1be68d931534659a269ae57717e47d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.380232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1be68d931534659a269ae57717e47d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.418419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1be68d931534659a269ae57717e47d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.421097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1be68d931534659a269ae57717e47d2'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:34.434870 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4026/8008] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:33 2022] DELETE /identity/v3/users/a1be68d931534659a269ae57717e47d2 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:03:34.588107 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ec8c6-3df3-4914-ad4b-6e2e367436ed None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:34.896021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:34.899017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:34.922651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:35.039256 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:35.155409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:35.156114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:35.156405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:35.163889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:35.173578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:35.191731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b421564-0859-42e8-bbb9-67a9aa3ae5d1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:35.211595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:35.212257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:35.212582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:35.212900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] PATH_INFO: `/v3/projects/1ac4313709954b2e9e651cb26814df74` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:35.221977 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac4313709954b2e9e651cb26814df74)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:35.226494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:35.232948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:35.233098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:35.265853 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3983/8009] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 980 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:35.477259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac4313709954b2e9e651cb26814df74', 'request_id': 'req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:35.508654 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac4313709954b2e9e651cb26814df74', 'request_id': 'req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:35.553502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac4313709954b2e9e651cb26814df74', 'request_id': 'req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:35.723540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] The token cache is being invalidate because project 1ac4313709954b2e9e651cb26814df74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:35.723885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:35.724722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:35.726284 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4027/8010] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:34 2022] DELETE /identity/v3/projects/1ac4313709954b2e9e651cb26814df74 => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:35.730562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:35.743577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b827b-af33-4329-9d04-77f4f8670c2c service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:35.767827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:35.828519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:35.830004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:36.023188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:36.023905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:36.024183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:36.024455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] PATH_INFO: `/v3/users/ba5adb911f7545239cd9db71f78333c2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:36.027469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba5adb911f7545239cd9db71f78333c2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:36.034745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:36.114864 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c74cb-eccc-4760-9e0c-6ce9c9e87fe8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:36.134104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:36.134768 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:36.135043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:36.135314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] PATH_INFO: `/v3/projects/cf13747783784374a0341b0652d7a08d` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:36.141645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf13747783784374a0341b0652d7a08d)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:36.144000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:36.192512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:36.354221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba5adb911f7545239cd9db71f78333c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.417581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf13747783784374a0341b0652d7a08d', 'request_id': 'req-24a35fef-94d3-4e3c-8a89-84076e62a78d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.444097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf13747783784374a0341b0652d7a08d', 'request_id': 'req-24a35fef-94d3-4e3c-8a89-84076e62a78d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.453281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf13747783784374a0341b0652d7a08d', 'request_id': 'req-24a35fef-94d3-4e3c-8a89-84076e62a78d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.547446 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba5adb911f7545239cd9db71f78333c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.558802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:36.571662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba5adb911f7545239cd9db71f78333c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.573821 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba5adb911f7545239cd9db71f78333c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.574960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7af059a6-9d33-4ef5-88e8-42192590d6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba5adb911f7545239cd9db71f78333c2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.595370 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3984/8011] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:35 2022] DELETE /identity/v3/users/ba5adb911f7545239cd9db71f78333c2 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:36.630474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] The token cache is being invalidate because project cf13747783784374a0341b0652d7a08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:36.630474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.630474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-24a35fef-94d3-4e3c-8a89-84076e62a78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:36.637893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:36.638337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:36.638701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:36.641030 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4028/8012] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:35 2022] DELETE /identity/v3/projects/cf13747783784374a0341b0652d7a08d => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:36.729071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:36.734891 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:37.017406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:37.018113 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:37.018492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:37.028465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3985/8013] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:37.084954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:37.091011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:37.102341 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:37.137355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:37.151377 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4029/8014] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:03:37.156946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b857-8875-484e-ad8a-08d4159da346 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:37.172024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:37.172971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:37.174030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:37.174991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:37.176963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:03:37.177781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:37.182659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:37.188318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:37.219990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:37.227436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3986/8015] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:03:37.235242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb38f7-c76e-4190-b2f6-d4a23e9c9d5d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:37.250785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:37.251582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:37.251957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:37.252331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:37.254563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:37.257615 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:37.267734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:37.270047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:37.283679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:37.318801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2a4e5-9502-435a-ae43-46f51d6e6af8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:37.364669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:37.366037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:37.366788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:37.370936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] PATH_INFO: `/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:37.374905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe3c3f159e14c2bb0cba6debd69ec1f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:37.386947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:37.451801 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4030/8016] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:37 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:37.456207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:37.613287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe3c3f159e14c2bb0cba6debd69ec1f', 'request_id': 'req-3e74f907-6f85-455e-be3a-45d54bdafbb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:37.619222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79fc09-9f29-4df2-9bff-106c244cee85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:37.634595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe3c3f159e14c2bb0cba6debd69ec1f', 'request_id': 'req-3e74f907-6f85-455e-be3a-45d54bdafbb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:37.752031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:37.752811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:37.754033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:37.754412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:37.755168 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:37.759917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:37.780008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe3c3f159e14c2bb0cba6debd69ec1f', 'request_id': 'req-3e74f907-6f85-455e-be3a-45d54bdafbb3'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:37.798219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] The token cache is being invalidate because project 3fe3c3f159e14c2bb0cba6debd69ec1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:37.798774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:37.800099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:37.803885 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3987/8017] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:37 2022] DELETE /identity/v3/projects/3fe3c3f159e14c2bb0cba6debd69ec1f => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:37.814855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:37.926195 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4031/8018] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:37 2022] POST /identity/v3/users => generated 281 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:37.927226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:37.929028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:37.974162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74f907-6f85-455e-be3a-45d54bdafbb3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:38.011228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:38.011228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:38.011228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:38.011228 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:38.011989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:38.022591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:38.078000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:38.078647 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3988/8019] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:38.095430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd9143-95cb-479d-a1e0-f486da55cc83 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:38.118573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:38.122038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:38.122591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:38.123020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:38.126466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:38.128347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f264ba-69cc-40d9-ae8e-4d9ede35e778 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:38.159804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:38.160478 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4032/8020] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:38.181341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd9a5f-8494-4d81-b693-4e0bfa11500d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:38.195095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:38.195829 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:38.196116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:38.196416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] PATH_INFO: `/v3/projects/30b66d3762734ed19abb9aaab112c790/users/5961b62d992b4e3f8ed47535deaef56e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:38.246052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b66d3762734ed19abb9aaab112c790, user_id=5961b62d992b4e3f8ed47535deaef56e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:38.249492 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:38.264543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:38.364470 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3989/8021] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:38 2022] PUT /identity/v3/projects/30b66d3762734ed19abb9aaab112c790/users/5961b62d992b4e3f8ed47535deaef56e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:03:38.366508 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e4f-a8c7-4835-a3eb-9811ac39278d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:38.367641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e4f-a8c7-4835-a3eb-9811ac39278d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:38.367921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0e4f-a8c7-4835-a3eb-9811ac39278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:38.402006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-10ba0e4f-a8c7-4835-a3eb-9811ac39278d None None] MFA Rules not processed for user `5961b62d992b4e3f8ed47535deaef56e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:38.402865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-10ba0e4f-a8c7-4835-a3eb-9811ac39278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:38.568523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:38.614857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4033/8022] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:38.637669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:38.637669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:38.801703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a311ac-2300-4178-ac89-18f95cead175 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:38.822184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:38.823177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:38.823663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:38.824187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:38.846860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:38.849072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:38.865929 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3990/8023] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:39.095416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:39.141317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:39.551681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:40.688572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:40.689143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:40.689246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:40.712945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:40.805952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] MFA Rules not processed for user `d7c9b5ba6ee94cc6af97216ec70fbec7`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:40.805952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:40.871958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:41.016171 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:41.016623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4034/8024] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:41.018208 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:41.131008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514476-5552-4eb7-aabe-fee20f9e190b service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:41.140819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:41.143146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:41.146333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:41.151064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:41.152001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:41.156683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:41.295190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:41.350692 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3991/8025] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:41 2022] POST /identity/v3/projects => generated 381 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:03:41.353606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:41.377217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335a350c-1d8c-4344-b31c-14daa90831fc None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:41.478388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:41.479951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:41.480459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:41.481104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:41.481931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:41.485729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:41.646181 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4035/8026] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:41 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:41.650134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:41.667530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45141a68-cc89-4e1f-ac4f-2b178e082b64 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:41.679780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:41.682129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:41.683749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:41.686796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:41.688262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:41.709558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:41.774706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3992/8027] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:41.776618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:41.793415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d183c-a0ea-41e6-96c4-13210563c17b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:41.822867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:41.830130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:41.831591 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:41.832044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] PATH_INFO: `/v3/projects/c737c998423f4e7785441ff046aed0a2/users/2fe3986a9e9145cf84307bd58ca71f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:41.909919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c737c998423f4e7785441ff046aed0a2, user_id=2fe3986a9e9145cf84307bd58ca71f37, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:41.913856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:42.010424 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4036/8028] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:41 2022] PUT /identity/v3/projects/c737c998423f4e7785441ff046aed0a2/users/2fe3986a9e9145cf84307bd58ca71f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:42.015610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:42.036876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886fed5-8e89-4c0c-8f6e-503003c47a01 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:42.166099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:42.166862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:42.167399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:42.167763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:42.168513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:42.171535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:42.219270 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3993/8029] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:42.227667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:42.248079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08e594-ed0c-4023-aacb-8722f128ea41 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:42.255694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:42.256970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:42.257410 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:42.258787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] PATH_INFO: `/v3/projects/c737c998423f4e7785441ff046aed0a2/users/2fe3986a9e9145cf84307bd58ca71f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:42.265081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c737c998423f4e7785441ff046aed0a2, user_id=2fe3986a9e9145cf84307bd58ca71f37, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:42.275158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e048fb-e84a-4bb5-89df-ae9c03e29c27 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:42.297562 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4037/8030] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:42 2022] PUT /identity/v3/projects/c737c998423f4e7785441ff046aed0a2/users/2fe3986a9e9145cf84307bd58ca71f37/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:42.477837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:42.797596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:43.871236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:44.003493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:44.950455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:44.987426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:45.002896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:45.042338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a008dd4-2bb0-4316-a09f-b2d151785d5d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:45.173191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:45.174363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:45.175126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:45.175810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] PATH_INFO: `/v3/users/a759fc81b82347a989508b060dc28451` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:45.177381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a759fc81b82347a989508b060dc28451)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:45.179876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:45.473167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a759fc81b82347a989508b060dc28451'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:45.540439 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a759fc81b82347a989508b060dc28451'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:45.580153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a759fc81b82347a989508b060dc28451'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:45.583345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a759fc81b82347a989508b060dc28451'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:45.586645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a759fc81b82347a989508b060dc28451'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:45.646537 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3994/8031] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:03:44 2022] DELETE /identity/v3/users/a759fc81b82347a989508b060dc28451 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:45.651280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:45.651807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:45.655278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:45.688129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:45.689792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:45.870072 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4038/8032] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:45.888405 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:45.890816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:46.099790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ae8a3-188b-40bf-a0f9-f5b88686a3b1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:46.112908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:46.114743 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:46.115191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:46.144850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:46.162406 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:46.170614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc0c53-9638-4b59-a9fb-d3c48bbca094 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:46.197613 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3995/8033] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:46.265183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:47.318310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:47.336794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:47.341026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:47.388312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c97c52-46e9-4af2-9a6d-d515b7203162 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:47.409413 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:47.410162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:47.410446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:47.410728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] PATH_INFO: `/v3/projects/ba304b8b59ef40f2bf199d31de5c20cc` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:47.438040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba304b8b59ef40f2bf199d31de5c20cc)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:47.453569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:47.678046 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba304b8b59ef40f2bf199d31de5c20cc', 'request_id': 'req-a41771e7-179c-46f0-8615-4f8d81f4f4fa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:47.696321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba304b8b59ef40f2bf199d31de5c20cc', 'request_id': 'req-a41771e7-179c-46f0-8615-4f8d81f4f4fa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:47.714461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba304b8b59ef40f2bf199d31de5c20cc', 'request_id': 'req-a41771e7-179c-46f0-8615-4f8d81f4f4fa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:47.844512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] The token cache is being invalidate because project ba304b8b59ef40f2bf199d31de5c20cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:03:47.844830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:47.846093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a41771e7-179c-46f0-8615-4f8d81f4f4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:03:47.847653 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4039/8034] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:03:47 2022] DELETE /identity/v3/projects/ba304b8b59ef40f2bf199d31de5c20cc => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:47.853226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:47.853512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:47.853788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:47.893193 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:47.896528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:48.030412 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3996/8035] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:48.038077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.038369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.038832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.084349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:48.086959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:48.115493 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4040/8036] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:48.119873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.130588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14422245-ca9c-468f-ab41-38ff61cee2f5 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.149468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.150254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.150638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.151047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.152564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:03:48.152989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.155313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.186715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3997/8037] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:03:48.188702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.209623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62047e-5be8-4c7d-ba8a-5de10301015d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.220523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.221162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.221750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.222186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.223044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.225255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.445629 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4041/8038] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:03:48 2022] POST /identity/v3/projects => generated 363 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:03:48.450443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.462312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6cc72-520f-4f5c-8801-b978a5db914a admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.572916 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.573594 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.573945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.574295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.575070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.580819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.750671 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3998/8039] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:03:48 2022] POST /identity/v3/users => generated 282 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:03:48.753630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.767291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999e16-e707-4b97-a0c4-7dfb593cb16d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.773867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.774868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.775448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.775935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.777744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.780258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.806095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.815191 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4042/8040] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:48.828137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7545e4-ce7e-44f9-88ef-d929bd3e6015 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.828649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.830164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.831506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.832048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.833625 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.835992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a597db7-6b14-49de-92b0-2715e74367fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.854020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:48.864869 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 3999/8041] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:03:48.867194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ec311-ca58-4717-99f0-403dc7500833 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:48.874540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:48.875627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.876148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.876744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] PATH_INFO: `/v3/projects/02b01e81a2f14e4ba262421b37ab20e8/users/0203f6c05dc24de19b91b1f6c3a66f9d/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:48.894934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b01e81a2f14e4ba262421b37ab20e8, user_id=0203f6c05dc24de19b91b1f6c3a66f9d, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:48.898182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:48.989972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4043/8042] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:03:48 2022] PUT /identity/v3/projects/02b01e81a2f14e4ba262421b37ab20e8/users/0203f6c05dc24de19b91b1f6c3a66f9d/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:03:48.995831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f7a40-a7cb-4cf1-a578-bd908bc3ac93 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:48.997295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f7a40-a7cb-4cf1-a578-bd908bc3ac93 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:48.997740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f7a40-a7cb-4cf1-a578-bd908bc3ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:49.014511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:49.020607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e82f7a40-a7cb-4cf1-a578-bd908bc3ac93 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:49.021827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e82f7a40-a7cb-4cf1-a578-bd908bc3ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:49.089307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4000/8043] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:49.099729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:49.102429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:49.234831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:49.304245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138370f8-323e-4131-82cc-707d78f9e18a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:49.318931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:49.319644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:49.319924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:49.320196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:49.356185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:49.359042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:49.380794 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4044/8044] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:49.683745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:49.997662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:51.408871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:51.614506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:52.986403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:53.041797 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:53.482761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:INSERT=5,keystone:DELETE=15 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:53.889751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:53.890550 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:53.891067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:53.976339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] MFA Rules not processed for user `2fe3986a9e9145cf84307bd58ca71f37`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:03:53.985253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:54.190807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4001/8045] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:03:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:03:54.221080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:54.223483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:54.397751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9054cd-6521-4ff2-9cf7-abef54d9a06d service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:54.407962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:54.409171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:54.409469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:54.409824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:54.421298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:54.422979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:54.450517 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4045/8046] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:54.580103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:54.956116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:54.956116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:55.048771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:55.177223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422848b-8ea8-428b-a29e-8197a4c9a537 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:55.194929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:55.196711 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:55.197238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:55.197746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:55.202908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:55.235230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:55.240855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:55.274403 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4002/8047] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:55.906046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:55.986464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:56.235180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:56.236710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:56.270742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0972b2b-2e75-4a67-a978-6e967a4ba0f8 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:56.280081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:56.281114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:56.281582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:56.282052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:56.285423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:56.313425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:56.319739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd03b3b-2d4f-45e7-8c5f-7bd20cfa3e24 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:56.349712 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4046/8048] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:03:57.410394 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:57.440671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:03:57.473769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddfc24-4f0b-4161-90dc-c5e9a7851844 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:03:57.527185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:03:57.528249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:03:57.529017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:03:57.529715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:03:57.552000 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:03:57.586537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:03:57.588170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:03:57.618975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4003/8049] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:03:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:03:57.728695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:58.419682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:59.227644 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:59.248240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:59.957274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:00.007861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:00.318267 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:00.990974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:01.111889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:01.526000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:01.527392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:01.527669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:01.623462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] MFA Rules not processed for user `0203f6c05dc24de19b91b1f6c3a66f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:01.625223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:01.775802 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4047/8050] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:01.782147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:01.798239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bcfaa-e638-4a8d-b1d9-29e43f1f1398 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:01.805390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:01.806199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:01.806723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:01.807196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:01.808162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:01.814186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:01.955804 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4004/8051] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:01 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:01.957054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:01.998806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec685f8-0dc1-466a-b3dc-89e21ca2acfe None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:02.014008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:02.015014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:02.015961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:02.016237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:02.016959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:02.022629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f22a-da2e-4314-b6c6-b5f98d858155 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:02.052220 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4048/8052] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:02.056745 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:02.072250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909641b-395f-425d-8112-cc2c175965c1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:02.078264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:02.079203 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:02.079627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:02.080253 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] PATH_INFO: `/v3/system/users/374e240d80b8429f8292ab4565ae0ff6/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:02.104113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=374e240d80b8429f8292ab4565ae0ff6, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:02.105845 n-d-857339-6 devstack@keystone.service[82132]: WARNING py.warnings [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 02 13:04:02.105845 n-d-857339-6 devstack@keystone.service[82132]: warnings.warn(msg) Nov 02 13:04:02.105845 n-d-857339-6 devstack@keystone.service[82132]: Nov 02 13:04:02.107236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:02.201486 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4005/8053] 10.222.0.64 () {60 vars in 1378 bytes} [Wed Nov 2 13:04:02 2022] PUT /identity/v3/system/users/374e240d80b8429f8292ab4565ae0ff6/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:02.207418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:02.208112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:02.208621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:02.249715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] MFA Rules not processed for user `374e240d80b8429f8292ab4565ae0ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:02.251101 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:02.357687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:02.504982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:02.505144 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4049/8054] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:02 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Nov 02 13:04:02.811798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:02.859551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918235a-158f-48c4-9fae-145a33fcb092 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:02.980308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '374e240d80b8429f8292ab4565ae0ff6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:02.981009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:02.981292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:02.981565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] PATH_INFO: `/v3/services` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:02.982753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:02.984251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:03.002008 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4006/8055] 10.222.0.64 () {58 vars in 1110 bytes} [Wed Nov 2 13:04:02 2022] GET /identity/v3/services => generated 2191 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:03.008906 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:03.304748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:03.414316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:03.573970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621bea3-8455-431f-802e-85e5fdac1c32 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:03.698356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '374e240d80b8429f8292ab4565ae0ff6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:03.700736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:03.702911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:03.703691 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] PATH_INFO: `/v3/limits` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:03.705097 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:03.710755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Nov 02 13:04:03.817274 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return method(*args, **kwargs) Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.NoLimitReference Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Nov 02 13:04:03.819167 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:04:03.826704 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4050/8056] 10.222.0.64 () {60 vars in 1126 bytes} [Wed Nov 2 13:04:03 2022] POST /identity/v3/limits => generated 124 bytes in 818 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Nov 02 13:04:03.828641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:03.839257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:04.080047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a39c8-18d7-45c3-80dc-30cf2318611e None tempest-ImageQuotaTest-528496347-system-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:04.167572 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '374e240d80b8429f8292ab4565ae0ff6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:04.168293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:04.168617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:04.168895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:04.169901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:04.171461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:04.200299 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4007/8057] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 13:04:03 2022] GET /identity/v3/registered_limits => generated 129 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:04:04.207848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:04.555632 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966563a-bac6-4963-994d-1559b29a998d None tempest-ImageQuotaTest-528496347-system-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:04.595247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:04.671680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '374e240d80b8429f8292ab4565ae0ff6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:04.678997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:04.679792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:04.680402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:04.681652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:04.688312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:04.711432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4051/8058] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 13:04:04 2022] GET /identity/v3/registered_limits => generated 129 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:04:05.243227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:05.780136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:06.648860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:06.927307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:07.619873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:07.837155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:07.917211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:07.973707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8362a82-31b3-42b1-a95d-845ee5830802 None tempest-ImageQuotaTest-528496347-system-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:07.996822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:07.998262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:07.998973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:08.001474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:08.012888 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:08.063598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:08.071865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2d5ee-5cdb-4404-8bec-8682da9034fe service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:08.137750 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4008/8059] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:09.050214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:09.235392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:09.554326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:09.724669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:09.726881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:09.757070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60f930-f7fa-46b9-af61-cc863edd966b None tempest-ImageQuotaTest-528496347-system-admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:09.775882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:09.778001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:09.779339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:09.779627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] PATH_INFO: `/v3/users/5961b62d992b4e3f8ed47535deaef56e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:09.782656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5961b62d992b4e3f8ed47535deaef56e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:09.785945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:10.069436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:10.120279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5961b62d992b4e3f8ed47535deaef56e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:10.224507 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5961b62d992b4e3f8ed47535deaef56e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:10.274005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5961b62d992b4e3f8ed47535deaef56e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:10.293356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5961b62d992b4e3f8ed47535deaef56e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:10.294339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5961b62d992b4e3f8ed47535deaef56e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:10.310811 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4052/8060] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:09 2022] DELETE /identity/v3/users/5961b62d992b4e3f8ed47535deaef56e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:10.312805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:10.313265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:10.313403 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:10.358779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:10.360128 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:10.479892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:10.535652 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4009/8061] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:10.552429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:10.555464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:10.660725 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:10.820350 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71005ad6-041b-48bd-95bf-1626207fe4c3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:10.828453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:10.830045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:10.830829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:10.831782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:10.856276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:10.859934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be8324-f39f-4c1a-811c-d6f0e896906d service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:10.884628 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4053/8062] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:11.060147 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:11.306907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:11.309314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:11.338177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654be3f-af09-4359-9faa-d6fe7a60ebc4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:11.348716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:11.350163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:11.350772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:11.351259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] PATH_INFO: `/v3/projects/30b66d3762734ed19abb9aaab112c790` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:11.354245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b66d3762734ed19abb9aaab112c790)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:11.358167 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:11.598140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b66d3762734ed19abb9aaab112c790', 'request_id': 'req-4d90f21c-1ae5-4882-ab54-40616f83216a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:11.608425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b66d3762734ed19abb9aaab112c790', 'request_id': 'req-4d90f21c-1ae5-4882-ab54-40616f83216a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:11.767687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b66d3762734ed19abb9aaab112c790', 'request_id': 'req-4d90f21c-1ae5-4882-ab54-40616f83216a'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:11.794727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] The token cache is being invalidate because project 30b66d3762734ed19abb9aaab112c790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:11.794727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:11.795134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d90f21c-1ae5-4882-ab54-40616f83216a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:11.797326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4010/8063] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:11 2022] DELETE /identity/v3/projects/30b66d3762734ed19abb9aaab112c790 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:11.802780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:11.803325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:11.803325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:11.836248 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:11.838056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:11.951363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:12.019919 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4054/8064] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:12.027802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:12.028152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:12.028451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:12.081270 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:12.082780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:12.122340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4011/8065] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:04:12.127152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:12.136839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:12.141626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfddcc-fd25-44c8-8b19-82c585918576 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:12.152368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:12.153453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:12.154145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:12.154694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:12.155573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:04:12.164251 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:12.164678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:12.191259 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4055/8066] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:04:12.197961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:12.243901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359390f-d2a4-4989-8445-547acea92a88 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:12.252902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:12.253907 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:12.254395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:12.254983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:12.257402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:12.265046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:12.445415 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4012/8067] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:12 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:12.450438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:12.477225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36d33d-4e4b-4454-820e-16d86f57af42 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:12.734807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:12.736658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:12.737250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:12.739422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:12.739422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:12.739422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:12.746274 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:12.929770 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4056/8068] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:12 2022] POST /identity/v3/users => generated 291 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:12.933283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:12.957852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecbbf4-ae42-4ec0-b344-86cd32eef395 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:12.997914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:12.998760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:13.000329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:13.001307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:13.002481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:13.005307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:13.031733 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4013/8069] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:13.032785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:13.065261 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81406a65-907b-4c1d-9aec-94f1a8ba7bb5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:13.078603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:13.079430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:13.079901 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:13.080478 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:13.081298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:13.083328 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441114c2-6fee-4e53-ab57-d8e903e1e640 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:13.098571 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4057/8070] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:13.102514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:13.114718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4715813-f45c-44e0-93b3-a947553165f3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:13.134884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:13.136206 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:13.136734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:13.137199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] PATH_INFO: `/v3/projects/f77b542ff1ec41efb0231aba11fe6039/users/41b090032eaa4c3592512dff315bfcb0/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:13.172835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77b542ff1ec41efb0231aba11fe6039, user_id=41b090032eaa4c3592512dff315bfcb0, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:13.175995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:13.265949 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:13.306741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4014/8071] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:13 2022] PUT /identity/v3/projects/f77b542ff1ec41efb0231aba11fe6039/users/41b090032eaa4c3592512dff315bfcb0/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:13.308573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:13.309008 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:13.309289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:13.382190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] MFA Rules not processed for user `41b090032eaa4c3592512dff315bfcb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:13.383477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:13.557074 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4058/8072] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:13.558185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:13.613598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:13.744111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7a42b-b56d-447f-9d0a-155e5bcca308 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:13.768174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:13.768843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:13.769123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:13.769397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:13.770041 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:13.772008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:13.895382 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4015/8073] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:13 2022] POST /identity/v3/projects => generated 381 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:13.899211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:13.911376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84e1a4-fd7e-4f9f-847f-06fa1c9b7d30 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.021162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.025793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.026551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.027050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.028315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.030643 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.045644 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:14.190160 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4059/8074] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:13 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:14.193387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.212397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797e5d0-e1f6-4216-a12e-9e69bfcba0d4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.218474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.219136 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.219411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.219884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.220937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.222977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.236367 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4016/8075] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:14.240988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.256955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a956c68-ec5f-42af-9d56-9f90bbf5b216 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.260243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.261143 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.261418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.261683 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] PATH_INFO: `/v3/projects/0b97113e9bf343339238c877ca7f28d4/users/1af8257b4ec3407bb596fdab3dfc41be/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.277811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b97113e9bf343339238c877ca7f28d4, user_id=1af8257b4ec3407bb596fdab3dfc41be, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.280542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.422196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.424945 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:14.445494 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4060/8076] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:14 2022] PUT /identity/v3/projects/0b97113e9bf343339238c877ca7f28d4/users/1af8257b4ec3407bb596fdab3dfc41be/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:14.449552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea5717-2c19-4fca-8475-d6aaf0613d79 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.464686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.557337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.558956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.560680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.561133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] PATH_INFO: `/v3/users/0203f6c05dc24de19b91b1f6c3a66f9d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.562760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0203f6c05dc24de19b91b1f6c3a66f9d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.566078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.635687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a6e3f-08f6-41fa-bef6-4b72eda5d9e1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.641401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.641830 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.642391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.642509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.643074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.644732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.657272 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4061/8077] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:14.662082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.673664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f01ac9-fbaa-4cfa-bd8e-f292a0216f2e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:14.679457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:14.680293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.680624 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.681009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] PATH_INFO: `/v3/projects/0b97113e9bf343339238c877ca7f28d4/users/1af8257b4ec3407bb596fdab3dfc41be/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.683080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b97113e9bf343339238c877ca7f28d4, user_id=1af8257b4ec3407bb596fdab3dfc41be, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:14.685958 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8506356-bcea-4ba8-bdce-4d1c1e4b3a7e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:14.697142 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4062/8078] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:14 2022] PUT /identity/v3/projects/0b97113e9bf343339238c877ca7f28d4/users/1af8257b4ec3407bb596fdab3dfc41be/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:14.710740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:14.711325 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:14.711659 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:14.749871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] MFA Rules not processed for user `1af8257b4ec3407bb596fdab3dfc41be`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:14.752292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:14.953019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0203f6c05dc24de19b91b1f6c3a66f9d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:14.957746 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4063/8079] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:14.977502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:14.983638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:15.134578 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d56656-29ab-4047-bb44-5744ef705580 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:15.138589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:15.139450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:15.140048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:15.140537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:15.152736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:15.154979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:15.165869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0203f6c05dc24de19b91b1f6c3a66f9d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:15.170026 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4064/8080] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:15.197980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0203f6c05dc24de19b91b1f6c3a66f9d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:15.199198 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0203f6c05dc24de19b91b1f6c3a66f9d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:15.200069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0203f6c05dc24de19b91b1f6c3a66f9d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:15.264746 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4017/8081] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:14 2022] DELETE /identity/v3/users/0203f6c05dc24de19b91b1f6c3a66f9d => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:15.327425 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:15.456316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:15.473794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb97b5d-05a8-4e63-837c-d612ad2afb09 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:15.601538 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:15.602202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:15.603056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:15.603347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:15.606313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:15.735347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:15.740314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:15.765052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:15.771763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4065/8082] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:15.775154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:15.870525 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:15.905586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f518cd1-6bb7-49e3-912d-c6074033b1fd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:15.917176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:15.918112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:15.918659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:15.919133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] PATH_INFO: `/v3/projects/02b01e81a2f14e4ba262421b37ab20e8` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:15.922687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b01e81a2f14e4ba262421b37ab20e8)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:15.939448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:16.119474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b01e81a2f14e4ba262421b37ab20e8', 'request_id': 'req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.131339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b01e81a2f14e4ba262421b37ab20e8', 'request_id': 'req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.275525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b01e81a2f14e4ba262421b37ab20e8', 'request_id': 'req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.296126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:16.298184 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:16.313299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] The token cache is being invalidate because project 02b01e81a2f14e4ba262421b37ab20e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:16.314502 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.315634 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.318674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851581f-9aa1-4dec-8793-b981b7a6ca63 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:16.319146 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4018/8083] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:15 2022] DELETE /identity/v3/projects/02b01e81a2f14e4ba262421b37ab20e8 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:16.323255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:16.324863 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:16.401333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:16.402383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:16.402825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:16.410601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] PATH_INFO: `/v3/users/d7c9b5ba6ee94cc6af97216ec70fbec7` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:16.410601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c9b5ba6ee94cc6af97216ec70fbec7)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:16.410601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:16.412394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2ddbd-95ee-4cb7-b41e-73c943f3704c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:16.418326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:16.419050 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:16.419336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:16.419603 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] PATH_INFO: `/v3/users/374e240d80b8429f8292ab4565ae0ff6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:16.420980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=374e240d80b8429f8292ab4565ae0ff6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:16.424240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:16.531567 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:16.656319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c9b5ba6ee94cc6af97216ec70fbec7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.698800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374e240d80b8429f8292ab4565ae0ff6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.738408 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c9b5ba6ee94cc6af97216ec70fbec7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.753990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c9b5ba6ee94cc6af97216ec70fbec7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.762004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c9b5ba6ee94cc6af97216ec70fbec7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.763502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-79efbd98-7051-4289-8fcf-49dc8d3229c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c9b5ba6ee94cc6af97216ec70fbec7'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.770819 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4066/8084] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:16 2022] DELETE /identity/v3/users/d7c9b5ba6ee94cc6af97216ec70fbec7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:16.824040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374e240d80b8429f8292ab4565ae0ff6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.848176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374e240d80b8429f8292ab4565ae0ff6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.849923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374e240d80b8429f8292ab4565ae0ff6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.851091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cbbe411a-c38a-4331-b642-d12962c73c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374e240d80b8429f8292ab4565ae0ff6'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:16.884574 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4019/8085] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:16 2022] DELETE /identity/v3/users/374e240d80b8429f8292ab4565ae0ff6 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:16.886329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:16.886617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:16.887029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:16.910954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:16.912234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.021817 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4067/8086] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:17.032578 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.032871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.033174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.059631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:17.061125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.073080 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4020/8087] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:17.078129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.089710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e8a9a-6c79-44e6-93b4-a18ec6583573 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.096053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:17.098744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.099447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.099803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.100144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.101372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:04:17.101785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.103702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.118714 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4068/8088] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:04:17.123659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.133760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f714563-ead2-4071-9e32-94164a3c7389 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.139537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.140187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.140464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.140794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.141440 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.143452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.170460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.172716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.187187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a83941a-6f37-4e83-af8a-fdc1f9602734 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.192306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.193001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.193309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.193627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] PATH_INFO: `/v3/projects/8b0011d992e047aba24e133bd4d3218e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.194759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0011d992e047aba24e133bd4d3218e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.196720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.284116 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4021/8089] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:17 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:17.285547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.333511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0011d992e047aba24e133bd4d3218e', 'request_id': 'req-711f6545-fd28-4630-9447-d45ba3a57d7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.342317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0011d992e047aba24e133bd4d3218e', 'request_id': 'req-711f6545-fd28-4630-9447-d45ba3a57d7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.349505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0011d992e047aba24e133bd4d3218e', 'request_id': 'req-711f6545-fd28-4630-9447-d45ba3a57d7f'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.361312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a0ee5-a964-4560-a3f5-e715bae52556 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.423635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.424418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.424909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.425392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.427882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.428937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.534414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] The token cache is being invalidate because project 8b0011d992e047aba24e133bd4d3218e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:17.535278 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.536358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.538467 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4069/8090] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:17 2022] DELETE /identity/v3/projects/8b0011d992e047aba24e133bd4d3218e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:17.546631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.549024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.565759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f6545-fd28-4630-9447-d45ba3a57d7f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.576840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.576840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.576840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.576840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] PATH_INFO: `/v3/users/2fe3986a9e9145cf84307bd58ca71f37` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.577590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe3986a9e9145cf84307bd58ca71f37)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.577590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.616540 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4022/8091] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:17 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:17.620527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.623078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.636126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0fea-c9a6-4f9c-9a88-65bfd7b61261 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.642787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.643408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.643685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.643960 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.644723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.646596 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.660347 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4023/8092] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:17.664433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.676923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b986c8-bf5c-43c9-8e8f-994281bc2351 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.684295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.685883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.686157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.686516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.687191 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.689138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.709585 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4024/8093] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:17.710981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:17.728042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99db7-043a-447e-b651-2fe1b034e798 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:17.733451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:17.734043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.734323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.734597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] PATH_INFO: `/v3/projects/0a42e2f895074311ba70e12d1b5eaeba/users/948c29a5d95c4ae1b44b3760eec4b344/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.751885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a42e2f895074311ba70e12d1b5eaeba, user_id=948c29a5d95c4ae1b44b3760eec4b344, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:17.754678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b08b4a-2de4-491f-9671-865d9a1c8da7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:17.789913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe3986a9e9145cf84307bd58ca71f37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.812352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:17.849933 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4025/8094] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:17 2022] PUT /identity/v3/projects/0a42e2f895074311ba70e12d1b5eaeba/users/948c29a5d95c4ae1b44b3760eec4b344/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:17.855718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:17.858664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:17.858664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:17.870397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe3986a9e9145cf84307bd58ca71f37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.886390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:17.887252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe3986a9e9145cf84307bd58ca71f37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.887505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:17.895170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe3986a9e9145cf84307bd58ca71f37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.895944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe3986a9e9145cf84307bd58ca71f37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:17.904915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4070/8095] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:17 2022] DELETE /identity/v3/users/2fe3986a9e9145cf84307bd58ca71f37 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:18.000141 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4026/8096] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:18.016049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:18.018099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:18.090793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a64aa-eb98-4596-8a38-a7d45019eee6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:18.094588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:18.095917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:18.095917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:18.095917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:18.171694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:18.173476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b1d23-e326-448e-bf0f-a0072cdaf419 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:18.183872 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4071/8097] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:18.388912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:18.392423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:18.417435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831899f6-a613-4bec-95cb-2c05965ae1b1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:18.423519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:18.425873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:18.426622 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:18.427689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] PATH_INFO: `/v3/projects/c737c998423f4e7785441ff046aed0a2` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:18.429236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c737c998423f4e7785441ff046aed0a2)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:18.431452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:18.682855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:18.710583 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c737c998423f4e7785441ff046aed0a2', 'request_id': 'req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:18.720077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c737c998423f4e7785441ff046aed0a2', 'request_id': 'req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:18.853497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c737c998423f4e7785441ff046aed0a2', 'request_id': 'req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:18.874608 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] The token cache is being invalidate because project c737c998423f4e7785441ff046aed0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:18.875926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:18.876602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-f86f59bd-f62b-4aa4-bbdb-b6948c7d97e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:18.878360 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4027/8098] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:18 2022] DELETE /identity/v3/projects/c737c998423f4e7785441ff046aed0a2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:18.885349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:18.888432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:18.888432 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:18.908867 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:18.910286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:18.987915 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4072/8099] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:18.998485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:18.998485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:18.998485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.031079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:19.031079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:19.052809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.058436 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4028/8100] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:19.069163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953c0b-f089-46cf-9a04-4e83ebbda627 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.087376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.089764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.092955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.093506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.094230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:04:19.094543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.096202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.118651 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4073/8101] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:04:19.123438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.138297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e07e0-a3ab-4fba-86c4-3ad8fff198ba None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.155338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.156180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.156744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.157170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.158095 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.161648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.307078 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4029/8102] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:19.308060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.319264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c4cb0-9809-4049-8874-d9ea4b94daaf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.392982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.404987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.404987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.404987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.404987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.404987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.493793 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4074/8103] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:19 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:19.498654 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.511059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e3af-9420-401f-b89f-011136882183 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.516558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.517351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.519751 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.520067 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.520764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.522359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.534121 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4030/8104] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:19.538296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.549823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbe2ee-a955-41de-9f74-205c960246c5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.555122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.555776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.556811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.556811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.557249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.558810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68089379-e241-49e2-a908-63c6a62076a7 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.572536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4075/8105] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:19.576687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:19.588679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e56b-3217-4d98-9257-e4d41384f9db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:19.594149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:19.595038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.595252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.595511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] PATH_INFO: `/v3/projects/61491c06413d4385afd9e7f35b7026df/users/62451d7dd91d4a719549e29e3b7e1aab/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.617040 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61491c06413d4385afd9e7f35b7026df, user_id=62451d7dd91d4a719549e29e3b7e1aab, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:19.620659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:19.688428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:19.737256 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4031/8106] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:19 2022] PUT /identity/v3/projects/61491c06413d4385afd9e7f35b7026df/users/62451d7dd91d4a719549e29e3b7e1aab/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:19.855775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:19.856162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:19.856390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:19.889803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] MFA Rules not processed for user `62451d7dd91d4a719549e29e3b7e1aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:19.891211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:19.986490 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4076/8107] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:19.987376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.057592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd960f6d-0ee3-44aa-84fb-bf0a27925297 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.063064 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.064074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.064074 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.064337 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:20.065120 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:20.067414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:20.235719 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4032/8108] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:19 2022] POST /identity/v3/projects => generated 393 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:20.242856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.290442 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e561dd5-2122-4cc5-8e80-691708e5c8f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.399169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.400223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.400701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.401203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:20.402283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:20.405449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:20.591094 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4077/8109] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:20 2022] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:20.595115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.606635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa9144-c1d1-457f-a8c4-daed47ab9bbe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.612465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.613691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.614236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.615103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:20.615956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:20.618018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:20.636252 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4033/8110] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:20.638397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.650163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309bd90-390b-4960-b0bd-50e5b294444b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.662288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.663429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.663937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.664706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] PATH_INFO: `/v3/projects/d92f685e47834bfdbe479a5b79ea6de4/users/0547b3952f184b548d369e729a9cadec/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:20.688842 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92f685e47834bfdbe479a5b79ea6de4, user_id=0547b3952f184b548d369e729a9cadec, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:20.692444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:20.813406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4078/8111] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:20 2022] PUT /identity/v3/projects/d92f685e47834bfdbe479a5b79ea6de4/users/0547b3952f184b548d369e729a9cadec/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:20.814639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.828096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255a8a6-8a40-4d85-92eb-bd4ea095cd19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.908240 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.909279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.909668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.909948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:20.910639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:20.912276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfdc6c-2abf-41dd-ad01-d0facee29364 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:20.930743 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4034/8112] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:20.932282 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:20.979400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bcc77-cc50-4747-92fb-cf4484fae4f5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:20.998381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:20.999222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:20.999510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:20.999793 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] PATH_INFO: `/v3/projects/d92f685e47834bfdbe479a5b79ea6de4/users/0547b3952f184b548d369e729a9cadec/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:21.003495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92f685e47834bfdbe479a5b79ea6de4, user_id=0547b3952f184b548d369e729a9cadec, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:21.008035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:21.037432 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4079/8113] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:20 2022] PUT /identity/v3/projects/d92f685e47834bfdbe479a5b79ea6de4/users/0547b3952f184b548d369e729a9cadec/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:21.044659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071a40-3989-4979-8e5b-0e0f57d25015 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:21.045220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071a40-3989-4979-8e5b-0e0f57d25015 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:21.045220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef071a40-3989-4979-8e5b-0e0f57d25015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:21.088383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ef071a40-3989-4979-8e5b-0e0f57d25015 None None] MFA Rules not processed for user `0547b3952f184b548d369e729a9cadec`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:21.090028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ef071a40-3989-4979-8e5b-0e0f57d25015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:21.246498 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4035/8114] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:21.267455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:21.269531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:21.397264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974eded-4df7-4ac0-ac59-448ad6c96cdf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:21.406271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:21.407983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:21.408337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:21.408745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:21.515650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:21.571245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:21.574471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:21.595231 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4080/8115] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:22.803366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:23.809855 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:24.375956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:25.179211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:25.671380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:26.754962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:27.591652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.253327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.534022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.588216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.755970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.808030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:28.827897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:28.828133 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:28.828411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:28.898897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:28.900400 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:28.921995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:29.058616 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4036/8116] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:29.063843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:29.065335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:29.071415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:29.226048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03512e-e7c9-468a-8e0d-e30877d0943e service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:29.238583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:29.239249 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:29.239531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:29.239915 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:29.241839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:29.245829 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:29.409530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:29.416751 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4081/8117] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:29 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:29.424803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:29.439547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d172e5b7-fd11-427a-8b16-32d513acd259 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:29.590286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:29.591323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:29.591856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:29.592709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:29.593415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:29.597273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:29.760513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4037/8118] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:29 2022] POST /identity/v3/users => generated 295 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:29.761759 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:29.790217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f4b9b-0607-4985-828c-c200464a1d5c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:29.804457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:29.805315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:29.805751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:29.806159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:29.806961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:29.808745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:29.825694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4082/8119] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:29.833109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:29.847943 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744cf73-4922-4b41-911c-f2fe5f8cac27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:29.853864 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:29.856605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:29.856605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:29.856605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] PATH_INFO: `/v3/projects/2c39594f88664c80b2e6e2774152f315/users/7bcb87c7fea541a9b6a41e5ed0aa9df0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:29.875089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c39594f88664c80b2e6e2774152f315, user_id=7bcb87c7fea541a9b6a41e5ed0aa9df0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:29.878487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:29.972696 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4038/8120] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:29 2022] PUT /identity/v3/projects/2c39594f88664c80b2e6e2774152f315/users/7bcb87c7fea541a9b6a41e5ed0aa9df0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:29.976914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:29.992343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb734ef-e4a5-4435-943c-47903d62ce4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:30.099377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:30.101141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:30.101597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:30.103838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:30.109773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:30.109773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:30.118540 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4083/8121] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:30.122570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:30.134160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35afd64-7f4c-4cdc-b710-189c57a10802 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:30.139729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:30.140397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:30.140710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:30.140990 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] PATH_INFO: `/v3/projects/2c39594f88664c80b2e6e2774152f315/users/7bcb87c7fea541a9b6a41e5ed0aa9df0/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:30.143062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c39594f88664c80b2e6e2774152f315, user_id=7bcb87c7fea541a9b6a41e5ed0aa9df0, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:30.145883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:30.158314 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4039/8122] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:30 2022] PUT /identity/v3/projects/2c39594f88664c80b2e6e2774152f315/users/7bcb87c7fea541a9b6a41e5ed0aa9df0/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:04:30.917936 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:31.261988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:31.264880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:31.366343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4111d-b3fc-4d56-892e-a3aad06da4ea admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:31.449502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:31.453033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:31.453320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:31.453598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:31.660437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:31.661951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e34f-894b-49ae-9060-a4f765d0a132 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:31.668745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:31.700097 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4084/8123] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:04:33.390740 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:33.568003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:34.519896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:35.316312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:36.898786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:37.020296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:39.051136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:39.202150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:39.647212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:39.649176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:39.800326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4b961-1880-40c6-a821-a4394e40a760 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:39.807017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:39.807697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:39.807982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:39.808266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] PATH_INFO: `/v3/users/41b090032eaa4c3592512dff315bfcb0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:39.810702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b090032eaa4c3592512dff315bfcb0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:39.814438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:40.166343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b090032eaa4c3592512dff315bfcb0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.367532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b090032eaa4c3592512dff315bfcb0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.449185 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:40.449550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.450036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.450159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.459788 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b090032eaa4c3592512dff315bfcb0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.461685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b090032eaa4c3592512dff315bfcb0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.465283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-c033c83a-93f8-42d8-8661-d1e808786d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b090032eaa4c3592512dff315bfcb0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:40.512573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] MFA Rules not processed for user `62451d7dd91d4a719549e29e3b7e1aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:40.514396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.588439 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4040/8124] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:39 2022] DELETE /identity/v3/users/41b090032eaa4c3592512dff315bfcb0 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:40.598648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:40.599150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:40.601563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:40.644876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:40.646397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.669242 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4085/8125] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:40.736345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:40.750062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.752604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:40.819307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4041/8126] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:40.849823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:40.851902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:41.007328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2f37b-314a-44be-abe5-eb1add051768 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:41.017811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:41.021688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:41.021981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:41.022255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:41.050551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:41.058174 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:41.058945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593bbff-21d4-4c63-84e8-59fc9e3810f0 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:41.087316 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4042/8127] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:04:41.266393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:41.271182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:41.271651 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:41.271935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:41.275750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:41.567297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:41.570510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6514c-2f7d-4ee0-bd20-c5876512133b service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:41.593982 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4086/8128] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:41.816993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:42.215712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:42.217627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:42.240970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498ffbe-454d-49e4-b94c-57864fffb6d9 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:42.248358 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:42.250066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:42.250519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:42.251121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] PATH_INFO: `/v3/projects/f77b542ff1ec41efb0231aba11fe6039` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:42.252770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77b542ff1ec41efb0231aba11fe6039)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:42.256899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:42.257370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:42.257669 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:04:42.266245 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:04:42.267556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:04:42.268709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:42.270080 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4087/8129] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:04:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:04:42.552790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77b542ff1ec41efb0231aba11fe6039', 'request_id': 'req-62f8eae5-c135-453f-aa17-a8c0acd7db21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:42.566150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77b542ff1ec41efb0231aba11fe6039', 'request_id': 'req-62f8eae5-c135-453f-aa17-a8c0acd7db21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:42.591956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:42.671241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77b542ff1ec41efb0231aba11fe6039', 'request_id': 'req-62f8eae5-c135-453f-aa17-a8c0acd7db21'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:42.696147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] The token cache is being invalidate because project f77b542ff1ec41efb0231aba11fe6039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:42.700163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:42.701236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:42.702427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-62f8eae5-c135-453f-aa17-a8c0acd7db21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:42.712100 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4043/8130] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:42 2022] DELETE /identity/v3/projects/f77b542ff1ec41efb0231aba11fe6039 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:42.712806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:42.714634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:42.885796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb0156-1055-4eb7-8a6b-1bd9f65da783 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:42.893738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:42.894697 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:42.901541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:42.901541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] PATH_INFO: `/v3/users/1af8257b4ec3407bb596fdab3dfc41be` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:42.901541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af8257b4ec3407bb596fdab3dfc41be)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:42.901541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:43.186437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af8257b4ec3407bb596fdab3dfc41be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:43.265356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af8257b4ec3407bb596fdab3dfc41be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:43.289775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af8257b4ec3407bb596fdab3dfc41be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:43.313844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af8257b4ec3407bb596fdab3dfc41be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:43.324332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af8257b4ec3407bb596fdab3dfc41be'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:43.338126 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4088/8131] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:04:42 2022] DELETE /identity/v3/users/1af8257b4ec3407bb596fdab3dfc41be => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:43.727204 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:43.728509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:43.729020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:43.854519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] MFA Rules not processed for user `7bcb87c7fea541a9b6a41e5ed0aa9df0`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:43.856373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:44.037902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:44.079548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4044/8132] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:44.086814 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:44.089106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:44.234696 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1308c-6286-4342-83fd-10734ac84275 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:44.242183 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:44.243766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:44.244403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:44.244986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:44.269387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:44.275992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:44.295511 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4089/8133] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:44.306859 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:44.310664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:44.437570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef043c-0c3c-475d-a9b0-6b621e603636 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:44.443005 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:44.443828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:44.444252 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:44.444753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] PATH_INFO: `/v3/projects/0b97113e9bf343339238c877ca7f28d4` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:44.448034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b97113e9bf343339238c877ca7f28d4)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:44.450368 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:44.707273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b97113e9bf343339238c877ca7f28d4', 'request_id': 'req-657698df-c5ab-4916-a23b-2b0c59222b6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:44.712216 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:44.714373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:44.725209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b97113e9bf343339238c877ca7f28d4', 'request_id': 'req-657698df-c5ab-4916-a23b-2b0c59222b6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:44.749969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eab71-2f2d-432d-a7e1-a269bfa26312 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:44.886173 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:44.887574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:44.887937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:44.888133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:44.892545 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:44.907233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b97113e9bf343339238c877ca7f28d4', 'request_id': 'req-657698df-c5ab-4916-a23b-2b0c59222b6c'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:44.983784 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] The token cache is being invalidate because project 0b97113e9bf343339238c877ca7f28d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:04:44.984075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:44.985601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-657698df-c5ab-4916-a23b-2b0c59222b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:04:44.992181 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4045/8134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:04:44 2022] DELETE /identity/v3/projects/0b97113e9bf343339238c877ca7f28d4 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:44.993534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:44.993814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:44.994089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.019262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:45.027179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:45.078229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:45.079739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d2dbb-5361-4e02-a923-77bf39d8857d service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:45.107740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:45.122819 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4090/8135] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:04:45.191338 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4046/8136] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:45.201131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:45.202116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:45.202828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.259077 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:45.263783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:45.283372 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4091/8137] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:45.284813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:45.324914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220355b4-deed-4389-9dc9-fd11740a8419 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:45.335944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:45.338356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:45.338804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:45.339331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.340443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:04:45.345514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:45.358429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:45.382590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4047/8138] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:04:45.388453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:45.401007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031bdc9-f4e1-4b8b-a0a9-5fe9b343ef00 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:45.417634 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:45.418309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:45.418587 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:45.418853 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.419520 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:45.421816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:45.699209 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4092/8139] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:45 2022] POST /identity/v3/projects => generated 383 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:45.705739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:45.726126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af045f4-22a9-42de-aaca-749c540b6192 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:45.846059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:45.848673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:45.849672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:45.850547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:45.851525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:45.857455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.009389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4048/8140] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:45 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:46.013737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.028103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b4594-6da5-44b8-b573-dbd3aebc0115 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:46.034767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:46.035572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.035967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.036307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.037109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:46.038954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.070652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:46.087331 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4093/8141] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:46.088683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.108183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1804-7825-4f27-958d-936b4ebabd8b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:46.119211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:46.119993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.120347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.123072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.123921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:46.134815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d399214-0504-4fa4-a816-c2583ba6333c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.158115 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4049/8142] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:46.159984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.177252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1f544-d397-41ae-a8cd-d3c284f36da9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:46.186874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:46.188742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.189252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.190028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] PATH_INFO: `/v3/projects/ba0b0f64f278402bb4efd4ea97eef351/users/140cab7e690a44eeaf605ebe3ee7cefa/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.233304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0b0f64f278402bb4efd4ea97eef351, user_id=140cab7e690a44eeaf605ebe3ee7cefa, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:46.238895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.411807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4094/8143] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:46 2022] PUT /identity/v3/projects/ba0b0f64f278402bb4efd4ea97eef351/users/140cab7e690a44eeaf605ebe3ee7cefa/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:46.425181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.425819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.426295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.504285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] MFA Rules not processed for user `140cab7e690a44eeaf605ebe3ee7cefa`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:46.505698 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:46.624227 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4050/8144] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:46.630064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.710570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf84e-2122-4810-907f-d29d02163b85 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:46.729565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:46.730820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:46.733919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:46.734401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:46.735298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:46.740886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:46.930271 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4095/8145] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:46 2022] POST /identity/v3/projects => generated 385 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:46.935536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:46.951647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:46.953045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797f84-23b3-47d0-b91f-6ec1210dabf6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.111402 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.112061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.112356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.112665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.119341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:47.119341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:47.327305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:47.333635 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4051/8146] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:46 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:47.344872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742eea-ac75-4037-909d-ae11a5d0bf05 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.357414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.359985 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.362719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.367493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.367493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:47.367493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:47.424010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:47.438694 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4096/8147] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:47.441737 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800b57e-2ed3-4e70-98c1-8359b8b6acf0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.479611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.480419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.484926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.484926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.484926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:47.484926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:47.522542 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4052/8148] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:47.529557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:47.553613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad24633-ed54-4e11-b629-76ca98cab6b4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.590275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.591040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.591242 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.591744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] PATH_INFO: `/v3/projects/58b965bf36f8491c93c5712722c610f6/users/f47cae8332724feb912426faafe8e416/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.627630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b965bf36f8491c93c5712722c610f6, user_id=f47cae8332724feb912426faafe8e416, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:47.630674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d95905-c3f3-4647-890e-4b4cfb166fe9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:47.717442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:47.723156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:47.747324 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4097/8149] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:47 2022] PUT /identity/v3/projects/58b965bf36f8491c93c5712722c610f6/users/f47cae8332724feb912426faafe8e416/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:47.748878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.750534 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.750825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.834897 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] MFA Rules not processed for user `f47cae8332724feb912426faafe8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:47.840712 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:47.882267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a63c-b598-455e-9092-17f0a2192f0c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:47.907281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:47.988149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:47.989995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:47.990532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:47.991037 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:47.996850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:47.999739 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4098/8150] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:48.004854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:48.155308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b4965-a042-469f-91e5-5abaeedb257a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:48.168777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:48.170758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:48.171391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:48.171885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:48.172966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:48.175707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:48.181215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:48.183858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:48.229105 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4053/8151] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:04:48.330876 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4099/8152] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:04:48 2022] POST /identity/v3/projects => generated 385 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:04:48.335773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:48.365166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a156-e6f6-409c-83a0-6e18e68ff717 service cinder] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:48.595865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:48.597292 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:48.597752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:48.598835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:48.600241 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:48.603653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:48.822031 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4054/8153] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:04:48 2022] POST /identity/v3/users => generated 299 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:04:48.826492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:48.845596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0483a6b-de1d-4b5c-a1a1-2346caa2d0bc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:48.856349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:48.858319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:48.859710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:48.872244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:48.872244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:48.872244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:48.901254 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4100/8154] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:04:48.904233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:48.936415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2390d-cdf6-40c4-b5f3-f38896899f5f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:48.953925 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:48.977511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:48.981929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:48.982549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] PATH_INFO: `/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc/users/e7f7981d07224f65a900ce7c6ac2fe65/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:49.028435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed40eed5a4a41618f9e72ecb56488dc, user_id=e7f7981d07224f65a900ce7c6ac2fe65, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:49.033953 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:49.118988 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4055/8155] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:48 2022] PUT /identity/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc/users/e7f7981d07224f65a900ce7c6ac2fe65/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:49.124026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:49.143526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ff531-5756-4cb0-bd8c-1a2110a5292d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:49.419789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:49.425648 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:49.426794 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:49.427666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:49.429715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:49.435746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05072c53-681b-41c4-828c-14b38b2211b3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:49.486460 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4101/8156] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:04:49.491329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:49.545944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cf099-e509-4c35-879c-095ee6387b2c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:49.552601 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:49.553774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:49.554497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:49.554932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] PATH_INFO: `/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc/users/e7f7981d07224f65a900ce7c6ac2fe65/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:49.559077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed40eed5a4a41618f9e72ecb56488dc, user_id=e7f7981d07224f65a900ce7c6ac2fe65, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:49.562183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:49.584442 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4056/8157] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:04:49 2022] PUT /identity/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc/users/e7f7981d07224f65a900ce7c6ac2fe65/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:04:49.599900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8f24-6806-4b97-920a-45f86d32eba8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:49.600665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8f24-6806-4b97-920a-45f86d32eba8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:49.601215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb8f24-6806-4b97-920a-45f86d32eba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:49.649766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b1eb8f24-6806-4b97-920a-45f86d32eba8 None None] MFA Rules not processed for user `e7f7981d07224f65a900ce7c6ac2fe65`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:49.654227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b1eb8f24-6806-4b97-920a-45f86d32eba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:49.710799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:49.762684 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4102/8158] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:49.771591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:49.861278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5c0f-d2ba-4d20-a571-ff8e59f2cb20 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:49.867251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:49.868101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:49.868380 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:49.868845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:49.891581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:49.893511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4a4d6-1acd-4ade-8819-a12f4d09075c service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:49.918166 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4057/8159] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:50.545194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:51.018785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:51.019967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:51.020440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:51.046112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:04:51.048456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:04:51.135929 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4103/8160] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:04:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:04:51.673752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:51.862861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998273-b741-4e30-a67f-b01008429fb2 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:51.863278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998273-b741-4e30-a67f-b01008429fb2 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:51.863524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998273-b741-4e30-a67f-b01008429fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-dd998273-b741-4e30-a67f-b01008429fb2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:04:51.870058 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:04:51.871184 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:04:51.875425 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4058/8161] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:04:51 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:04:52.967667 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:04:52.986296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778229f-b7f5-45f2-9a85-e402a6b663f8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:04:52.991779 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:04:52.992709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:04:52.993162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:04:52.993600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:04:53.069188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:04:53.070964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ff91c-bcd5-47ff-aae3-134df788b0c9 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:04:53.104786 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4104/8162] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:04:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:04:53.445674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:53.741793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:55.899076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:56.857582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:57.818806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:59.358459 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:00.726463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:01.887773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:01.887773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:01.887773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:02.002595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:02.002595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:02.002595 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4059/8163] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:02.113284 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:03.306623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d918ab-1492-43bd-a77d-84d1b2dc1808 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:03.306623 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d918ab-1492-43bd-a77d-84d1b2dc1808 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:03.317226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d918ab-1492-43bd-a77d-84d1b2dc1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-64d918ab-1492-43bd-a77d-84d1b2dc1808 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:03.329040 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:03.330302 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:05:03.337981 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4105/8164] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:03 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 32 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:05:03.488165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:04.373091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=21 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:04.894883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:04.898553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:04.959307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426147-bcce-4ba0-b9a2-51be2ed1282e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:04.970141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:04.971665 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:04.972378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:04.973071 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:05.166409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:05.171778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e1bb1-0d03-43e3-91db-fcbe2e3f0470 service cinder] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:05.251854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4060/8165] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:08.191141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:08.191714 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:08.192100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:08.276792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] MFA Rules not processed for user `62451d7dd91d4a719549e29e3b7e1aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:08.290266 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:08.553650 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4106/8166] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:09.168956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:09.169882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:09.170370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:09.181759 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:09.183511 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:05:09.189072 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4061/8167] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:05:15.219305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=59 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:17.644885 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:17.777402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9df77-9a73-4e42-bed7-331cee5e3d4b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:17.784348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:17.785564 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:17.786088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:17.786818 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] PATH_INFO: `/v3/users/140cab7e690a44eeaf605ebe3ee7cefa` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:17.788756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140cab7e690a44eeaf605ebe3ee7cefa)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:17.791500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:18.171060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140cab7e690a44eeaf605ebe3ee7cefa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:18.381109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140cab7e690a44eeaf605ebe3ee7cefa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:18.429718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140cab7e690a44eeaf605ebe3ee7cefa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:18.454016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140cab7e690a44eeaf605ebe3ee7cefa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:18.486671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140cab7e690a44eeaf605ebe3ee7cefa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:18.516026 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4107/8168] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:17 2022] DELETE /identity/v3/users/140cab7e690a44eeaf605ebe3ee7cefa => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:05:18.519299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:18.519299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:18.519299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:18.537956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:18.540782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:18.664808 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4062/8169] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:18.678354 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:18.680403 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:18.736732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:18.837671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2464b6b-79ab-47fa-8c37-820aad8c5957 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:18.847480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:18.851895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:18.851895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:18.851895 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:18.868858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:18.872480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:18.892107 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4108/8170] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:05:19.579969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:19.582600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:19.603355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c3d11-3320-431b-9f16-74df7124d2f6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:19.630878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:19.632709 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:19.635806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:19.635806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] PATH_INFO: `/v3/projects/ba0b0f64f278402bb4efd4ea97eef351` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:19.636649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0b0f64f278402bb4efd4ea97eef351)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:19.642885 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:19.839675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0b0f64f278402bb4efd4ea97eef351', 'request_id': 'req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:19.849590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0b0f64f278402bb4efd4ea97eef351', 'request_id': 'req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.049623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0b0f64f278402bb4efd4ea97eef351', 'request_id': 'req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.072261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] The token cache is being invalidate because project ba0b0f64f278402bb4efd4ea97eef351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:20.073707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.074716 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.077071 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4063/8171] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:19 2022] DELETE /identity/v3/projects/ba0b0f64f278402bb4efd4ea97eef351 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:20.082689 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:20.096166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265b900-96e5-4dd8-8482-7664c8f217eb service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:20.178694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:20.179801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:20.180311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:20.180856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] PATH_INFO: `/v3/users/f47cae8332724feb912426faafe8e416` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:20.183862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47cae8332724feb912426faafe8e416)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:20.189470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:20.677736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47cae8332724feb912426faafe8e416'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.803671 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47cae8332724feb912426faafe8e416'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.826333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47cae8332724feb912426faafe8e416'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.836470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47cae8332724feb912426faafe8e416'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.837324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47cae8332724feb912426faafe8e416'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:20.845182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4109/8172] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:20 2022] DELETE /identity/v3/users/f47cae8332724feb912426faafe8e416 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:21.681937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:21.685787 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:21.718105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3232561-fcb6-4baa-bac3-2a2b2a74ae53 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:21.863606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:21.864329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:21.866495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:21.866849 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] PATH_INFO: `/v3/projects/58b965bf36f8491c93c5712722c610f6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:21.870725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b965bf36f8491c93c5712722c610f6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:21.875988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:22.027168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:22.065061 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b965bf36f8491c93c5712722c610f6', 'request_id': 'req-e1587227-4dc6-4b35-9c74-2ccc380527df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:22.099052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b965bf36f8491c93c5712722c610f6', 'request_id': 'req-e1587227-4dc6-4b35-9c74-2ccc380527df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:22.666771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b965bf36f8491c93c5712722c610f6', 'request_id': 'req-e1587227-4dc6-4b35-9c74-2ccc380527df'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:22.718511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] The token cache is being invalidate because project 58b965bf36f8491c93c5712722c610f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:22.720092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:22.723239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:22.736591 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4064/8173] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:21 2022] DELETE /identity/v3/projects/58b965bf36f8491c93c5712722c610f6 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:05:22.745376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:22.746231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:22.792617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb49e11-33bc-469d-a52c-4d6d6cac61dc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:22.908509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:22.960857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:22.960857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:22.960857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:22.960857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] PATH_INFO: `/v3/users/e7f7981d07224f65a900ce7c6ac2fe65` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:22.963063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f7981d07224f65a900ce7c6ac2fe65)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:22.966882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:23.305986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f7981d07224f65a900ce7c6ac2fe65'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:23.492123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f7981d07224f65a900ce7c6ac2fe65'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:23.540685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f7981d07224f65a900ce7c6ac2fe65'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:23.557345 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f7981d07224f65a900ce7c6ac2fe65'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:23.558470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1257f3aa-9da6-4011-97e0-5adc12cd3f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f7981d07224f65a900ce7c6ac2fe65'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:23.573969 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4110/8174] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:22 2022] DELETE /identity/v3/users/e7f7981d07224f65a900ce7c6ac2fe65 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:24.449728 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:24.453216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:24.511481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1587227-4dc6-4b35-9c74-2ccc380527df admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:24.642929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:24.644569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:24.644858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:24.645134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] PATH_INFO: `/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:24.646606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed40eed5a4a41618f9e72ecb56488dc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:24.648793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:24.798505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed40eed5a4a41618f9e72ecb56488dc', 'request_id': 'req-7a797419-83c2-47c0-8d47-877f889625dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:24.810021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed40eed5a4a41618f9e72ecb56488dc', 'request_id': 'req-7a797419-83c2-47c0-8d47-877f889625dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:24.926691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed40eed5a4a41618f9e72ecb56488dc', 'request_id': 'req-7a797419-83c2-47c0-8d47-877f889625dd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:24.969604 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] The token cache is being invalidate because project 2ed40eed5a4a41618f9e72ecb56488dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:24.973237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:24.980467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7a797419-83c2-47c0-8d47-877f889625dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:24.983590 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4065/8175] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:24 2022] DELETE /identity/v3/projects/2ed40eed5a4a41618f9e72ecb56488dc => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:24.990572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:24.991822 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:24.992281 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:25.023576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:25.025279 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:25.153703 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4111/8176] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:25.276986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:25.278250 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:25.278773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:25.320545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:25.323172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:25.338424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4066/8177] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:25.342590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:25.354329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb21a0-c5ef-4594-b97f-038ede0c75c8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:25.362701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:25.363386 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:25.363741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:25.364172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:25.366873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:25.372524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:25.374333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:25.389578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4112/8178] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:25.400261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:25.414976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabcb68-45df-4b87-b1d3-1540d1bc8273 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:25.420299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:25.421117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:25.421394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:25.422048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:25.423562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:25.426627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:25.582201 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4067/8179] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:25 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:25.587258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:25.631265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42122f-377f-4629-aea9-6efbe1e7d275 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:25.732516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:25.743369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:25.744526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:25.745067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:25.745500 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:25.746536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:25.748975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:25.956198 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4113/8180] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:25 2022] POST /identity/v3/users => generated 295 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:05:25.959749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:25.991569 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7faf5-7a14-43cd-a015-4b855779c375 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:25.998670 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:25.999955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.005261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.005261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.005261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:26.005261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:26.027057 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4068/8181] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:26.027706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:26.040421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986456da-339f-45e0-a1c8-e70fb07dc8fc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:26.050855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:26.051636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.059392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.059392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.059392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:26.059392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47353f-8bf1-4278-9af2-b925a9fc04ca admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:26.074989 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4114/8182] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:05:26.079395 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:26.088691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:26.095472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ca38-5dae-485b-b6ce-05c83e7206f3 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:26.100812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:26.101511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.102913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.102913 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] PATH_INFO: `/v3/projects/1bdd5540830e483a8364970ff36db950/users/7f843fce1db44f51a4c25d7bd06c1fc5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.125648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bdd5540830e483a8364970ff36db950, user_id=7f843fce1db44f51a4c25d7bd06c1fc5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:26.128995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:26.241089 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4069/8183] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:26 2022] PUT /identity/v3/projects/1bdd5540830e483a8364970ff36db950/users/7f843fce1db44f51a4c25d7bd06c1fc5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:26.253891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.254258 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.254540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.320294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] MFA Rules not processed for user `7f843fce1db44f51a4c25d7bd06c1fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:26.322219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:26.441806 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4115/8184] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:26.445982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:26.594790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba40b-15c0-4505-9e19-850ee8770904 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:26.603207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:26.604693 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:26.604881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:26.605148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:26.605802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:26.608008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:26.882114 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4070/8185] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:26 2022] POST /identity/v3/projects => generated 389 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:26.887642 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:26.911451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65f6e5-572e-4666-8692-2934bc259d07 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:27.048907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:27.049724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:27.049902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:27.050178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:27.050857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:27.053140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:27.245725 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4116/8186] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:26 2022] POST /identity/v3/users => generated 301 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:05:27.251974 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:27.276218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1008754-cc7d-47b9-89a0-187919881338 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:27.288919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:27.292758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:27.292758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:27.292758 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:27.294677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:27.298238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:27.347287 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4071/8187] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:27.357115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:27.400946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566384c0-6a9d-4b25-887e-cfe24d105595 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:27.419892 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:27.421059 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:27.422292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:27.422292 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] PATH_INFO: `/v3/projects/a34b6a79e6c44b91915b8bcac211d1df/users/28afedf4b23d4300b80427d984457c5b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:27.462635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b6a79e6c44b91915b8bcac211d1df, user_id=28afedf4b23d4300b80427d984457c5b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:27.468344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:28.054885 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4117/8188] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:27 2022] PUT /identity/v3/projects/a34b6a79e6c44b91915b8bcac211d1df/users/28afedf4b23d4300b80427d984457c5b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:28.061950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:28.077657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3748dc12-bcf6-4b8c-a239-1c18d9785c33 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:28.198168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:28.198168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:28.198168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:28.199491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:28.199491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:28.202726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714183a-57c1-46d6-9000-1f2027a7a717 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:28.233228 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4072/8189] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:28.234686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:28.272828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dade08-b477-40ca-a9a2-d077e44de277 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:28.305588 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:28.308940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:28.310304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:28.317955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] PATH_INFO: `/v3/projects/a34b6a79e6c44b91915b8bcac211d1df/users/28afedf4b23d4300b80427d984457c5b/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:28.317955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34b6a79e6c44b91915b8bcac211d1df, user_id=28afedf4b23d4300b80427d984457c5b, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:28.317955 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:28.339964 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4118/8190] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:28 2022] PUT /identity/v3/projects/a34b6a79e6c44b91915b8bcac211d1df/users/28afedf4b23d4300b80427d984457c5b/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:05:28.357186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:28.357541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:28.357822 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:28.404414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] MFA Rules not processed for user `28afedf4b23d4300b80427d984457c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:28.406310 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:28.483707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:28.564127 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4073/8191] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:28.578612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:28.581996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:28.613135 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:28.700071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f0024-80c8-433d-80fe-a61717f3ffb2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:28.706003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:28.707037 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:28.707387 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:28.707672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:28.721599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:28.723469 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd1b8-e991-4e13-ac38-d4911c42f175 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:28.748765 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4119/8192] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:29.112432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:29.279565 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96a53-e2e5-4600-8cab-1ee470a3fd50 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:29.289488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:29.290729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:29.292794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:29.296785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] PATH_INFO: `/v3/users/7f843fce1db44f51a4c25d7bd06c1fc5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:29.301298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f843fce1db44f51a4c25d7bd06c1fc5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:29.306620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:29.643649 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f843fce1db44f51a4c25d7bd06c1fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:29.972025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f843fce1db44f51a4c25d7bd06c1fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.010031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f843fce1db44f51a4c25d7bd06c1fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.010884 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f843fce1db44f51a4c25d7bd06c1fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.018430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f843fce1db44f51a4c25d7bd06c1fc5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:30.032423 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4074/8193] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:29 2022] DELETE /identity/v3/users/7f843fce1db44f51a4c25d7bd06c1fc5 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:30.039043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.039926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.039926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.084100 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:30.085809 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:30.233918 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4120/8194] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:30.246959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:30.248639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:30.417782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf479d7-d402-43bb-a41c-e3e6b0547b24 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:30.431464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:30.432352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:30.432989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:30.432989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:30.454169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:30.457043 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:30.464266 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:30.492766 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4075/8195] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:31.667803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:31.671687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:31.751169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06d176-ee01-4523-8c50-ca1dfa94ba3b None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:31.770533 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:31.771841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:31.772397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:31.776316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] PATH_INFO: `/v3/projects/1bdd5540830e483a8364970ff36db950` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:31.783720 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bdd5540830e483a8364970ff36db950)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:31.794472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:32.098816 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdd5540830e483a8364970ff36db950', 'request_id': 'req-0bf80c6b-182b-4b48-9f94-d62df152d8ad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:32.166850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdd5540830e483a8364970ff36db950', 'request_id': 'req-0bf80c6b-182b-4b48-9f94-d62df152d8ad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:32.232316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdd5540830e483a8364970ff36db950', 'request_id': 'req-0bf80c6b-182b-4b48-9f94-d62df152d8ad'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:32.403970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] The token cache is being invalidate because project 1bdd5540830e483a8364970ff36db950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:32.404521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:32.408453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:32.418178 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4121/8196] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:31 2022] DELETE /identity/v3/projects/1bdd5540830e483a8364970ff36db950 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:32.424075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:32.454899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f2a4-ead1-4d26-be8b-ec9f44a9cf25 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:32.648161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:32.649947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:32.650932 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:32.651325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] PATH_INFO: `/v3/users/28afedf4b23d4300b80427d984457c5b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:32.653883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=28afedf4b23d4300b80427d984457c5b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:32.657320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:33.404085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28afedf4b23d4300b80427d984457c5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.651423 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28afedf4b23d4300b80427d984457c5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.674218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28afedf4b23d4300b80427d984457c5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.675392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28afedf4b23d4300b80427d984457c5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.676134 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-fb25ba4e-1a28-48a8-b35d-0db36a56d42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28afedf4b23d4300b80427d984457c5b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:33.700548 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4076/8197] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:05:32 2022] DELETE /identity/v3/users/28afedf4b23d4300b80427d984457c5b => generated 0 bytes in 1277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:05:35.014043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:35.015730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:35.051182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80c6b-182b-4b48-9f94-d62df152d8ad admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:35.160576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:35.191871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:35.193811 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.214860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.220790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] PATH_INFO: `/v3/projects/a34b6a79e6c44b91915b8bcac211d1df` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.220790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34b6a79e6c44b91915b8bcac211d1df)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:35.220790 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:35.478852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34b6a79e6c44b91915b8bcac211d1df', 'request_id': 'req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:35.513813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34b6a79e6c44b91915b8bcac211d1df', 'request_id': 'req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:35.538631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34b6a79e6c44b91915b8bcac211d1df', 'request_id': 'req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:35.688011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] The token cache is being invalidate because project a34b6a79e6c44b91915b8bcac211d1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:05:35.688449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:35.691475 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-e79f5b2f-fb4a-4190-bfb4-f3d8543a7050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:05:35.704067 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4122/8198] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:05:35 2022] DELETE /identity/v3/projects/a34b6a79e6c44b91915b8bcac211d1df => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:35.708087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e60db-f011-4410-9add-524609d487b1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:35.709166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e60db-f011-4410-9add-524609d487b1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:35.709609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e60db-f011-4410-9add-524609d487b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:35.757089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-330e60db-f011-4410-9add-524609d487b1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:35.763048 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-330e60db-f011-4410-9add-524609d487b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:36.085487 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4077/8199] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:36.102319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:36.103208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:36.103208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:36.166275 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:36.172196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:36.214363 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4123/8200] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:36.219164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e60db-f011-4410-9add-524609d487b1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:36.237496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e60db-f011-4410-9add-524609d487b1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:36.255392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:36.257835 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:36.261852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:36.261852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:36.261852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:05:36.261852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:36.270511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:36.328554 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4078/8201] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:05:36.336007 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:36.443319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8075f06-97f4-4321-b17d-3d7f884ef1a9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:36.490665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:36.498699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:36.503372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:36.505956 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:36.515861 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:36.533482 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:36.827918 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4124/8202] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:05:36 2022] POST /identity/v3/projects => generated 373 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:36.834869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:36.857437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:36.891993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa8297-06b1-41b2-868e-887abd02eaff admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:37.098631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:37.103764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:37.105349 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:37.105873 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:37.106836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:37.113413 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:37.332694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:37.333868 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4079/8203] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:05:36 2022] POST /identity/v3/users => generated 287 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:05:37.366383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db720fe8-e00b-4a5c-a839-d9def5e9d062 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:37.390504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:37.392658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:37.395581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:37.396194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:37.399962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:37.403323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:37.435341 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4125/8204] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:37.435868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:37.457438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d411-8ae0-4a8d-8112-960735b3ac79 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:37.479251 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:37.480756 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:37.501586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:37.502039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:37.502900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:37.505330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b829aa9-2e86-4374-95fd-3572db532082 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:37.535232 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4080/8205] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:05:37.543713 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:37.615399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c4b61-70b0-423f-b555-91341770e8cc admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:37.657140 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:37.660902 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:37.663851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:37.664795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] PATH_INFO: `/v3/projects/265437565d7341439bc5263a1291fb2b/users/ad70fb3b226f4873805138a965673672/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:37.782146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265437565d7341439bc5263a1291fb2b, user_id=ad70fb3b226f4873805138a965673672, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:37.799464 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:37.950741 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4126/8206] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:05:37 2022] PUT /identity/v3/projects/265437565d7341439bc5263a1291fb2b/users/ad70fb3b226f4873805138a965673672/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:05:37.961365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953826-a3ef-4591-884c-f80b52cb3c76 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:37.968089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953826-a3ef-4591-884c-f80b52cb3c76 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:37.969404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23953826-a3ef-4591-884c-f80b52cb3c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:38.040525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-23953826-a3ef-4591-884c-f80b52cb3c76 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:38.044220 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-23953826-a3ef-4591-884c-f80b52cb3c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:38.297846 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4081/8207] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:38.339982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:38.342743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:38.404160 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aed30-7353-4009-9d4c-85e5352d68eb None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:38.405119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aed30-7353-4009-9d4c-85e5352d68eb None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:38.406815 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512aed30-7353-4009-9d4c-85e5352d68eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:38.453069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-512aed30-7353-4009-9d4c-85e5352d68eb None None] MFA Rules not processed for user `62451d7dd91d4a719549e29e3b7e1aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:38.455725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-512aed30-7353-4009-9d4c-85e5352d68eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:38.545792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384884d6-3bfc-4a87-a52f-5fd4b5ad0a07 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:38.564436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:38.589355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:38.590323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:38.591014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:38.668416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:38.670523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:38.702352 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4082/8208] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:38.728796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4127/8209] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:05:41.037156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7d00-53bc-4d1e-9de1-06574c7b7d01 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.038687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7d00-53bc-4d1e-9de1-06574c7b7d01 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.039197 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd7d00-53bc-4d1e-9de1-06574c7b7d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.108236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d9dd7d00-53bc-4d1e-9de1-06574c7b7d01 None None] MFA Rules not processed for user `ad70fb3b226f4873805138a965673672`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:41.112875 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d9dd7d00-53bc-4d1e-9de1-06574c7b7d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:41.169508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:41.321605 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4083/8210] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:41.327440 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:41.329760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:41.364755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:41.558650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a899af9-7a36-4ca3-8efc-0b8af3a5847e service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:41.565900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:41.568523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:41.569335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:41.570179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:41.619366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:41.622921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3cc5e-71b2-4f24-8690-eedc7a7d84e2 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:41.658204 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4128/8211] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:45.326484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5293fb-f3c6-4afd-9728-05d52aff03e1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:45.328059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5293fb-f3c6-4afd-9728-05d52aff03e1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:45.328818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5293fb-f3c6-4afd-9728-05d52aff03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:45.363147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5a5293fb-f3c6-4afd-9728-05d52aff03e1 None None] MFA Rules not processed for user `ad70fb3b226f4873805138a965673672`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:45.365326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5a5293fb-f3c6-4afd-9728-05d52aff03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:45.384738 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4084/8212] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:47.348808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf37fb-0b7c-44de-b748-9d84d79e6639 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:47.349443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf37fb-0b7c-44de-b748-9d84d79e6639 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:47.350187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf37fb-0b7c-44de-b748-9d84d79e6639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-72cf37fb-0b7c-44de-b748-9d84d79e6639 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:47.374442 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.386787 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:05:47.410546 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4129/8213] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:05:47.423619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe824a2-4e06-421b-a41b-6390819973f9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:47.423619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe824a2-4e06-421b-a41b-6390819973f9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:47.423619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe824a2-4e06-421b-a41b-6390819973f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:47.482655 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3fe824a2-4e06-421b-a41b-6390819973f9 None None] MFA Rules not processed for user `ad70fb3b226f4873805138a965673672`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:47.483053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4453-8f99-4025-9311-164ee2ff4b4d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:47.483513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4453-8f99-4025-9311-164ee2ff4b4d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:47.483961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd4453-8f99-4025-9311-164ee2ff4b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:47.484671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3fe824a2-4e06-421b-a41b-6390819973f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:47.504872 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4085/8214] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-70cd4453-8f99-4025-9311-164ee2ff4b4d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:47.505663 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.506528 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:05:47.507585 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4130/8215] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 13:05:47.965763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314838d-cddd-4603-970c-70a0659897ef None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:47.966098 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314838d-cddd-4603-970c-70a0659897ef None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:47.966376 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314838d-cddd-4603-970c-70a0659897ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9314838d-cddd-4603-970c-70a0659897ef None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:47.980421 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:47.982509 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:05:48.010076 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4086/8216] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:47 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 29 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 13:05:53.098425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=22 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:53.428379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a694d-5f86-4d3e-8725-7806d460ee27 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:53.429961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a694d-5f86-4d3e-8725-7806d460ee27 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:53.430582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a694d-5f86-4d3e-8725-7806d460ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:53.527384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-808a694d-5f86-4d3e-8725-7806d460ee27 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:53.531555 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-808a694d-5f86-4d3e-8725-7806d460ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:53.749002 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4131/8217] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:54.047306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314838d-cddd-4603-970c-70a0659897ef None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:54.050304 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9314838d-cddd-4603-970c-70a0659897ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:54.333108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314838d-cddd-4603-970c-70a0659897ef None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:54.358702 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:54.360028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:54.360969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:54.361609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:54.388053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:54.392627 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:54.422349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4087/8218] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:05:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:05:57.693702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e25e4-9721-4dba-b3cc-efbc56fa5a0b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:57.695608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e25e4-9721-4dba-b3cc-efbc56fa5a0b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:57.696602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e25e4-9721-4dba-b3cc-efbc56fa5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:57.737783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-e62e25e4-9721-4dba-b3cc-efbc56fa5a0b None None] MFA Rules not processed for user `10227f104b254a91b4f14e9818244d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:05:57.741031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e62e25e4-9721-4dba-b3cc-efbc56fa5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:58.018893 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4132/8219] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:05:58.025826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:05:58.028344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:58.365277 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647858e-8ecb-4cd6-aec2-a5a1289aa664 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:05:58.381138 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:05:58.381869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:58.382213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:58.382606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:58.384805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:05:58.428430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:05:58.432137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:05:58.480246 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4088/8220] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:05:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:05:59.770601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b7d-2e10-4af5-aea9-81551fdee262 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:05:59.771299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b7d-2e10-4af5-aea9-81551fdee262 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:05:59.773320 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367b7d-2e10-4af5-aea9-81551fdee262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-aa367b7d-2e10-4af5-aea9-81551fdee262 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:05:59.786017 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:05:59.787416 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:05:59.793199 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4133/8221] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:05:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 24 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:06:07.965398 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=58 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:08.445130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:10.072796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:10.075582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:10.114899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a19ee9-94d7-4b06-9afe-bbd7796c3989 service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:10.129793 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:10.130559 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:10.131769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:10.132147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:10.137500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:10.158776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:10.161914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c6d84-6375-4438-a289-d4374e7c8009 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:10.179699 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4089/8222] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:20.173722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:23.522333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:23.523466 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:23.523788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:23.631918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] MFA Rules not processed for user `62451d7dd91d4a719549e29e3b7e1aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:23.634286 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:23.709142 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4134/8223] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:25.095137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:25.097086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:25.097664 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:06:25.122719 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:06:25.124564 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:06:25.136700 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4090/8224] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:06:25 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 44 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:06:25.487876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:25.491605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:25.557185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0011e2-e685-4e1f-95f9-5ab48ee740ac None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:25.563995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:25.565213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:25.565766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:25.566347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:25.569033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:25.655308 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:25.656984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c4858-6934-414d-9fd9-642410d3e55c service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:25.669175 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4135/8225] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:06:26.965030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:26.965575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:26.965575 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:26.995434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:26.996814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:27.131113 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4091/8226] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:28.813925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:28.815023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:28.816115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:06:28.826759 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:06:28.827789 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:06:28.833205 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4136/8227] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:06:28 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:06:36.030211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=36 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:37.106525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=25 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:38.190889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:38.201499 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:38.269669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea04374-ffc8-4077-ae20-0f4f15d7d497 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:38.286033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:38.287068 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:38.296826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:38.298985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] PATH_INFO: `/v3/users/10227f104b254a91b4f14e9818244d7d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:38.311832 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10227f104b254a91b4f14e9818244d7d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:38.323447 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:38.671366 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10227f104b254a91b4f14e9818244d7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:38.771623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10227f104b254a91b4f14e9818244d7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:38.814692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10227f104b254a91b4f14e9818244d7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:38.818419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10227f104b254a91b4f14e9818244d7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:38.822100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10227f104b254a91b4f14e9818244d7d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:38.895912 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4092/8228] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:38 2022] DELETE /identity/v3/users/10227f104b254a91b4f14e9818244d7d => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:39.668756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:39.670063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:39.870309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d77b4-ef41-42e5-ba13-9026168257b1 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:39.877109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:39.878180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:39.878872 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:39.879463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] PATH_INFO: `/v3/projects/9aa48be6894b4a5993e969472afe1396` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:39.881980 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa48be6894b4a5993e969472afe1396)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:39.886355 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:40.084560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:40.084560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:40.084560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572ee5-caf6-4bfb-9abf-1bc4b6724ae1 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:40.085780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:40.085780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:40.085780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:40.085780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] PATH_INFO: `/v3/users/62451d7dd91d4a719549e29e3b7e1aab` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:40.086164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62451d7dd91d4a719549e29e3b7e1aab)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:40.086164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:40.141607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa48be6894b4a5993e969472afe1396', 'request_id': 'req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.151404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa48be6894b4a5993e969472afe1396', 'request_id': 'req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.160698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa48be6894b4a5993e969472afe1396', 'request_id': 'req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.291203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] The token cache is being invalidate because project 9aa48be6894b4a5993e969472afe1396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:40.292324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.293719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.295629 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4137/8229] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:39 2022] DELETE /identity/v3/projects/9aa48be6894b4a5993e969472afe1396 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:40.301295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:40.303721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:40.431782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62451d7dd91d4a719549e29e3b7e1aab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.508739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004f5a6-a5e7-4f2f-85c5-eac24ca412d0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:40.518340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:40.519497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:40.520016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:40.520590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] PATH_INFO: `/v3/users/92cebcd11f264b638182090f5c57a02b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:40.523092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cebcd11f264b638182090f5c57a02b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:40.527419 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:40.543750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62451d7dd91d4a719549e29e3b7e1aab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.569722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62451d7dd91d4a719549e29e3b7e1aab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.570894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62451d7dd91d4a719549e29e3b7e1aab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.572140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-3e87bdc5-3de7-487c-b5ad-382d408c2db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62451d7dd91d4a719549e29e3b7e1aab'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:40.610557 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4093/8230] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:40 2022] DELETE /identity/v3/users/62451d7dd91d4a719549e29e3b7e1aab => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:40.610557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:40.610557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:40.611450 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:40.652372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:40.656998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:40.778464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:40.809572 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4094/8231] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:40.826780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:40.829609 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:40.954284 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:40.995652 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cebcd11f264b638182090f5c57a02b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.018755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375af773-a5df-4890-92a7-5760ae94e74b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:41.026177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:41.027630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:41.028570 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:41.029311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:41.052919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:41.056991 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:41.079575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4095/8232] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:06:41.112348 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cebcd11f264b638182090f5c57a02b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.147639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cebcd11f264b638182090f5c57a02b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.166673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cebcd11f264b638182090f5c57a02b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.168064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cebcd11f264b638182090f5c57a02b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.183298 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4138/8233] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:40 2022] DELETE /identity/v3/users/92cebcd11f264b638182090f5c57a02b => generated 0 bytes in 883 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:41.572893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:41.574196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:41.604718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcec44-dbfe-4d65-b784-7d346933c658 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:41.632301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:41.634079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:41.724066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:41.724837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:41.725172 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:41.727012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] PATH_INFO: `/v3/projects/61491c06413d4385afd9e7f35b7026df` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:41.729155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61491c06413d4385afd9e7f35b7026df)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:41.735321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:41.795430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e205e5c-4919-4651-a979-1fbfa9d8d12b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:41.804227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:41.805717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:41.806237 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:41.806746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] PATH_INFO: `/v3/projects/af21b0a3be4b48368cfade99cec6b57c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:41.808934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af21b0a3be4b48368cfade99cec6b57c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:41.813728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:41.889794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61491c06413d4385afd9e7f35b7026df', 'request_id': 'req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:41.900346 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61491c06413d4385afd9e7f35b7026df', 'request_id': 'req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.012897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61491c06413d4385afd9e7f35b7026df', 'request_id': 'req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.019774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af21b0a3be4b48368cfade99cec6b57c', 'request_id': 'req-d223f5c0-08a6-4c9f-8664-d57a48ea2269'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.034876 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af21b0a3be4b48368cfade99cec6b57c', 'request_id': 'req-d223f5c0-08a6-4c9f-8664-d57a48ea2269'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.035230 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] The token cache is being invalidate because project 61491c06413d4385afd9e7f35b7026df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:42.036110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.037010 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.039836 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4096/8234] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:41 2022] DELETE /identity/v3/projects/61491c06413d4385afd9e7f35b7026df => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:42.046053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:42.049640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:42.054254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af21b0a3be4b48368cfade99cec6b57c', 'request_id': 'req-d223f5c0-08a6-4c9f-8664-d57a48ea2269'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.165354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2ab4a-6603-4c3f-8fbd-a1e5c5976a8f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:42.169211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] The token cache is being invalidate because project af21b0a3be4b48368cfade99cec6b57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:42.170563 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.172171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d223f5c0-08a6-4c9f-8664-d57a48ea2269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.194484 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4139/8235] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:41 2022] DELETE /identity/v3/projects/af21b0a3be4b48368cfade99cec6b57c => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:42.347229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:42.348083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:42.348432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:42.348807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] PATH_INFO: `/v3/users/0547b3952f184b548d369e729a9cadec` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:42.350263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0547b3952f184b548d369e729a9cadec)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:42.368378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:42.411378 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:42.645993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0547b3952f184b548d369e729a9cadec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.755551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0547b3952f184b548d369e729a9cadec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.776993 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0547b3952f184b548d369e729a9cadec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.778614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0547b3952f184b548d369e729a9cadec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.779704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0547b3952f184b548d369e729a9cadec'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:42.783316 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:42.783602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:42.784086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:42.801710 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4097/8236] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:42 2022] DELETE /identity/v3/users/0547b3952f184b548d369e729a9cadec => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:42.842076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:42.849032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:42.955979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:42.997182 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4140/8237] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:43.017369 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:43.020202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:43.199714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c884a-8cbf-43dc-ace8-e0f2b5da35a8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:43.208298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:43.209354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.209919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.210857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:43.225861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:43.228959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:43.248557 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4098/8238] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:06:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:06:43.713002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:43.714657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:43.855364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9cdbd-1296-43a2-ad60-9a2022579fb9 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:43.860256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:43.861016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:43.861423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:43.861753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] PATH_INFO: `/v3/projects/d92f685e47834bfdbe479a5b79ea6de4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:43.863069 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92f685e47834bfdbe479a5b79ea6de4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:43.865499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:44.042492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92f685e47834bfdbe479a5b79ea6de4', 'request_id': 'req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:44.062291 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92f685e47834bfdbe479a5b79ea6de4', 'request_id': 'req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:44.070914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92f685e47834bfdbe479a5b79ea6de4', 'request_id': 'req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:44.182590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] The token cache is being invalidate because project d92f685e47834bfdbe479a5b79ea6de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:44.183447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:44.185459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:44.189792 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4141/8239] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:43 2022] DELETE /identity/v3/projects/d92f685e47834bfdbe479a5b79ea6de4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:44.725077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:50.093465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:50.095408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:50.130577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cfa46-e695-404b-9a3b-2ba3bfde6857 service swift] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:50.253639 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:50.254635 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:50.255300 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:50.255750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] PATH_INFO: `/v3/users/ad70fb3b226f4873805138a965673672` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:50.257119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad70fb3b226f4873805138a965673672)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:50.259766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:50.589498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad70fb3b226f4873805138a965673672'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:50.760255 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad70fb3b226f4873805138a965673672'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:50.781836 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad70fb3b226f4873805138a965673672'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:50.782982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad70fb3b226f4873805138a965673672'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:50.783632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5c3e2d50-d05d-4bd5-ab95-10b74642744d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad70fb3b226f4873805138a965673672'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:50.804669 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4099/8240] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:06:50 2022] DELETE /identity/v3/users/ad70fb3b226f4873805138a965673672 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:51.158404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:51.161459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:51.197468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0f55f-d5e4-46fa-84d6-dc65d89fd0e8 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:51.339891 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:51.341068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:51.341536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:51.342021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] PATH_INFO: `/v3/projects/265437565d7341439bc5263a1291fb2b` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:51.344166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265437565d7341439bc5263a1291fb2b)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:51.348013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:51.387838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:51.562879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265437565d7341439bc5263a1291fb2b', 'request_id': 'req-75153484-a657-43f3-8157-81a7ef1f2e93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:51.576900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265437565d7341439bc5263a1291fb2b', 'request_id': 'req-75153484-a657-43f3-8157-81a7ef1f2e93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:51.588452 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265437565d7341439bc5263a1291fb2b', 'request_id': 'req-75153484-a657-43f3-8157-81a7ef1f2e93'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:51.707736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] The token cache is being invalidate because project 265437565d7341439bc5263a1291fb2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:06:51.707957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:51.708878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-75153484-a657-43f3-8157-81a7ef1f2e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:06:51.710754 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4142/8241] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:06:51 2022] DELETE /identity/v3/projects/265437565d7341439bc5263a1291fb2b => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:06:51.725503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:51.725503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:51.725503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:51.767753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:51.770840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:51.862605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:51.884245 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4100/8242] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:06:51.894989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:51.895447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:51.895839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:51.933917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:51.947068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:51.968807 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4143/8243] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:51.971536 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:51.990610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054bb77-b66f-4660-954a-ede0b387367e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.001333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.001798 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.002213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.002517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.003003 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:06:52.003408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.005083 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.021103 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4101/8244] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:06:52.034554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.046247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23132a2-eec8-444b-bfc9-6f84229f96c8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.057550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.057550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.057550 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.063552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.063552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.063552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.244916 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4144/8245] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:52.247173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.260532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebafbf-a4f3-4764-8640-15923e18d5cb admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.378824 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.380093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.380732 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.381352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.382710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.386746 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.513641 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4102/8246] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/users => generated 285 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:06:52.528609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.543456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd700e9-ff72-4626-a870-6e47e4247185 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.551786 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.552893 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.553905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.554352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.555185 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.557815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.575111 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4145/8247] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:52.580237 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.598415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248bffe-6926-47e6-a72e-7fb496076a27 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.614723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.615577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.623161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.623161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.623161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.623161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3205906d-8b6f-49cc-82c5-a1f67f867c95 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.643596 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4103/8248] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:06:52.649312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:52.670180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82c139-f208-44bb-bc00-2a852b90a5db admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:52.679513 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:52.681030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.681756 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.682510 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] PATH_INFO: `/v3/projects/4e1afbff632c4a93a46582d215b68e89/users/b09670c3c59c49c4a797e808d8de4ebc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.708852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1afbff632c4a93a46582d215b68e89, user_id=b09670c3c59c49c4a797e808d8de4ebc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:52.713862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:52.822519 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4146/8249] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:06:52 2022] PUT /identity/v3/projects/4e1afbff632c4a93a46582d215b68e89/users/b09670c3c59c49c4a797e808d8de4ebc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:06:52.838921 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb301-b626-42a9-81cd-ae9af2c5cdc9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:52.839506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb301-b626-42a9-81cd-ae9af2c5cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:52.839752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcb301-b626-42a9-81cd-ae9af2c5cdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:52.890763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-80bcb301-b626-42a9-81cd-ae9af2c5cdc9 None None] MFA Rules not processed for user `b09670c3c59c49c4a797e808d8de4ebc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:06:52.893265 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-80bcb301-b626-42a9-81cd-ae9af2c5cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:53.019715 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4104/8250] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:06:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:06:53.034917 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:06:53.038430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:06:53.135024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8af4e-84de-4bd3-b9e2-87402aae099f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:06:53.147912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:06:53.147912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:06:53.147912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:06:53.147912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:06:53.152333 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:06:53.154132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0c8f4-2b23-45e3-b2a8-f01ee008dc90 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:06:53.167427 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4147/8251] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:06:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:07:03.015968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:03.161211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:21.818489 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:21.819545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:21.819545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:21.856701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:07:21.857455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:21.953315 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4105/8252] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:07:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:07:22.324927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:22.325890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:22.325890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:07:22.336211 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:07:22.346612 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:07:22.354010 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4148/8253] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:07:22 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 14 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:07:31.943055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=25 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:48.061409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:07:48.061409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:48.061409 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51b568-3a58-4a62-877a-ef26aff848e4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:07:48.064647 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:07:48.065420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:07:48.065858 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:07:48.066154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:07:48.068029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:07:48.085086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:07:48.087988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea944aa-5ee1-48dd-98d2-e3bf0c160b07 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:07:48.106906 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4106/8254] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:07:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:07:58.096616 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=32 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:12.836945 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:12.839081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:12.958646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e9fde-4ca1-4db5-b3e8-e15de9621353 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:12.970597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:12.970597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:12.971321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:12.971321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:12.973546 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:13.055005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:13.057064 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28990c9-d979-4656-9772-21c29ad15167 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:13.067592 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4149/8255] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:08:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 655 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:08:13.502212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:13.503227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:13.503504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:13.537141 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] MFA Rules not processed for user `948c29a5d95c4ae1b44b3760eec4b344`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:13.539333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:13.559174 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4107/8256] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:08:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:13.998537 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:13.999399 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:14.007176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:08:14.014694 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:08:14.015951 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:08:14.018337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4150/8257] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:08:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:08:23.063040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=59 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:23.525890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:29.823487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:29.827281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:29.908100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4db03c-474c-4a9e-8416-a072ca4de8c4 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:29.912979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:29.913733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:29.914114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:29.914487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] PATH_INFO: `/v3/users/948c29a5d95c4ae1b44b3760eec4b344` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:29.915794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] RBAC: Authorizing `identity:delete_user(user_id=948c29a5d95c4ae1b44b3760eec4b344)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:29.918153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:30.110866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948c29a5d95c4ae1b44b3760eec4b344'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.214306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948c29a5d95c4ae1b44b3760eec4b344'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.234811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948c29a5d95c4ae1b44b3760eec4b344'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.235729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948c29a5d95c4ae1b44b3760eec4b344'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.236528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948c29a5d95c4ae1b44b3760eec4b344'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.258502 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4108/8258] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:08:29 2022] DELETE /identity/v3/users/948c29a5d95c4ae1b44b3760eec4b344 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:30.616636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:30.618685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:30.710744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:30.715655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:30.716305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:30.716608 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:30.716889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] PATH_INFO: `/v3/projects/0a42e2f895074311ba70e12d1b5eaeba` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:30.718054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a42e2f895074311ba70e12d1b5eaeba)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:30.719988 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:30.885693 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a42e2f895074311ba70e12d1b5eaeba', 'request_id': 'req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.893038 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a42e2f895074311ba70e12d1b5eaeba', 'request_id': 'req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:30.900425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a42e2f895074311ba70e12d1b5eaeba', 'request_id': 'req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.038489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] The token cache is being invalidate because project 0a42e2f895074311ba70e12d1b5eaeba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:08:31.038903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.039763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.042136 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4151/8259] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:08:30 2022] DELETE /identity/v3/projects/0a42e2f895074311ba70e12d1b5eaeba => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:31.046747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:31.063151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b3ea-0ccb-436a-a80f-dc9efc4985db admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:31.164771 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:31.165626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:31.165790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:31.166053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] PATH_INFO: `/v3/users/7bcb87c7fea541a9b6a41e5ed0aa9df0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:31.167307 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcb87c7fea541a9b6a41e5ed0aa9df0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:31.169343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:31.198390 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:31.464982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcb87c7fea541a9b6a41e5ed0aa9df0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.555424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcb87c7fea541a9b6a41e5ed0aa9df0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.577619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcb87c7fea541a9b6a41e5ed0aa9df0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.584080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcb87c7fea541a9b6a41e5ed0aa9df0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.584080 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcb87c7fea541a9b6a41e5ed0aa9df0'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:31.614125 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4109/8260] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:08:31 2022] DELETE /identity/v3/users/7bcb87c7fea541a9b6a41e5ed0aa9df0 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:31.987948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:31.991701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:32.044369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a080-a44b-4d0e-be5d-0aec771bf6aa admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:32.188467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:32.189381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:32.189709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:32.190641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] PATH_INFO: `/v3/projects/2c39594f88664c80b2e6e2774152f315` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:32.192107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c39594f88664c80b2e6e2774152f315)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:32.194306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:32.373336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:32.390590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c39594f88664c80b2e6e2774152f315', 'request_id': 'req-a46816b6-7d62-4b3a-bf50-4c4d703dd950'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:32.403339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c39594f88664c80b2e6e2774152f315', 'request_id': 'req-a46816b6-7d62-4b3a-bf50-4c4d703dd950'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:32.419463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c39594f88664c80b2e6e2774152f315', 'request_id': 'req-a46816b6-7d62-4b3a-bf50-4c4d703dd950'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:32.584515 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] The token cache is being invalidate because project 2c39594f88664c80b2e6e2774152f315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:08:32.585579 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:32.587096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a46816b6-7d62-4b3a-bf50-4c4d703dd950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:32.606789 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4152/8261] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:08:31 2022] DELETE /identity/v3/projects/2c39594f88664c80b2e6e2774152f315 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:41.604370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:42.515610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:42.517856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:42.541245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116270c1-9212-4eee-a447-308b3ca07cbe admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:42.654090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:42.654090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:42.657870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:42.657870 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] PATH_INFO: `/v3/users/b09670c3c59c49c4a797e808d8de4ebc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:42.658054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:42.658961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09670c3c59c49c4a797e808d8de4ebc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:42.661374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:42.999178 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09670c3c59c49c4a797e808d8de4ebc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:43.123091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09670c3c59c49c4a797e808d8de4ebc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:43.156245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09670c3c59c49c4a797e808d8de4ebc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:43.157470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09670c3c59c49c4a797e808d8de4ebc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:43.158904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09670c3c59c49c4a797e808d8de4ebc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:43.191557 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4110/8262] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:08:42 2022] DELETE /identity/v3/users/b09670c3c59c49c4a797e808d8de4ebc => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:43.201517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:43.201517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:43.201517 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:43.242653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:43.244664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:43.357606 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4153/8263] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:43.369557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:43.371314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:43.464469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99a2f-4929-4c9d-afda-613c2b00c39c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:43.476063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:43.476063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:43.476617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:43.476617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:43.493159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:43.494675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6e1c-a2de-4c14-bf4c-54cb7663f115 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:43.521108 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4111/8264] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:44.198091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:44.201699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:44.224880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442c7a4-c58f-4eb5-abeb-18299b2ba577 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:44.233674 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:44.235736 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:44.238483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:44.239013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] PATH_INFO: `/v3/projects/4e1afbff632c4a93a46582d215b68e89` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:44.241806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1afbff632c4a93a46582d215b68e89)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:44.245424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:44.433930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1afbff632c4a93a46582d215b68e89', 'request_id': 'req-bf360abc-2a16-45be-8887-4d324158281d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:44.447000 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1afbff632c4a93a46582d215b68e89', 'request_id': 'req-bf360abc-2a16-45be-8887-4d324158281d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:44.459551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1afbff632c4a93a46582d215b68e89', 'request_id': 'req-bf360abc-2a16-45be-8887-4d324158281d'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:44.590067 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] The token cache is being invalidate because project 4e1afbff632c4a93a46582d215b68e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:08:44.590858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:44.591760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-bf360abc-2a16-45be-8887-4d324158281d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:08:44.606290 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4154/8265] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:08:44 2022] DELETE /identity/v3/projects/4e1afbff632c4a93a46582d215b68e89 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:08:44.606487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:44.606487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:44.606487 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:44.640721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:44.642853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:44.677384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:44.759284 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4112/8266] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:44.770909 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:44.778420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:44.778420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:44.798166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:44.799788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:44.812530 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4155/8267] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:44.820335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:44.841362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d51d0b-527b-4917-bb7f-18447c64cb68 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:44.852353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:44.853418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:44.854032 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:44.854528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:44.855545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:08:44.855983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:44.858810 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:44.896952 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4113/8268] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:08:44.899323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:44.916857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ae3ce-85b6-465c-9860-7bc676b18e17 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:44.926476 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:44.927470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:44.927996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:44.928638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:44.930158 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:44.933439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.063393 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4156/8269] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:08:44 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:08:45.068115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:45.088476 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656d51e-c51a-43af-b2b2-e8a70c9a453c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:45.193617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:45.194224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.194503 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.194780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.195648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:45.197966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.331288 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4114/8270] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:08:45 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:08:45.337235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:45.357189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc41bcf-9a2e-440f-8e71-eb9ef7e04016 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:45.366004 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:45.366838 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.367225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.367601 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.368423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:45.371878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.387839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4157/8271] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:08:45.393853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:45.411553 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb5ecc-af24-4dc2-8f9d-1f85efe8733b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:45.418551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:45.419600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.420049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.420430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.421245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:45.423182 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb9b14-021a-4728-a384-dd7bf3963b6b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.439014 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4115/8272] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:08:45.445715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:45.465133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e415204-9cd1-4f17-aa19-7e4e274767c1 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:45.476670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:45.476670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.476670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.476670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] PATH_INFO: `/v3/projects/ecd0f1631ded4df3a4c56ffbc6563729/users/eae16593bd014812aae990b9d5b2787a/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.508318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd0f1631ded4df3a4c56ffbc6563729, user_id=eae16593bd014812aae990b9d5b2787a, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:45.512819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.649441 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4158/8273] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:08:45 2022] PUT /identity/v3/projects/ecd0f1631ded4df3a4c56ffbc6563729/users/eae16593bd014812aae990b9d5b2787a/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:08:45.660517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.661170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.661170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.791892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] MFA Rules not processed for user `eae16593bd014812aae990b9d5b2787a`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:08:45.791892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:45.791892 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4116/8274] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:08:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:08:45.805611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:08:45.807997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:08:45.840560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:45.906175 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e23de-329c-447a-b271-b3310bf0836e admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:08:45.921987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:08:45.922629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:08:45.922910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:08:45.923186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:08:45.942019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:08:45.943556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:08:45.957062 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4159/8275] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:08:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:08:55.785968 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:56.340709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=22 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:00.888316 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:09:00.891438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:01.107769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da619-f6aa-432f-9d95-b0be505a8e3e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:09:01.114092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:09:01.114731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:01.115002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:01.115291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:01.117586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:01.135899 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:09:01.138096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ba05f-c81c-44e3-ae4b-47f202148169 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:09:01.158947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4117/8276] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:09:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:09:11.151302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=54 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:43.224716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:09:43.388411 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7378b-681d-4ab0-aeed-954f554c8d37 service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:09:43.396161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:09:43.397666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:43.397666 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:43.403265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] PATH_INFO: `/v3/users/eae16593bd014812aae990b9d5b2787a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:43.403265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae16593bd014812aae990b9d5b2787a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:09:43.403265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:09:43.612412 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae16593bd014812aae990b9d5b2787a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:43.681392 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae16593bd014812aae990b9d5b2787a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:43.701936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae16593bd014812aae990b9d5b2787a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:43.714887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae16593bd014812aae990b9d5b2787a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:43.716081 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae16593bd014812aae990b9d5b2787a'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:43.725495 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4160/8277] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:09:43 2022] DELETE /identity/v3/users/eae16593bd014812aae990b9d5b2787a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:09:43.731509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62756-5248-4e18-84eb-743446a035fd None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:43.732333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62756-5248-4e18-84eb-743446a035fd None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:43.732765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d62756-5248-4e18-84eb-743446a035fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:43.792846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-20d62756-5248-4e18-84eb-743446a035fd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:09:43.794223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20d62756-5248-4e18-84eb-743446a035fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:43.870854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4118/8278] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:09:43.882549 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:09:43.884024 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:43.956161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:43.975805 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a7f8e6-1c08-4b3f-a16a-a5b00cc62c5b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:09:43.982060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:09:43.983009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:43.983375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:43.983719 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:43.995626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:09:43.997463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:09:44.019551 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4161/8279] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:09:44.551076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d62756-5248-4e18-84eb-743446a035fd None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:09:44.552710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-20d62756-5248-4e18-84eb-743446a035fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:09:44.566477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d62756-5248-4e18-84eb-743446a035fd None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:09:44.573021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:09:44.573675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:09:44.574384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:09:44.574661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] PATH_INFO: `/v3/projects/ecd0f1631ded4df3a4c56ffbc6563729` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:09:44.576678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd0f1631ded4df3a4c56ffbc6563729)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:09:44.578778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:09:44.718375 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd0f1631ded4df3a4c56ffbc6563729', 'request_id': 'req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:44.726590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd0f1631ded4df3a4c56ffbc6563729', 'request_id': 'req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:44.806749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd0f1631ded4df3a4c56ffbc6563729', 'request_id': 'req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:44.822460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] The token cache is being invalidate because project ecd0f1631ded4df3a4c56ffbc6563729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:09:44.822460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:44.822460 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:09:44.822460 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4119/8280] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:09:44 2022] DELETE /identity/v3/projects/ecd0f1631ded4df3a4c56ffbc6563729 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:09:54.279017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=7 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:09:54.815393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=62,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:26.006541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:26.008047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:26.078276 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa85b20-c77c-4dcb-8c12-35c5172c61f2 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:26.132126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:26.132776 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:26.133080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:26.133356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:26.135531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:26.229088 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:26.230656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122109df-3602-407f-ae9b-23a23eeee61b service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:26.258316 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4162/8281] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:26.317360 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:26.318996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:26.413078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf136fc-a5f0-4bb3-b2b6-bd93d5cc603d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:26.419156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:26.419868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:26.420144 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:26.420444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] PATH_INFO: `/v3/users/cfc554a51c084c45805c44333f345b8d` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:26.422391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc554a51c084c45805c44333f345b8d)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:26.424382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:26.636477 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc554a51c084c45805c44333f345b8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:26.779169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc554a51c084c45805c44333f345b8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:26.794323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc554a51c084c45805c44333f345b8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:26.795129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc554a51c084c45805c44333f345b8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:26.795905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc554a51c084c45805c44333f345b8d'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:26.813000 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4120/8282] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:11:26 2022] DELETE /identity/v3/users/cfc554a51c084c45805c44333f345b8d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:11:26.818179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:26.818572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:26.818929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:26.840680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:26.841900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:26.884364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:26.910857 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4163/8283] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:26.923589 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:26.925427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.001919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aa90b-4c8b-4093-ba04-5773eaaac106 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:27.005680 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:27.006297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.006573 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.006828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.017645 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:27.019104 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d88d40-2813-4c19-a78f-a5925a52320f service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:27.029515 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4121/8284] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:27.328519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:27.332229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.343743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc27f8b-228e-4f87-8d3c-414f6bbbcf3d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:27.348824 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:27.349481 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.349757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.350031 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] PATH_INFO: `/v3/projects/34bf3744309d4381acf25152b0225203` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.351196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34bf3744309d4381acf25152b0225203)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:27.353361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:27.510149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34bf3744309d4381acf25152b0225203', 'request_id': 'req-fa0b912a-390a-460c-84da-b665f8a451f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:27.518782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34bf3744309d4381acf25152b0225203', 'request_id': 'req-fa0b912a-390a-460c-84da-b665f8a451f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:27.528430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34bf3744309d4381acf25152b0225203', 'request_id': 'req-fa0b912a-390a-460c-84da-b665f8a451f8'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:27.618233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] The token cache is being invalidate because project 34bf3744309d4381acf25152b0225203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:11:27.618755 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:27.620219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-fa0b912a-390a-460c-84da-b665f8a451f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:27.622839 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4164/8285] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:11:27 2022] DELETE /identity/v3/projects/34bf3744309d4381acf25152b0225203 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:27.630834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.631584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.631762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.669408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:27.698731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:27.700017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.778855 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4122/8286] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:27.787144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.787424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.787703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.808827 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:27.810063 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:27.818909 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4165/8287] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:27.824159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:27.836669 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f804c62-f8ec-4b5d-8490-e28d3d28b94c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:27.844273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:27.844948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.845226 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.845620 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.846640 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:11:27.847073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:27.848892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:27.862511 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4123/8288] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:11:27.867524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:27.878238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afaa5c6-aa84-41b8-97e4-10215a9bcf53 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:27.893122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:27.893731 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:27.894014 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:27.894283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:27.894939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:27.896887 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.065352 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4166/8289] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:11:27 2022] POST /identity/v3/projects => generated 373 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:11:28.070667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.082341 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e0811-82ca-4580-a425-108f9deaf8b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.161724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.162317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.162666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.163075 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.163890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.166233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.266543 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4124/8290] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:11:28 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:28.270813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.283330 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe1b92-9337-400e-b9be-bf86b5d60a0b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.288172 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.288898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.289178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.289456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.290255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.291879 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.304586 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4167/8291] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:28.309258 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.321001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91545e70-c212-4900-adbf-5ff7558f0e89 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.326283 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.327052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.327338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.327610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.328259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.329955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fddb07-28c1-4a25-b19e-6239d375c169 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.346320 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4125/8292] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:11:28.350688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.362735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308230b-a93d-4d6a-9964-99e7a5a6ae39 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.368079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.368799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.369107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.369347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] PATH_INFO: `/v3/projects/2405df08a5814a0b93833252927f13d3/users/9b03f5b4f9c740e3b378b6ad3ab62f4b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.389966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2405df08a5814a0b93833252927f13d3, user_id=9b03f5b4f9c740e3b378b6ad3ab62f4b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.392698 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.497822 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4168/8293] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:11:28 2022] PUT /identity/v3/projects/2405df08a5814a0b93833252927f13d3/users/9b03f5b4f9c740e3b378b6ad3ab62f4b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:28.514683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.514955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.515227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.547623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] MFA Rules not processed for user `9b03f5b4f9c740e3b378b6ad3ab62f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:28.548948 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:28.610086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:28.626708 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4126/8294] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:28.637142 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.639707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:28.710670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f256f49-8e56-418d-b1f8-a58abb80ca4f admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.722332 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.723060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.723382 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.723704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.731592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:28.736839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.739599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456991b6-bf32-4806-a058-0862bec9430f service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:28.757764 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4169/8295] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:28.787053 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:28.862199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f4e8-e25e-4f4f-9fc5-386f99fc5a07 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:28.867042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:28.867721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:28.868001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:28.868285 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] PATH_INFO: `/v3/users/9b03f5b4f9c740e3b378b6ad3ab62f4b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:28.869506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b03f5b4f9c740e3b378b6ad3ab62f4b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:28.871510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:29.079838 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b03f5b4f9c740e3b378b6ad3ab62f4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:29.172912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b03f5b4f9c740e3b378b6ad3ab62f4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:29.187908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b03f5b4f9c740e3b378b6ad3ab62f4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:29.188791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b03f5b4f9c740e3b378b6ad3ab62f4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:29.189418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b03f5b4f9c740e3b378b6ad3ab62f4b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:29.205874 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4127/8296] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:11:28 2022] DELETE /identity/v3/users/9b03f5b4f9c740e3b378b6ad3ab62f4b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:29.210823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:29.211187 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:29.211540 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:29.234523 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:29.235836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:29.314149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4170/8297] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:29.324797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:29.326243 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:29.414691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da6653-c3e0-4b80-8485-25909ac862c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:29.418738 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:29.419371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:29.419651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:29.419923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:29.430508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:29.432087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae4d4c-8180-491b-a5dc-7d20a336201c service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:29.444241 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4128/8298] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:29.955287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:29.957329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:29.973288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e4ae5-2cc9-44e8-99b7-b02a0fed38d3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:29.979116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:29.979871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:29.980223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:29.980602 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] PATH_INFO: `/v3/projects/2405df08a5814a0b93833252927f13d3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:29.982574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2405df08a5814a0b93833252927f13d3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:29.985548 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.158153 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2405df08a5814a0b93833252927f13d3', 'request_id': 'req-3f484309-7a8f-44a2-9e68-9eeafd45af86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:30.164944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2405df08a5814a0b93833252927f13d3', 'request_id': 'req-3f484309-7a8f-44a2-9e68-9eeafd45af86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:30.171352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2405df08a5814a0b93833252927f13d3', 'request_id': 'req-3f484309-7a8f-44a2-9e68-9eeafd45af86'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:30.252971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] The token cache is being invalidate because project 2405df08a5814a0b93833252927f13d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:11:30.253254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:30.253952 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-3f484309-7a8f-44a2-9e68-9eeafd45af86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:30.255492 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4171/8299] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:11:29 2022] DELETE /identity/v3/projects/2405df08a5814a0b93833252927f13d3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:30.260861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.261540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.261540 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.282617 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:30.284002 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:30.294866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:30.348207 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4129/8300] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:30.357590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.357883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.358162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.380104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:30.381401 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:30.389326 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4172/8301] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:30.393750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.404463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28470137-d4cd-480c-a26d-73eabcba52ae None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.409854 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.410469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.410744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.411015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.411666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:11:30.411962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.413597 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.427435 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4130/8302] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:11:30.432455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.442931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a76d6-5918-485e-b19e-a4cd57c49b0a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.448136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.448774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.449060 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.449359 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.449989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.451904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.546953 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4173/8303] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:11:30 2022] POST /identity/v3/projects => generated 399 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:30.551320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.562652 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5606e1-36d8-4b60-9610-79146f7f6ba7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.622399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.623059 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.623468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.623755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.624987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.626964 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.758722 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4131/8304] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:11:30 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:30.763036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.774235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719de23a-f11c-4a8a-9770-25af62a1737d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.779599 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.780148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.780423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.780927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.781502 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.783186 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.794012 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4174/8305] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:30.798994 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.809520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364365e6-0d43-4712-a9e8-c64a610607f0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.814999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.815611 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.815897 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.816173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.816850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.818462 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9529a-be5d-4cd6-9fb1-4643d26fbac8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.829939 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4132/8306] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:30.834293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:30.844600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eeeec-1c3f-48df-883b-6a6e8f1ce27a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:30.849114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:30.849777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.850056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.850334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] PATH_INFO: `/v3/projects/793aa35b62424e02a251707383a53191/users/9a7c8ded8739448fa71b383028fb6997/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.866225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] RBAC: Authorizing `identity:create_grant(project_id=793aa35b62424e02a251707383a53191, user_id=9a7c8ded8739448fa71b383028fb6997, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:30.868957 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:30.944500 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4175/8307] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:11:30 2022] PUT /identity/v3/projects/793aa35b62424e02a251707383a53191/users/9a7c8ded8739448fa71b383028fb6997/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:30.955344 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:30.955584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:30.955954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:30.985995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] MFA Rules not processed for user `9a7c8ded8739448fa71b383028fb6997`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:30.987224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:31.058222 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4133/8308] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:31.067461 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:31.069206 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:31.089366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:31.135262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7007-380a-4473-bcb3-03e76134424b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:31.139314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:31.140029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:31.140329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:31.140639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:31.150225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:31.152232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de8a1b-0854-4698-8812-8adc8cf549a7 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:31.162911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4176/8309] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:41.050211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:41.174451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=19 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:42.628541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:42.712264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8f622-8f12-428f-88d7-731d596f4b58 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:42.721386 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:42.722060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:42.722329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:42.722607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] PATH_INFO: `/v3/users/9a7c8ded8739448fa71b383028fb6997` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:42.723837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7c8ded8739448fa71b383028fb6997)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:42.725966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:42.948958 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7c8ded8739448fa71b383028fb6997'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.013087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7c8ded8739448fa71b383028fb6997'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.028661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7c8ded8739448fa71b383028fb6997'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.029552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7c8ded8739448fa71b383028fb6997'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.031034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7c8ded8739448fa71b383028fb6997'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.048043 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4134/8310] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:11:42 2022] DELETE /identity/v3/users/9a7c8ded8739448fa71b383028fb6997 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:43.052801 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:43.053379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:43.053379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:43.073658 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:43.075062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:43.141898 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4177/8311] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:43.164149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:43.164718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:43.233666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251320-727f-4724-9c4d-ad9011eaef17 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:43.237417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:43.238396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:43.238396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:43.238668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:43.252860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:43.254245 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373ffe8-c308-496f-a0a3-fdc66d6cbe4a service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:43.265101 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4135/8312] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:43.752253 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:43.753783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:43.773117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b90cb57-9009-4a51-b843-a0b216e97ff7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:43.779122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:43.779777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:43.780052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:43.780391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] PATH_INFO: `/v3/projects/793aa35b62424e02a251707383a53191` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:43.781511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=793aa35b62424e02a251707383a53191)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:43.783467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:43.895733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793aa35b62424e02a251707383a53191', 'request_id': 'req-ffe17d7c-b2be-4c93-976e-095c6e515bae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.902532 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793aa35b62424e02a251707383a53191', 'request_id': 'req-ffe17d7c-b2be-4c93-976e-095c6e515bae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.910159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793aa35b62424e02a251707383a53191', 'request_id': 'req-ffe17d7c-b2be-4c93-976e-095c6e515bae'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.995364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] The token cache is being invalidate because project 793aa35b62424e02a251707383a53191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:11:43.995665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.996511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-ffe17d7c-b2be-4c93-976e-095c6e515bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:11:43.998200 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4178/8313] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:11:43 2022] DELETE /identity/v3/projects/793aa35b62424e02a251707383a53191 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:53.260331 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:53.991883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:54.585254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:54.586115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:54.586279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:54.612717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:54.614025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:54.694635 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4136/8314] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:54.706774 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:54.707057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:54.707335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:54.738362 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:54.740402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:54.752858 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4179/8315] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:54.758484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:54.769963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f9daf-b3fd-4b04-8f22-78d3705e95c9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:54.775453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:54.776239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:54.776527 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:54.776806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:54.777485 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:11:54.777785 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:54.779988 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:54.794624 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4137/8316] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:11:54.813337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:54.823260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f960dc2-ed79-413f-8392-3ff0a3b23241 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:54.830970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:54.831680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:54.831953 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:54.832223 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:54.832943 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:54.835144 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:54.985087 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4180/8317] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:11:54 2022] POST /identity/v3/projects => generated 391 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:11:54.990467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.002211 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d81594-6740-48c2-9808-ff282f40c47c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.077723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.078275 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.078558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.078826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.079464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.081452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.161050 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4138/8318] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:11:54 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:55.165467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.176265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045b135-af5f-4485-bb84-3598c88ea196 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.181112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.181710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.181983 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.182259 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.182900 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.184541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.196666 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4181/8319] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:55.201145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.212679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45756fc9-bfea-41d2-831a-c977c62a593b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.217777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.218396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.218396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.219122 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.219568 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.221309 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a289204-da83-4bf2-843b-4f6f4c8884c5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.233485 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4139/8320] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:11:55.239211 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.250074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf4c40-d187-48c4-9c84-4537cd1bac41 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.254773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.255446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.255717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.256016 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] PATH_INFO: `/v3/projects/12989eef0a7c41a99a77eab4f44a1fec/users/ca39062f3b3145dca705e96334272975/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.272780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] RBAC: Authorizing `identity:create_grant(project_id=12989eef0a7c41a99a77eab4f44a1fec, user_id=ca39062f3b3145dca705e96334272975, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.275626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.424407 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4182/8321] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:11:55 2022] PUT /identity/v3/projects/12989eef0a7c41a99a77eab4f44a1fec/users/ca39062f3b3145dca705e96334272975/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:55.436905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.437184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.437437 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.473139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] MFA Rules not processed for user `ca39062f3b3145dca705e96334272975`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:55.474365 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:55.534451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:55.543997 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4140/8322] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:11:55.552273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.628379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b7ba5-7b1d-405e-813d-88f4221381de admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.639272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.639272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.639272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.639272 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.640114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.640114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.717388 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4183/8323] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:11:55 2022] POST /identity/v3/projects => generated 393 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:55.722194 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.734908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee04db0-f5ea-4894-80d5-198ae241e3c3 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.805140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.805846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.806189 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.806469 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.807108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.809100 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.955361 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4141/8324] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:11:55 2022] POST /identity/v3/users => generated 303 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:11:55.959835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:55.971317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438055a-4109-4bdc-b8e3-3340988e2c5c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:55.975875 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:55.976600 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:55.976880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:55.977151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:55.977787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:55.979391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:55.991730 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4184/8325] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:55.996325 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:56.007387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a477-456e-4923-a6ad-85cda54e17bf admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:56.012273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:56.012975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.013257 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.013595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] PATH_INFO: `/v3/projects/7ac63ec066c546f3bceda8877968fc0f/users/26bcf53003144899ba6477704f2b9b8e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.031452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac63ec066c546f3bceda8877968fc0f, user_id=26bcf53003144899ba6477704f2b9b8e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:56.034607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:56.171374 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4142/8326] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:11:55 2022] PUT /identity/v3/projects/7ac63ec066c546f3bceda8877968fc0f/users/26bcf53003144899ba6477704f2b9b8e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:56.177112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:56.188268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4facc74-8f2b-4a4f-a804-728b1d428c17 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:56.258193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:56.258844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.259149 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.259400 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.260065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:56.261752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e5c4-10df-4327-bf77-727dfdd6e897 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:56.273110 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4185/8327] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:11:56.281183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:56.290905 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b29e62-248e-4c59-a11a-3864f51d1025 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:56.296374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:56.297188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.297490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.297765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] PATH_INFO: `/v3/projects/7ac63ec066c546f3bceda8877968fc0f/users/26bcf53003144899ba6477704f2b9b8e/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.300033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac63ec066c546f3bceda8877968fc0f, user_id=26bcf53003144899ba6477704f2b9b8e, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:56.303024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e00151d-b490-4b28-a102-79e843e05bde admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:56.316128 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4143/8328] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:11:56 2022] PUT /identity/v3/projects/7ac63ec066c546f3bceda8877968fc0f/users/26bcf53003144899ba6477704f2b9b8e/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:11:56.328074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.328425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.328777 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.347916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:56.364204 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] MFA Rules not processed for user `26bcf53003144899ba6477704f2b9b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:56.365636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:56.445330 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4186/8329] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:56.459983 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.467537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.467537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.482482 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] MFA Rules not processed for user `ca39062f3b3145dca705e96334272975`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:11:56.483712 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:56.545418 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4144/8330] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:11:56.568979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:56.570845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:56.678395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772ecba-5f97-47ec-a0f8-d9fa1bae5d7a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:56.684255 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:56.684898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.685179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.685966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.697878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:56.699499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:56.710488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4187/8331] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:56.743091 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:56.744800 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:56.809190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c20b6-e8c8-4ba5-9366-df2802c2ffb9 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:56.813475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:56.814092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:56.814377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:56.814666 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:56.816453 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:56.828744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:56.834213 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:56.835691 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:56.850308 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4145/8332] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:11:57.475927 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:57.477626 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:57.490926 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:11:57.493396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:57.554061 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:57.577349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bd83e-7e7e-41c1-9116-f6c04b95f686 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:57.580411 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09af295-73d4-4708-8236-5ab807653b1f service glance] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:11:57.589365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:57.590011 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:57.590542 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:57.591121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:57.593375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:57.596424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:11:57.597109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:11:57.597393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:11:57.597668 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:11:57.599740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:11:57.617244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:57.618657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:57.619147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:11:57.620545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:11:57.636672 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4146/8333] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:11:57.643153 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4188/8334] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:01.783931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:01.798419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240e189-8267-4eae-87d7-9d98385479fe service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:01.802207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:01.802834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:01.803090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:01.803352 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:01.805119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:01.820984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:01.824889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:01.836054 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4147/8335] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:02.806487 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:02.827799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89f5f6-0d27-4132-b0d1-8cff27f40a8f service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:02.835907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:02.836657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:02.836934 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:02.837200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:02.839074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:02.861492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:02.863396 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:02.881624 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4189/8336] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:09.957385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:09.966522 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:09.981959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38ac7e-cc51-4525-ba0b-7143ff936a6e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:09.987742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:09.988345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:09.988657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:09.988934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:09.991026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:10.007273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:10.009314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e71f3-af05-4886-b362-8d0e51d2b311 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:10.023797 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4148/8337] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:12.100989 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:12.115622 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cb112-196e-450f-be24-c4f8b5d7ad52 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:12.121682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:12.122293 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.123243 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.123455 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.132509 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:12.134110 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:12.144454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4190/8338] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:12.160427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba922ef-b12a-413e-809e-771a9c0e4cef None None] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.161038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba922ef-b12a-413e-809e-771a9c0e4cef None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.161038 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba922ef-b12a-413e-809e-771a9c0e4cef None None] PATH_INFO: `/` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.162602 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4149/8339] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 13:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 13:12:12.167938 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] Authenticating service token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 13:12:12.183530 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:12.193115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d7582-3843-4b56-a370-2e6c47c0094c service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:12.198905 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26bcf53003144899ba6477704f2b9b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ac63ec066c546f3bceda8877968fc0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:12.199559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.199841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.200115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] PATH_INFO: `/v3/projects/7ac63ec066c546f3bceda8877968fc0f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.201336 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ac63ec066c546f3bceda8877968fc0f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:12.203238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72033453-c0f6-4973-aa8c-8c6b5cb5b3c8 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:12.204954 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4191/8340] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 13:12:12 2022] GET /identity/v3/projects/7ac63ec066c546f3bceda8877968fc0f => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:12.449195 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.449535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.449862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:12.456854 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:12.458114 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:12:12.459260 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4150/8341] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:12:12.655159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945262a1-190c-4f8a-bc3a-3d50d3f5c706 None None] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.655457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945262a1-190c-4f8a-bc3a-3d50d3f5c706 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.655704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945262a1-190c-4f8a-bc3a-3d50d3f5c706 None None] PATH_INFO: `/` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.657156 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4192/8342] 10.222.0.64 () {54 vars in 912 bytes} [Wed Nov 2 13:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 02 13:12:12.662458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] Authenticating service token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Nov 02 13:12:12.682672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:12.693528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c995036-20b6-4176-9e0f-6a1137b13633 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:12.698769 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26bcf53003144899ba6477704f2b9b8e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ac63ec066c546f3bceda8877968fc0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:12.699490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.699715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.699989 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] PATH_INFO: `/v3/projects/7ac63ec066c546f3bceda8877968fc0f` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.701723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ac63ec066c546f3bceda8877968fc0f)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:12.703555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:12.705326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4151/8343] 10.222.0.64 () {58 vars in 1443 bytes} [Wed Nov 2 13:12:12 2022] GET /identity/v3/projects/7ac63ec066c546f3bceda8877968fc0f => generated 393 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:12.940434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629be9-3329-4356-a190-32776621c01a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:12.940743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629be9-3329-4356-a190-32776621c01a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:12.941026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02629be9-3329-4356-a190-32776621c01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-02629be9-3329-4356-a190-32776621c01a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:12.948231 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:12.949467 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:12:12.951436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4193/8344] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:12:17.172866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:17.264857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e907a87-c341-429e-84ee-ef45b17d68ae tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:17.270687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:17.271340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:17.271615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:17.271893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] PATH_INFO: `/v3/users/ca39062f3b3145dca705e96334272975` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:17.275860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca39062f3b3145dca705e96334272975)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:17.275860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:17.476922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca39062f3b3145dca705e96334272975'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:17.571661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca39062f3b3145dca705e96334272975'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:17.581677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:17.587109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca39062f3b3145dca705e96334272975'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:17.587959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca39062f3b3145dca705e96334272975'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:17.591052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca39062f3b3145dca705e96334272975'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:17.603061 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4152/8345] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:17 2022] DELETE /identity/v3/users/ca39062f3b3145dca705e96334272975 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:17.608727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:17.609312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:17.609312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:17.630975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:17.632312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:17.707975 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4194/8346] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:17.718332 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:17.720869 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:17.786417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791f2c-db6f-4a8d-9d97-2469b143633e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:17.790264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:17.790890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:17.791173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:17.791445 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:17.803980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:17.805528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:17.817824 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4153/8347] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:18.220402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:18.222122 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:18.235044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cb388-f9b3-408c-a0be-46df0111e10f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:18.240428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:18.241179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:18.241462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:18.241744 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] PATH_INFO: `/v3/projects/12989eef0a7c41a99a77eab4f44a1fec` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:18.243050 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] RBAC: Authorizing `identity:delete_project(project_id=12989eef0a7c41a99a77eab4f44a1fec)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:18.246775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:18.458439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12989eef0a7c41a99a77eab4f44a1fec', 'request_id': 'req-2224606c-795d-4cd5-b030-78e262cd723b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:18.467457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12989eef0a7c41a99a77eab4f44a1fec', 'request_id': 'req-2224606c-795d-4cd5-b030-78e262cd723b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:18.473878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12989eef0a7c41a99a77eab4f44a1fec', 'request_id': 'req-2224606c-795d-4cd5-b030-78e262cd723b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:18.599828 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] The token cache is being invalidate because project 12989eef0a7c41a99a77eab4f44a1fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:18.600150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:18.600803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:18.602306 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4195/8348] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:18 2022] DELETE /identity/v3/projects/12989eef0a7c41a99a77eab4f44a1fec => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:18.606861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:18.620338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709f32-743b-45cb-8914-7664c597efd2 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:18.688796 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:18.689433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:18.689710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:18.689979 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] PATH_INFO: `/v3/users/26bcf53003144899ba6477704f2b9b8e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:18.691121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bcf53003144899ba6477704f2b9b8e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:18.693084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:19.038748 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bcf53003144899ba6477704f2b9b8e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.148909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bcf53003144899ba6477704f2b9b8e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.162092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bcf53003144899ba6477704f2b9b8e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.162782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bcf53003144899ba6477704f2b9b8e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.163481 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-393dc0e2-5388-48a7-8add-34289a1c6ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bcf53003144899ba6477704f2b9b8e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.178987 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4154/8349] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:18 2022] DELETE /identity/v3/users/26bcf53003144899ba6477704f2b9b8e => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:19.699017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:19.701254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:19.714812 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224606c-795d-4cd5-b030-78e262cd723b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:19.756233 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:19.785045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:19.785730 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:19.786166 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:19.786680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] PATH_INFO: `/v3/projects/7ac63ec066c546f3bceda8877968fc0f` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:19.787823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac63ec066c546f3bceda8877968fc0f)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:19.789787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:19.968620 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac63ec066c546f3bceda8877968fc0f', 'request_id': 'req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.975167 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac63ec066c546f3bceda8877968fc0f', 'request_id': 'req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:19.981379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac63ec066c546f3bceda8877968fc0f', 'request_id': 'req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:20.084733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] The token cache is being invalidate because project 7ac63ec066c546f3bceda8877968fc0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:20.085009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:20.085646 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-84f87761-ca81-4aa0-ad8f-36a07e0e5c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:20.087149 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4196/8350] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:19 2022] DELETE /identity/v3/projects/7ac63ec066c546f3bceda8877968fc0f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:20.093574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.094115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.094115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.103137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:20.114776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:20.116009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:20.190041 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4155/8351] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:20.199145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.199424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.199787 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.221757 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:20.222944 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:20.231761 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4197/8352] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:20.255177 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:20.267427 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b30b05-c27e-4b32-a0b1-ffa0804daa2d None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:20.272657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:20.273276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.273554 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.273816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.274472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:20.274809 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:20.276804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:20.291615 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4156/8353] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:12:20.297503 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:20.306936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f07a7-ca09-4fc3-999d-a88d43272b85 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:20.311888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:20.312570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.312850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.313121 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.314318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:20.316306 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:20.509746 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4198/8354] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:20 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:12:20.515426 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:20.527539 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a1cbd3-81da-4b0e-9ae9-56801c7329c0 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:20.593733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:20.594339 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.594614 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.594882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.595509 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:20.597529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:20.925827 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4157/8355] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:20 2022] POST /identity/v3/users => generated 290 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:20.930227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:20.941630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae8085-010c-4929-90ef-fdcb2fd095b6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:20.946820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:20.947521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:20.947847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:20.948201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:20.949012 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:20.950888 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:20.964436 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4199/8356] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:20.979501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:20.999175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3b6e5-d74c-43a3-acec-981e74895136 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:21.004831 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:21.005595 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:21.005977 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:21.006355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:21.007121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:21.009034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58fb96d-9c27-4adf-ad8b-8e12c0362d76 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:21.021575 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4158/8357] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:21.026219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:21.039019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a84680-9614-438e-a295-4f101e3d3417 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:21.044963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:21.045631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:21.045908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:21.046179 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] PATH_INFO: `/v3/projects/09d23c3964304a16bcd7080a9313a5fc/users/dbf340c36cd444a4894bff210de05764/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:21.061717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d23c3964304a16bcd7080a9313a5fc, user_id=dbf340c36cd444a4894bff210de05764, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:21.064437 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:21.155602 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4200/8358] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:21 2022] PUT /identity/v3/projects/09d23c3964304a16bcd7080a9313a5fc/users/dbf340c36cd444a4894bff210de05764/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:21.161082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bed7-cefe-4aec-ab07-0e304955babe None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:21.161602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bed7-cefe-4aec-ab07-0e304955babe None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:21.161602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bed7-cefe-4aec-ab07-0e304955babe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:21.181892 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8d51bed7-cefe-4aec-ab07-0e304955babe None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:21.183027 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8d51bed7-cefe-4aec-ab07-0e304955babe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:21.250533 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4159/8359] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:21.260352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:21.262270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:21.333425 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35b903-c111-4d2f-badd-1b44835f7842 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:21.338005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:21.338618 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:21.338890 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:21.339156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:21.354250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:21.354250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114278d1-2e27-43c1-a024-52c2f3661965 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:21.365819 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4201/8360] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:28.427335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:28.427956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:28.427956 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:28.459883 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:28.468947 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] MFA Rules not processed for user `dbf340c36cd444a4894bff210de05764`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:28.470335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:28.563389 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4160/8361] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:12:28.575991 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b0fd-cb10-445f-8170-d2f16fa1499b None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:28.576613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b0fd-cb10-445f-8170-d2f16fa1499b None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:28.576613 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0b0fd-cb10-445f-8170-d2f16fa1499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:28.588054 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:28.599750 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-0cd0b0fd-cb10-445f-8170-d2f16fa1499b None None] MFA Rules not processed for user `dbf340c36cd444a4894bff210de05764`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:28.603742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0cd0b0fd-cb10-445f-8170-d2f16fa1499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:28.608143 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4202/8362] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:28.622753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:28.624272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:28.721063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c834b-1f03-4b24-b84b-bdc9da6a14e1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:28.727046 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:28.727685 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:28.728022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:28.728222 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:28.739755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:28.741478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:28.752297 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4161/8363] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:29.130781 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:29.131150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:29.131423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:29.138496 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:29.139744 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:12:29.145450 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4203/8364] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:12:33.493150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:33.494878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:33.581937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f87f0-4a31-4231-af75-a2ea12c7dd0d service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:33.587034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:33.587630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:33.587904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:33.588186 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:33.589946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:33.606184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:33.621381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:33.621586 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4162/8365] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:33.661767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:33.675592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:33.680458 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:33.681150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:33.681435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:33.681708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] PATH_INFO: `/v3/users/dbf340c36cd444a4894bff210de05764` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:33.682855 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf340c36cd444a4894bff210de05764)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:33.685431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:33.897474 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf340c36cd444a4894bff210de05764'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:33.976710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf340c36cd444a4894bff210de05764'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:33.991329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf340c36cd444a4894bff210de05764'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:33.999368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf340c36cd444a4894bff210de05764'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.000152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-c3b86114-2d9d-4a06-8e26-cc12226df37a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf340c36cd444a4894bff210de05764'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.006183 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4204/8366] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:33 2022] DELETE /identity/v3/users/dbf340c36cd444a4894bff210de05764 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:34.276431 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:34.288448 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1b9d-1a90-4702-8277-369b30bcc538 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:34.301532 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=100 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:34.352273 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:34.353057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.353335 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.353607 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] PATH_INFO: `/v3/projects/09d23c3964304a16bcd7080a9313a5fc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.354744 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d23c3964304a16bcd7080a9313a5fc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:34.356678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:34.531834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d23c3964304a16bcd7080a9313a5fc', 'request_id': 'req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.538096 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d23c3964304a16bcd7080a9313a5fc', 'request_id': 'req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.611356 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d23c3964304a16bcd7080a9313a5fc', 'request_id': 'req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.624377 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] The token cache is being invalidate because project 09d23c3964304a16bcd7080a9313a5fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:34.624701 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.625397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-dbb0c6e7-8d61-4727-a886-11bb2a2fb294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:34.626984 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4163/8367] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:34 2022] DELETE /identity/v3/projects/09d23c3964304a16bcd7080a9313a5fc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:34.632254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.632571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.632860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.653815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:34.655078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:34.738752 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4205/8368] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:34.746401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.746688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.746966 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.767827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:34.769159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:34.777556 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4164/8369] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:34.782964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:34.793327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca310b9-d136-4809-ae35-10bbf725f5bd None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:34.798605 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:34.799200 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.799477 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.799804 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.800393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:34.800724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:34.802323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:34.814493 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4206/8370] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:12:34.819016 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:34.829175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e7fd6-9234-40e5-8dd4-90114ef9b2e7 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:34.834140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:34.834749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:34.835026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:34.835298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:34.835930 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:34.837908 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:34.927741 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4165/8371] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:34 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:34.932287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:34.943339 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6642540-bbc8-48ea-9877-d2dbd955b298 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.000858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:35.006946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.007568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.008023 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.008294 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.008971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.015865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.143990 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4207/8372] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:34 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:35.149707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.168110 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12e82e-bf0e-429d-ac8c-099b4fa6dd82 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.175890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.176632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.176880 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.177209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.177896 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.179808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.192016 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4166/8373] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:35.201990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.212468 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e279a8-3319-49ac-b972-9fa940eb7225 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.217334 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.217939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.218220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.218493 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.219125 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.220874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1758d2-579a-4665-ab68-94d1eb28a54a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.233127 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4208/8374] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:35.237683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.249986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ef09f-a811-4a51-b9b5-791315a88e08 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.254752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.255438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.255730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.255973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] PATH_INFO: `/v3/projects/6e7a1c1ebdbd4c6a917564a830970660/users/20c1d413bce041529061f61dd90fb073/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.275278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a1c1ebdbd4c6a917564a830970660, user_id=20c1d413bce041529061f61dd90fb073, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.280169 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.383139 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4167/8375] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:35 2022] PUT /identity/v3/projects/6e7a1c1ebdbd4c6a917564a830970660/users/20c1d413bce041529061f61dd90fb073/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:35.389001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f27ac-2d6e-4a6c-87f4-c7e5a147de68 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.389280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f27ac-2d6e-4a6c-87f4-c7e5a147de68 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.389554 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f27ac-2d6e-4a6c-87f4-c7e5a147de68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.417638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-376f27ac-2d6e-4a6c-87f4-c7e5a147de68 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:35.418775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-376f27ac-2d6e-4a6c-87f4-c7e5a147de68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:35.480031 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4209/8376] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:12:35.490741 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:35.492923 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:35.552449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:35.568051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f36c3-22b3-43f7-9fa4-caaaf089cf34 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:35.572338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:35.572984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:35.573318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:35.573562 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:35.583910 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:35.585576 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa9541-647b-4561-9c65-e1efd56cc2c9 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:35.598807 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4168/8377] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:42.062360 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:42.062911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:42.062911 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:42.098704 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] MFA Rules not processed for user `20c1d413bce041529061f61dd90fb073`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:42.100141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:42.198381 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4210/8378] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:42.211152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d0a8-750c-44a0-b895-c774270a7d79 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:42.211152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d0a8-750c-44a0-b895-c774270a7d79 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:42.211840 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284d0a8-750c-44a0-b895-c774270a7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:42.236124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0284d0a8-750c-44a0-b895-c774270a7d79 None None] MFA Rules not processed for user `20c1d413bce041529061f61dd90fb073`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:42.237478 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0284d0a8-750c-44a0-b895-c774270a7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:42.245011 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4169/8379] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:42.259426 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:42.261764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:42.350948 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:42.358971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56d4f4-5d8b-4366-9a40-dabbb258672d None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:42.364951 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:42.365594 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:42.365865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:42.366254 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:42.376045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:42.377808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0d20e-b74f-4b43-9cb8-17511bcb4410 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:42.387958 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4211/8380] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:42.672761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a514-2b74-46a2-8132-69c4affc79f8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:42.673126 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a514-2b74-46a2-8132-69c4affc79f8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:42.673468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64a514-2b74-46a2-8132-69c4affc79f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9f64a514-2b74-46a2-8132-69c4affc79f8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:42.682520 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:42.683619 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:12:42.686004 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4170/8381] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:42 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:12:42.724954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:42.725235 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:42.725505 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:42.746863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] MFA Rules not processed for user `20c1d413bce041529061f61dd90fb073`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:42.748913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:42.756909 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4212/8382] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:43.048435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:43.048435 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:43.048749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:43.057504 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:43.058918 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:12:43.062385 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4171/8383] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:43 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 15 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:12:47.312384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.314092 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:47.421322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f48f73-a167-49fe-91b8-9a236eed08f2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.428559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.429262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.429536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.429807 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.431921 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:47.450783 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.452544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:47.468095 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4213/8384] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:12:47.485299 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:47.505114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8390c3f-42c5-46ca-9714-017770812419 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:47.516165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:47.517056 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:47.517518 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:47.517850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] PATH_INFO: `/v3/users/20c1d413bce041529061f61dd90fb073` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:47.520030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c1d413bce041529061f61dd90fb073)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:47.522302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:47.782703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c1d413bce041529061f61dd90fb073'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.856183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c1d413bce041529061f61dd90fb073'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.876807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c1d413bce041529061f61dd90fb073'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.877676 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c1d413bce041529061f61dd90fb073'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.878571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-be92ccc0-d5fe-46fe-a731-44a0e721c554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c1d413bce041529061f61dd90fb073'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:47.893881 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4172/8385] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:12:47 2022] DELETE /identity/v3/users/20c1d413bce041529061f61dd90fb073 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:12:48.167485 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.181214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7b41-dd63-42ad-8e88-943c8d34b7b9 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.265042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.265703 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.266504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.266504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] PATH_INFO: `/v3/projects/6e7a1c1ebdbd4c6a917564a830970660` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.267789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7a1c1ebdbd4c6a917564a830970660)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.269529 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.398131 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7a1c1ebdbd4c6a917564a830970660', 'request_id': 'req-31df044a-4abf-42e6-9784-12757828b2b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.406457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7a1c1ebdbd4c6a917564a830970660', 'request_id': 'req-31df044a-4abf-42e6-9784-12757828b2b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.412912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7a1c1ebdbd4c6a917564a830970660', 'request_id': 'req-31df044a-4abf-42e6-9784-12757828b2b1'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.415577 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:48.537152 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] The token cache is being invalidate because project 6e7a1c1ebdbd4c6a917564a830970660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:12:48.537637 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.538091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-31df044a-4abf-42e6-9784-12757828b2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:12:48.539611 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4214/8386] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:12:48 2022] DELETE /identity/v3/projects/6e7a1c1ebdbd4c6a917564a830970660 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:48.551168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.551845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.551845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.581770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:48.583069 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:48.655606 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4173/8387] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:48.669639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.669639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.669639 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.697883 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:48.699344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:48.712618 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4215/8388] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:48.716667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.727556 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef895fb-ed07-430d-94ad-f04bd8fbd21c None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.732775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.733407 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.733672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.733934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.734582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:12:48.734877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.736525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.754282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4174/8389] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:12:48.759821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.775353 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fa606-a295-4981-9ff6-688736814736 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:48.786761 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:48.788899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:48.788899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:48.788899 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:48.790080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:48.793819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:48.961797 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4216/8390] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:48.965963 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:48.976783 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2c76-6d2f-4176-b9ab-e1e7ea74d476 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.014850 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:49.041102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.041715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.041995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.042268 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.042941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.044995 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.137087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4175/8391] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:12:48 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:12:49.142566 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.154225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707c0669-a136-4d44-be2b-31c2a5c2c107 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.158970 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.159570 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.159929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.160241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.160912 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.162607 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.174304 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4217/8392] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:12:49.178633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.190223 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b896f-d195-403e-89dc-9a3317e03936 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.195249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.195853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.196158 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.196428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.197124 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.198734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772822f-1d42-4670-9310-5d2f8d857e8e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.210070 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4176/8393] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:12:49.215161 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.226682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce241-5844-4f2e-89c3-1781d1cd54e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.231645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.232322 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.232638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.232940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] PATH_INFO: `/v3/projects/a31ce9d15a694d549202903d3761e616/users/61ab14de1670457cb831f8baa233bb18/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.249483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31ce9d15a694d549202903d3761e616, user_id=61ab14de1670457cb831f8baa233bb18, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.252151 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.377748 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4218/8394] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:12:49 2022] PUT /identity/v3/projects/a31ce9d15a694d549202903d3761e616/users/61ab14de1670457cb831f8baa233bb18/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:12:49.383505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.383901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.384244 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.404806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:49.406060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:49.474783 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4177/8395] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:49.486035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:49.490301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:49.565245 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934c701-c6c6-4784-87bb-bf38f5fd35f3 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:49.569053 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:49.569834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:49.570112 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:49.570372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:49.580297 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:49.581868 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d28f8b-1d33-4ac5-b7f6-f25f1953080c service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:49.592406 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4219/8396] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:51.948263 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:51.949772 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:52.081149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82674822-b992-4d31-97d5-10231bcb9b36 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:52.087166 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:52.088789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:52.088789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:52.088789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:52.092404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:52.109663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:52.111710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:52.126712 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4178/8397] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:55.819972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e0a8-ddd1-4164-bf14-008b5d4e5473 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:55.820784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e0a8-ddd1-4164-bf14-008b5d4e5473 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:55.820784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210e0a8-ddd1-4164-bf14-008b5d4e5473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:55.859381 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d210e0a8-ddd1-4164-bf14-008b5d4e5473 None None] MFA Rules not processed for user `61ab14de1670457cb831f8baa233bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:55.861376 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d210e0a8-ddd1-4164-bf14-008b5d4e5473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:55.944873 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4220/8398] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:55.960035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:12:55.964359 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:56.021207 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:56.053563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6bb7a5-b4d3-4056-ae74-7b5ea7ceb315 service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:12:56.059592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:12:56.061417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:56.061417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:56.061417 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:56.070495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:12:56.072111 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baa4aa-9f22-42ec-a6a8-f4f96083d456 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:12:56.083458 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4179/8399] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:12:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:12:58.956462 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:58.957962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:58.957962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:58.979595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] MFA Rules not processed for user `61ab14de1670457cb831f8baa233bb18`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:12:58.981406 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:12:58.992475 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4221/8400] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:12:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:12:59.369817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:12:59.370717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:12:59.370717 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:12:59.377884 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:12:59.379408 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:12:59.392235 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4180/8401] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:12:59 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 23 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:13:04.852815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:04.868815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794718e-8595-4726-a4ee-20f6ba04974a None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:04.877356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:04.877558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:04.877843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:04.878118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] PATH_INFO: `/v3/users/61ab14de1670457cb831f8baa233bb18` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:04.879672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ab14de1670457cb831f8baa233bb18)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:04.881990 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:04.895522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:05.089453 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ab14de1670457cb831f8baa233bb18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.158701 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ab14de1670457cb831f8baa233bb18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.172878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ab14de1670457cb831f8baa233bb18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.181383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ab14de1670457cb831f8baa233bb18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.182145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a8f45e9d-c5bd-4819-855b-b51df1b0dd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ab14de1670457cb831f8baa233bb18'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.188831 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4222/8402] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:04 2022] DELETE /identity/v3/users/61ab14de1670457cb831f8baa233bb18 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:05.463333 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:05.465261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:05.549279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97025e3-dcd5-4286-973a-b164ae7af457 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:05.554157 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:05.554802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:05.555077 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:05.555347 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] PATH_INFO: `/v3/projects/a31ce9d15a694d549202903d3761e616` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:05.556592 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31ce9d15a694d549202903d3761e616)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:05.558686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:05.710279 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31ce9d15a694d549202903d3761e616', 'request_id': 'req-2568a2fd-025d-4074-bcfd-722fc2c0b72b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.717282 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31ce9d15a694d549202903d3761e616', 'request_id': 'req-2568a2fd-025d-4074-bcfd-722fc2c0b72b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.849847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31ce9d15a694d549202903d3761e616', 'request_id': 'req-2568a2fd-025d-4074-bcfd-722fc2c0b72b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.863202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] The token cache is being invalidate because project a31ce9d15a694d549202903d3761e616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:05.863500 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.864190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-2568a2fd-025d-4074-bcfd-722fc2c0b72b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:05.865819 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4181/8403] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:05 2022] DELETE /identity/v3/projects/a31ce9d15a694d549202903d3761e616 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:05.882707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:05.883244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:05.883244 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:05.905044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:05.906749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:05.983727 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4223/8404] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:05.992914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:05.993217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:05.993364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.017130 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:06.018464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:06.027978 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4182/8405] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:06.032819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.044858 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7999d-1cfb-4b9b-8c9e-d42d486f87eb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.050017 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.050706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.051029 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.051327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.052026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:06.052352 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.054169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.069099 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4224/8406] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:13:06.074135 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.084681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c8d7c-4fff-4b6a-9128-84e1acec70ab None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.090089 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.090736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.091014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.091311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.092087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.094288 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.206627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4183/8407] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:06 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:13:06.211709 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.225099 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2becf-dcb5-4327-adfb-860a4d816892 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.294865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.295528 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.295687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.295967 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.296603 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.298907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.407275 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4225/8408] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:06 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:06.412648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.426731 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349e8d-67aa-4525-8229-1c49f716302f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.433547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.434272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.434650 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.435076 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.435860 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.437906 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.453230 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4184/8409] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:06.460052 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.469390 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:06.476051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40cdf-6eff-4b77-a92b-863608bf4ccd admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.486019 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.486815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.487171 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.487635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.488722 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.491374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd8ae3-c933-4dcb-8cb2-1daa1a4cb615 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.508328 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4226/8410] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:06.513216 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.525436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413fa1-3093-4c4c-96cb-f8e8ef27b1c6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.531762 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.532549 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.532837 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.533113 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] PATH_INFO: `/v3/projects/3f2d877784ae4806858c9a0baec1cc0e/users/90a02f4f51e449b280ec424c9e8ccf39/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.552108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2d877784ae4806858c9a0baec1cc0e, user_id=90a02f4f51e449b280ec424c9e8ccf39, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.554710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.667764 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:06.673992 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4185/8411] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:06 2022] PUT /identity/v3/projects/3f2d877784ae4806858c9a0baec1cc0e/users/90a02f4f51e449b280ec424c9e8ccf39/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:06.679270 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428d27-5f99-4ea5-8dc1-59bb46e4e237 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.679557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428d27-5f99-4ea5-8dc1-59bb46e4e237 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.679831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2428d27-5f99-4ea5-8dc1-59bb46e4e237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.701627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f2428d27-5f99-4ea5-8dc1-59bb46e4e237 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:06.704145 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f2428d27-5f99-4ea5-8dc1-59bb46e4e237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:06.772994 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4227/8412] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:06.784180 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:06.785912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:06.855678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf51da-2227-43f8-a8ac-5b0d120bb48d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:06.859797 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:06.860508 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:06.860866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:06.861152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:06.872102 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:06.873630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7a86e-823a-4910-a72c-3bb0cbcd25cf service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:06.884424 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4186/8413] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:13.279641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:13.279641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:13.280416 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:13.320365 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] MFA Rules not processed for user `90a02f4f51e449b280ec424c9e8ccf39`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:13.321641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:13.427612 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4228/8414] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:13:13.438801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42cdf-4fab-4afb-84d0-d0ef38d69d1a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:13.439385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42cdf-4fab-4afb-84d0-d0ef38d69d1a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:13.439385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b42cdf-4fab-4afb-84d0-d0ef38d69d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:13.462719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-16b42cdf-4fab-4afb-84d0-d0ef38d69d1a None None] MFA Rules not processed for user `90a02f4f51e449b280ec424c9e8ccf39`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:13.463984 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-16b42cdf-4fab-4afb-84d0-d0ef38d69d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:13.471465 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4187/8415] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:13:13.485806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:13.487283 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:13.590395 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448992fe-3878-4e7d-beca-0d5334b3f2a7 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:13.596096 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:13.597959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:13.598246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:13.598619 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:13.608374 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:13.610022 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:13.637265 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4229/8416] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:13:13.929471 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:13.929760 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:13.930034 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:13:13.936964 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:13:13.938959 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:13:13.940847 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4188/8417] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:13:13 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:13:18.618706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:18.631076 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bae9-285e-4c75-92fc-c09d9e3de7a3 service nova] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:18.636647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:18.637169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:18.637543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:18.637727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] PATH_INFO: `/v3/users/90a02f4f51e449b280ec424c9e8ccf39` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:18.638907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a02f4f51e449b280ec424c9e8ccf39)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:18.641215 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:18.643847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:18.890194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a02f4f51e449b280ec424c9e8ccf39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.021324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a02f4f51e449b280ec424c9e8ccf39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.035544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a02f4f51e449b280ec424c9e8ccf39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.043574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a02f4f51e449b280ec424c9e8ccf39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.044877 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-139a966d-df1a-4057-bfba-b3dbf76c049c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a02f4f51e449b280ec424c9e8ccf39'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.051054 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4230/8418] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:18 2022] DELETE /identity/v3/users/90a02f4f51e449b280ec424c9e8ccf39 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:19.308865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:19.310705 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:19.391090 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f1a74-36dd-4f13-a77f-1e56191e0e71 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:19.395937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:19.396648 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:19.396935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:19.397235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] PATH_INFO: `/v3/projects/3f2d877784ae4806858c9a0baec1cc0e` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:19.398433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2d877784ae4806858c9a0baec1cc0e)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:19.400394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:19.515959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2d877784ae4806858c9a0baec1cc0e', 'request_id': 'req-76f02cfc-ba9e-4f58-b86a-7170c531cba2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.526912 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2d877784ae4806858c9a0baec1cc0e', 'request_id': 'req-76f02cfc-ba9e-4f58-b86a-7170c531cba2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.643721 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2d877784ae4806858c9a0baec1cc0e', 'request_id': 'req-76f02cfc-ba9e-4f58-b86a-7170c531cba2'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.657581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] The token cache is being invalidate because project 3f2d877784ae4806858c9a0baec1cc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:19.657871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.658544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-76f02cfc-ba9e-4f58-b86a-7170c531cba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:19.660106 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4189/8419] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:19 2022] DELETE /identity/v3/projects/3f2d877784ae4806858c9a0baec1cc0e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:19.670047 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a417-8aed-4665-8c46-579654340352 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:19.671314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a417-8aed-4665-8c46-579654340352 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:19.671314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34a417-8aed-4665-8c46-579654340352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:19.692129 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-8e34a417-8aed-4665-8c46-579654340352 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:19.693460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-8e34a417-8aed-4665-8c46-579654340352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:19.759227 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4231/8420] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:19.770415 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:19.770813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:19.771179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:19.792834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:19.794060 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:19.802633 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4190/8421] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:19.807305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34a417-8aed-4665-8c46-579654340352 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:19.819758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34a417-8aed-4665-8c46-579654340352 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:19.824673 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:19.826106 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:19.826384 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:19.826723 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:19.827430 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:19.827732 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:19.829495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:19.842481 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4232/8422] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:13:19.847362 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:19.857653 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c4199-82ae-47f5-9711-bf9fc4c84400 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:19.862683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:19.863297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:19.863577 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:19.863852 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:19.864574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:19.866493 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:19.884861 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:20.045809 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4191/8423] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:19 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:20.050265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:20.061581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090f16c-bd93-4c37-bf5d-ed5371fc1f35 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:20.121343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:20.122551 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.122832 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.123108 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.123741 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:20.125711 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:20.222049 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:20.228671 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4233/8424] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:20 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:20.235029 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:20.245919 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39e869-1b80-4fbe-ad3e-541ba37863c4 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:20.251330 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:20.251939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.252218 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.252506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.253782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:20.254763 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:20.265509 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4192/8425] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:20.270193 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:20.281042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7ffa3-56da-4e75-9407-de61f00be2e9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:20.286385 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:20.287091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.287364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.287682 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.288402 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:20.290086 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f061e-60ac-4631-9a9f-9de9f99b7844 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:20.303016 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4234/8426] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:20.307605 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:20.319235 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9346-fbd8-4c60-843d-99981a19144f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:20.324033 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:20.324723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.325030 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.325305 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] PATH_INFO: `/v3/projects/03026ea2c9bf431caf037c391586cc58/users/ce3b3c75d23b476d87a1e668a0b8bed5/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.341866 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03026ea2c9bf431caf037c391586cc58, user_id=ce3b3c75d23b476d87a1e668a0b8bed5, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:20.344641 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:20.439648 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4193/8427] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:20 2022] PUT /identity/v3/projects/03026ea2c9bf431caf037c391586cc58/users/ce3b3c75d23b476d87a1e668a0b8bed5/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:13:20.450541 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.450936 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.451219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.483994 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] MFA Rules not processed for user `ce3b3c75d23b476d87a1e668a0b8bed5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:20.485264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:20.575670 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4235/8428] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:13:20.587519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:20.589588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:20.657173 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51924ab-cbf1-44a5-93da-4d7d0109e84b admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:20.661052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:20.661672 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:20.661952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:20.662227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:20.672773 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:20.674281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf68bd-32d1-4044-a31a-2c2ada639aa5 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:20.686048 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4194/8429] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:30.572733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=38 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:30.680725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:40.153335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:40.232862 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238a9a-0a8e-4241-992c-0932808307b4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:40.235823 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:40.236514 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:40.236870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:40.237109 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] PATH_INFO: `/v3/users/ce3b3c75d23b476d87a1e668a0b8bed5` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:40.238436 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3b3c75d23b476d87a1e668a0b8bed5)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:40.240240 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:40.390227 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3b3c75d23b476d87a1e668a0b8bed5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:40.443773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3b3c75d23b476d87a1e668a0b8bed5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:40.457260 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3b3c75d23b476d87a1e668a0b8bed5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:40.465391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3b3c75d23b476d87a1e668a0b8bed5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:40.466762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3b3c75d23b476d87a1e668a0b8bed5'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:40.477780 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4236/8430] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:40 2022] DELETE /identity/v3/users/ce3b3c75d23b476d87a1e668a0b8bed5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:40.484311 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:40.484847 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:40.485267 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:40.509696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:40.511031 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:40.582369 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4195/8431] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:40.592930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:40.594434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:40.672085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dee29c-a086-46f9-a2d9-bd753a1bdbf5 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:40.675898 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:40.676735 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:40.677018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:40.677298 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:40.687586 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:40.689604 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d9b1e-26c5-475d-a02e-97ad90237fa2 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:40.700911 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4237/8432] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:41.017321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.018742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:41.033381 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d760d71-b903-4d4d-b43b-bfdc759b7876 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.040466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.041151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.041483 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.041759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] PATH_INFO: `/v3/projects/03026ea2c9bf431caf037c391586cc58` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.042934 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03026ea2c9bf431caf037c391586cc58)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.046105 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.150140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03026ea2c9bf431caf037c391586cc58', 'request_id': 'req-b39babf4-ed26-4c40-b51a-af3c3331ae25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:41.157229 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03026ea2c9bf431caf037c391586cc58', 'request_id': 'req-b39babf4-ed26-4c40-b51a-af3c3331ae25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:41.289724 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03026ea2c9bf431caf037c391586cc58', 'request_id': 'req-b39babf4-ed26-4c40-b51a-af3c3331ae25'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:41.301734 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] The token cache is being invalidate because project 03026ea2c9bf431caf037c391586cc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:41.302024 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:41.302688 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-b39babf4-ed26-4c40-b51a-af3c3331ae25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:41.304202 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4196/8433] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:41 2022] DELETE /identity/v3/projects/03026ea2c9bf431caf037c391586cc58 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:41.309974 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.310686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.310686 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.319856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:41.333368 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:41.334614 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:41.399262 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4238/8434] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:41.408078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.408364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.408720 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.430490 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:41.431735 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:41.440947 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4197/8435] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:13:41.445813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.457032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab8849-c452-4588-9902-2cc79e05d6d8 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.462165 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.462825 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.463078 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.463351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.464045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:41.464299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.466111 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.479264 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4239/8436] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:13:41.484254 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.498937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a8945-65a4-4f4d-a564-dc36a9adf8e1 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.504914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.505658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.506023 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.506159 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.506998 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.509047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.642243 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4198/8437] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:41 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:41.647001 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.661751 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cce72d3-9d84-452f-b6ee-8a3ebaa62e63 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.743178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.744218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.744737 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.745234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.746377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.750575 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.838560 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4240/8438] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:41 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:41.842766 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.853707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea41f0b-d0f6-4270-945e-31c73e1b9035 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.859049 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.859658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.859938 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.860212 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.860894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.862520 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.874816 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4199/8439] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:41.879265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.890636 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4b272-fe6c-4f70-8e61-8b63cce8374a admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.895940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.896512 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.896798 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.897203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.898226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.900446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bcc3c-9bd5-47cc-a879-9f46c98bceee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:41.912672 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4241/8440] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:41.917498 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:41.929014 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e0c51-2f1e-4a6a-9752-00c4e99d5802 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:41.933814 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:41.935272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:41.935438 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:41.935710 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] PATH_INFO: `/v3/projects/b00094aac7744537ba2c41beb4b35f85/users/55273d9804514fa58421a441d335aee3/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:41.951434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00094aac7744537ba2c41beb4b35f85, user_id=55273d9804514fa58421a441d335aee3, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:41.954156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:42.021591 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4200/8441] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:41 2022] PUT /identity/v3/projects/b00094aac7744537ba2c41beb4b35f85/users/55273d9804514fa58421a441d335aee3/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:42.032870 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:42.033182 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:42.033459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:42.064597 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] MFA Rules not processed for user `55273d9804514fa58421a441d335aee3`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:42.065910 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:42.130304 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:42.136680 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4242/8442] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:42.149351 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:42.151261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:42.175081 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:42.216557 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c74d6-fc0b-4d7f-9d17-c5e849dc4bd9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:42.220663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:42.221321 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:42.222238 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:42.222397 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:42.232103 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:42.233590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef716f98-80c7-42a4-bd9d-77541ed608d0 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:42.243412 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4201/8443] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:49.764479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:49.832552 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69146f8e-be3a-4796-987e-7d1bf2fbb914 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:49.837489 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:49.838177 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:49.838457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:49.838734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] PATH_INFO: `/v3/users/55273d9804514fa58421a441d335aee3` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:49.839889 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55273d9804514fa58421a441d335aee3)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:49.842409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:50.270760 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55273d9804514fa58421a441d335aee3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:50.406470 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55273d9804514fa58421a441d335aee3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:50.418961 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55273d9804514fa58421a441d335aee3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:50.426630 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55273d9804514fa58421a441d335aee3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:50.427565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55273d9804514fa58421a441d335aee3'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:50.434536 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4243/8444] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:13:49 2022] DELETE /identity/v3/users/55273d9804514fa58421a441d335aee3 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:50.439600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:50.440269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:50.440269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:50.464101 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:50.466371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:50.554638 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4202/8445] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:50.567380 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:50.569136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:50.645617 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c8c34-36d5-4d99-9c86-f4354ffcb334 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:50.649313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:50.649940 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:50.650214 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:50.650483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:50.660803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:50.662302 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5444c55-a00c-477e-985f-4481040957eb service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:50.674138 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4244/8446] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:51.062175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:51.063876 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:51.078065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c80c60-40ce-4d58-8c91-d93028b6bd5b None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:51.083035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:51.083697 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.083976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.084248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] PATH_INFO: `/v3/projects/b00094aac7744537ba2c41beb4b35f85` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.085428 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00094aac7744537ba2c41beb4b35f85)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:51.087393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:51.221626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00094aac7744537ba2c41beb4b35f85', 'request_id': 'req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:51.228456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00094aac7744537ba2c41beb4b35f85', 'request_id': 'req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:51.328918 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00094aac7744537ba2c41beb4b35f85', 'request_id': 'req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:51.342391 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] The token cache is being invalidate because project b00094aac7744537ba2c41beb4b35f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:13:51.342706 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:51.343475 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7ac7242b-c43d-4b0b-9f9d-080e7488ee52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:13:51.345155 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4203/8447] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:13:51 2022] DELETE /identity/v3/projects/b00094aac7744537ba2c41beb4b35f85 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:51.350319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.350788 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.350964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.372699 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:51.375553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:51.395849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:51.444894 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4245/8448] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:51.453028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.462602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.462602 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.474451 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:51.475747 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:51.484604 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4204/8449] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:51.488933 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:51.499295 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9eb958-7711-4b94-a6c6-82954bc1ab41 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:51.504056 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:51.504687 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.504962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.505239 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.505939 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:13:51.506238 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:51.507845 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:51.525165 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4246/8450] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:13:51.526232 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:51.536468 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54dec-9107-4874-9051-7b524945ecc6 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:51.541328 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:51.541935 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.542217 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.542560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.543269 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:51.545909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:51.794282 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4205/8451] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:51 2022] POST /identity/v3/projects => generated 389 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:51.798498 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:51.808873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d7ef-f8f5-4147-8293-e7a6c1ad32d0 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:51.870531 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:51.871444 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.871918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.872819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.873471 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:51.875492 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:51.969763 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4247/8452] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:51 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:51.974047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:51.985374 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2350c8-1cb5-42f5-9ad8-65e03b59cc33 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:51.990343 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:51.990949 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:51.991227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:51.991495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:51.992233 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:51.993871 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:52.005446 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4206/8453] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:52.010349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:52.021372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9424806-c64c-46b0-93de-6a9c9411a9e4 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:52.026157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:52.026762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:52.027065 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:52.027340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:52.028005 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:52.029631 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434de9f5-4533-453e-bc41-858414c581cb admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:52.040823 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4248/8454] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:52.045234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:52.055535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32c8ee-53f7-474f-9a2d-9bf48de415a9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:52.061117 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:52.061808 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:52.062066 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:52.062338 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] PATH_INFO: `/v3/projects/e3e5c7cd329741efa45718744a7c9ba6/users/57e194058f1c4d41b809218518b4492e/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:52.064924 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:52.081730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e5c7cd329741efa45718744a7c9ba6, user_id=57e194058f1c4d41b809218518b4492e, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:52.084383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:52.220878 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4207/8455] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:52 2022] PUT /identity/v3/projects/e3e5c7cd329741efa45718744a7c9ba6/users/57e194058f1c4d41b809218518b4492e/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:52.226218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f0c9-668e-415e-8a75-2fcd403a7455 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:52.226504 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f0c9-668e-415e-8a75-2fcd403a7455 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:52.226771 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f0c9-668e-415e-8a75-2fcd403a7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:52.245785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bb62f0c9-668e-415e-8a75-2fcd403a7455 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:52.247519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bb62f0c9-668e-415e-8a75-2fcd403a7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:52.313210 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4249/8456] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:52.324364 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:52.326467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:52.396291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5beac-595b-48a2-811a-a837b203a7b9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:52.405818 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:52.410638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:52.410638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:52.410638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:52.418042 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:52.420065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:52.431593 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4208/8457] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:13:58.821429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:58.822268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:58.822268 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:58.857947 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] MFA Rules not processed for user `57e194058f1c4d41b809218518b4492e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:13:58.860347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:13:58.884582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:58.962699 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:58.963479 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4250/8458] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:13:58.981750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352b4b7-24cd-486c-9030-d747671c3997 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:58.987782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:58.988466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:58.988776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:58.989465 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:58.989704 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:58.992026 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.122747 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4209/8459] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:13:58 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:13:59.127573 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:59.140574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152be8ba-bcb7-4bea-8795-09deb503b5c5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:59.212199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:59.212968 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:59.213373 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:59.213497 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:59.214132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:59.216087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.376759 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4251/8460] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:13:59 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:13:59.381291 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:59.392955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0eaee-8256-48bb-b3fc-5276919d503e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:59.397972 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:59.398610 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:59.398886 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:59.399164 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:59.399827 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:59.401523 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.415961 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4210/8461] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:13:59.421919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:59.439375 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53bf63-1979-41e2-8a5c-9ea6c25a3040 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:59.447837 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:59.451361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:59.451361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:59.451361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] PATH_INFO: `/v3/projects/f2326ca2d54f4b3da83070696ed53f87/users/2a14f2c97a5147b4aa0a90ea085f0e05/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:59.478775 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2326ca2d54f4b3da83070696ed53f87, user_id=2a14f2c97a5147b4aa0a90ea085f0e05, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:59.485417 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.603720 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4252/8462] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:59 2022] PUT /identity/v3/projects/f2326ca2d54f4b3da83070696ed53f87/users/2a14f2c97a5147b4aa0a90ea085f0e05/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:13:59.608851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:59.620976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4335cd-edf8-4bd2-a35e-3a3c48fb253e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:59.694383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:59.695433 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:59.695965 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:59.696740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:59.698047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:59.701941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.719334 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4211/8463] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:13:59.724315 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:13:59.736964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b67cea-7467-4674-903d-4749b7990c3b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:13:59.742344 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:13:59.743071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:13:59.743351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:13:59.743629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] PATH_INFO: `/v3/projects/f2326ca2d54f4b3da83070696ed53f87/users/2a14f2c97a5147b4aa0a90ea085f0e05/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:13:59.745692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2326ca2d54f4b3da83070696ed53f87, user_id=2a14f2c97a5147b4aa0a90ea085f0e05, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:13:59.748942 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8076bdc-7369-4d78-95dd-83f92053b9a1 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:13:59.760642 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4253/8464] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:13:59 2022] PUT /identity/v3/projects/f2326ca2d54f4b3da83070696ed53f87/users/2a14f2c97a5147b4aa0a90ea085f0e05/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:05.924839 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:05.928805 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:06.048940 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:06.111674 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7336-9024-40d0-8a66-6d1543f17a8d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:06.219035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:06.220121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:06.220659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:06.221152 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:06.224092 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:06.247901 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:06.250561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:06.270521 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4212/8465] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:14:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:14:07.578884 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8d3c-f3fe-49ce-a4a4-594f364d7ff5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:07.579609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8d3c-f3fe-49ce-a4a4-594f364d7ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:07.579609 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e8d3c-f3fe-49ce-a4a4-594f364d7ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:07.612383 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-220e8d3c-f3fe-49ce-a4a4-594f364d7ff5 None None] MFA Rules not processed for user `2a14f2c97a5147b4aa0a90ea085f0e05`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:07.613848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-220e8d3c-f3fe-49ce-a4a4-594f364d7ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:07.699662 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:07.715147 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4254/8466] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:07.734733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:07.736696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:07.864421 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633c79a-681e-4048-8f3a-8f08ba1890cc service placement] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:07.871626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:07.872591 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:07.872757 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:07.873190 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:07.962001 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:07.964278 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1192c95-f943-4909-9cbc-868a60815de3 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:07.976867 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4213/8467] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:14:08.191931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe504-f547-46da-a61d-60c10f88d893 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:08.192212 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe504-f547-46da-a61d-60c10f88d893 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:08.192780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe504-f547-46da-a61d-60c10f88d893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:08.216192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-f4fbe504-f547-46da-a61d-60c10f88d893 None None] MFA Rules not processed for user `57e194058f1c4d41b809218518b4492e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:08.217581 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f4fbe504-f547-46da-a61d-60c10f88d893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:08.224799 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4255/8468] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:08.525752 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18f431-5232-4191-84ab-bbda1fdd172c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:08.526035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18f431-5232-4191-84ab-bbda1fdd172c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:08.526318 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18f431-5232-4191-84ab-bbda1fdd172c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-7d18f431-5232-4191-84ab-bbda1fdd172c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:14:08.533417 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:08.534376 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:14:08.535196 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4214/8469] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:08 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:14:08.859878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c2a-ef84-4945-b8e3-ebe7da18a37d None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:08.860752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c2a-ef84-4945-b8e3-ebe7da18a37d None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:08.860752 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24c2a-ef84-4945-b8e3-ebe7da18a37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:08.882317 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-74f24c2a-ef84-4945-b8e3-ebe7da18a37d None None] MFA Rules not processed for user `57e194058f1c4d41b809218518b4492e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:08.883340 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-74f24c2a-ef84-4945-b8e3-ebe7da18a37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:08.891698 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4256/8470] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:14:09.251961 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d184-70e7-4f15-be9e-fa5973b9c83d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:09.252739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d184-70e7-4f15-be9e-fa5973b9c83d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:09.253287 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666d184-70e7-4f15-be9e-fa5973b9c83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9666d184-70e7-4f15-be9e-fa5973b9c83d None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:14:09.262371 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:09.263486 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:14:09.264463 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4215/8471] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:14:09.542034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:09.542438 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:09.543230 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:09.571695 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] MFA Rules not processed for user `57e194058f1c4d41b809218518b4492e`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:09.573782 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:09.591163 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4257/8472] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:14:09.963149 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:09.963436 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:09.963736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:14:09.972147 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:09.973748 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:14:09.975272 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4216/8473] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:09 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:14:17.970621 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=99 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:19.318159 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:19.387795 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ac696-ebf4-480c-aaf9-dd582f6f5ff5 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:19.393068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:19.393762 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:19.394039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:19.394409 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] PATH_INFO: `/v3/users/57e194058f1c4d41b809218518b4492e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:19.395556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e194058f1c4d41b809218518b4492e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:19.397524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:19.595349 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e194058f1c4d41b809218518b4492e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:19.670865 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e194058f1c4d41b809218518b4492e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:19.687271 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e194058f1c4d41b809218518b4492e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:19.695180 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e194058f1c4d41b809218518b4492e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:19.695919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e194058f1c4d41b809218518b4492e'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:19.703234 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4258/8474] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:14:19 2022] DELETE /identity/v3/users/57e194058f1c4d41b809218518b4492e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:20.045902 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:20.048631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:20.124184 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b919f9-a628-48a6-95fe-308c6938ad60 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:20.128851 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:20.129466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:20.129742 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:20.130017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] PATH_INFO: `/v3/projects/e3e5c7cd329741efa45718744a7c9ba6` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:20.131150 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e5c7cd329741efa45718744a7c9ba6)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:20.133099 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:20.291496 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e5c7cd329741efa45718744a7c9ba6', 'request_id': 'req-874ddb04-22ba-489c-aca5-1658b651124e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.298976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e5c7cd329741efa45718744a7c9ba6', 'request_id': 'req-874ddb04-22ba-489c-aca5-1658b651124e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.380115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e5c7cd329741efa45718744a7c9ba6', 'request_id': 'req-874ddb04-22ba-489c-aca5-1658b651124e'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.392401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] The token cache is being invalidate because project e3e5c7cd329741efa45718744a7c9ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:14:20.393276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.393535 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.395122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4217/8475] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:14:20 2022] DELETE /identity/v3/projects/e3e5c7cd329741efa45718744a7c9ba6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:20.399301 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:20.410280 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec91dc-e275-4b0b-abbc-a7c90be48a70 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:20.463511 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:20.471678 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:20.472446 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:20.472635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:20.472919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] PATH_INFO: `/v3/users/2a14f2c97a5147b4aa0a90ea085f0e05` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:20.474208 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a14f2c97a5147b4aa0a90ea085f0e05)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:20.476203 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:20.847068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a14f2c97a5147b4aa0a90ea085f0e05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.940351 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a14f2c97a5147b4aa0a90ea085f0e05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.956966 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a14f2c97a5147b4aa0a90ea085f0e05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.964965 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a14f2c97a5147b4aa0a90ea085f0e05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.965727 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-d46bf585-dd00-4d8e-a991-bf12c14b698b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a14f2c97a5147b4aa0a90ea085f0e05'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:20.972285 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4259/8476] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:14:20 2022] DELETE /identity/v3/users/2a14f2c97a5147b4aa0a90ea085f0e05 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:21.383025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:21.388336 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:21.398112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ddb04-22ba-489c-aca5-1658b651124e admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:21.463327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:21.463999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:21.464280 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:21.464586 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] PATH_INFO: `/v3/projects/f2326ca2d54f4b3da83070696ed53f87` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:21.465733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2326ca2d54f4b3da83070696ed53f87)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:21.468298 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:21.598308 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:21.610512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2326ca2d54f4b3da83070696ed53f87', 'request_id': 'req-1d722e34-6e82-480a-a377-06801125944b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:21.617108 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2326ca2d54f4b3da83070696ed53f87', 'request_id': 'req-1d722e34-6e82-480a-a377-06801125944b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:21.734537 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2326ca2d54f4b3da83070696ed53f87', 'request_id': 'req-1d722e34-6e82-480a-a377-06801125944b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:21.746187 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] The token cache is being invalidate because project f2326ca2d54f4b3da83070696ed53f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82132) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:14:21.746480 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:21.747140 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-1d722e34-6e82-480a-a377-06801125944b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:14:21.748676 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4218/8477] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:14:21 2022] DELETE /identity/v3/projects/f2326ca2d54f4b3da83070696ed53f87 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:21.753859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:21.754329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:21.754435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:21.775456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:21.777045 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:21.839729 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4260/8478] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:21.848097 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:21.848387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:21.848703 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:21.869163 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:21.870416 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:21.879087 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4219/8479] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:21.883583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:21.894194 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1cbfc-d44e-4eea-99eb-a999411f8e6f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:21.898993 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:21.899653 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:21.902920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:21.902920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:21.902920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:14:21.902920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:21.902920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:21.915194 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4261/8480] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:14:21.919726 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:21.930525 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763f228-84d4-43d8-90be-8762f0db3208 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:21.935491 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:21.936671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:21.936955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:21.937224 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:21.937862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:21.939819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.033513 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4220/8481] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:14:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:14:22.037749 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:22.048124 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8744c14-f323-402c-ab7b-fd3a2576afe9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:22.106647 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:22.107256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.107571 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.108439 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.109155 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:22.111043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.120307 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:22.254805 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4262/8482] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:14:22 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:14:22.259084 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:22.270971 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0570c-1b21-4f01-8830-a9be00e1b132 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:22.276147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:22.276846 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.277153 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.277424 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.278123 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:22.280529 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.291854 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4221/8483] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:14:22.295882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:22.306126 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92919c19-6dcc-454b-86fc-ff53d3c5baf9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:22.311048 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:22.311702 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.311975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.312241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.312913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:22.314527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6277-1bf0-4978-bd9b-cfa38da32b7a admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.326978 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4263/8484] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:14:22.331165 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:22.342156 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630846f-96e6-49ae-be27-764c230e415c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:22.347432 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:22.348161 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.348443 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.348878 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] PATH_INFO: `/v3/projects/de4a5e32387f4e81bd7c863b544a787e/users/8508520adb904d4d8f390018299f68cd/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.364754 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4a5e32387f4e81bd7c863b544a787e, user_id=8508520adb904d4d8f390018299f68cd, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:22.367464 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.501255 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4222/8485] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:14:22 2022] PUT /identity/v3/projects/de4a5e32387f4e81bd7c863b544a787e/users/8508520adb904d4d8f390018299f68cd/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:22.506448 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb873-c000-498f-aa98-86208c6e35ee None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.513189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb873-c000-498f-aa98-86208c6e35ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.513189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb873-c000-498f-aa98-86208c6e35ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.530079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-51ebb873-c000-498f-aa98-86208c6e35ee None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:22.531311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-51ebb873-c000-498f-aa98-86208c6e35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:22.591897 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4264/8486] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:22.601626 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:22.603385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:22.666087 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd2ea-8dc6-4bce-a514-8cd52236ab7f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:22.669825 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:22.670466 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:22.670776 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:22.671558 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:22.681079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:22.682544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:22.692632 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4223/8487] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:14:29.414009 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453faea-8871-43eb-8231-55db6d508784 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:29.414592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453faea-8871-43eb-8231-55db6d508784 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:29.414716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453faea-8871-43eb-8231-55db6d508784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:29.449372 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-1453faea-8871-43eb-8231-55db6d508784 None None] MFA Rules not processed for user `8508520adb904d4d8f390018299f68cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:29.450729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1453faea-8871-43eb-8231-55db6d508784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:29.539989 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4265/8488] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:29.544813 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:29.563444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d1380-0965-4f6c-91b6-2553dc45af68 service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:29.572980 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:29.573606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:29.573882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:29.574154 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] PATH_INFO: `/v3/projects` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:29.574802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:29.576914 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:29.701706 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4224/8489] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:14:29 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:14:29.705820 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453faea-8871-43eb-8231-55db6d508784 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:29.717992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453faea-8871-43eb-8231-55db6d508784 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:29.783848 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:29.788707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:29.788707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:29.788707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] PATH_INFO: `/v3/users` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:29.788707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:29.788707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:29.902743 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:29.908892 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4266/8490] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:14:29 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:14:29.912999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:29.924125 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11de0-090a-47f7-bdca-298c37031649 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:29.929624 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:29.943387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:29.943387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:29.943387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:29.943387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:29.943387 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:29.947545 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4225/8491] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:14:29.952918 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:29.963745 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03927d-4d02-4d1e-82cc-93d451feae51 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:29.969645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:29.970457 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:29.970572 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:29.970850 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] PATH_INFO: `/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c/users/c3f0e0f7880b42c386281a3e1d652ac9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:29.987767 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bf0bf9df1d42689402aa67a81f9f9c, user_id=c3f0e0f7880b42c386281a3e1d652ac9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:29.991074 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:30.095573 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4267/8492] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:14:29 2022] PUT /identity/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c/users/c3f0e0f7880b42c386281a3e1d652ac9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:30.099823 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:30.112047 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86c73-df72-49be-b7d1-f609b6a17b68 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:30.138199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:30.175950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:30.176954 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:30.177302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:30.177727 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:30.178379 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:30.180011 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0afab-e571-4af1-b154-d8b31ce15ad0 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:30.192401 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4226/8493] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:14:30.196665 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:30.207922 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba29d05-5f15-45fc-bd82-9c1ce742b244 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:30.212560 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:30.213222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:30.213499 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:30.213769 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] PATH_INFO: `/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c/users/c3f0e0f7880b42c386281a3e1d652ac9/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:30.215705 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bf0bf9df1d42689402aa67a81f9f9c, user_id=c3f0e0f7880b42c386281a3e1d652ac9, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:30.218447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:30.236284 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4268/8494] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:14:30 2022] PUT /identity/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c/users/c3f0e0f7880b42c386281a3e1d652ac9/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:14:36.935019 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd999b9-63c5-4b31-9abd-2ce816a5d86d None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:36.935454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd999b9-63c5-4b31-9abd-2ce816a5d86d None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:36.935454 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd999b9-63c5-4b31-9abd-2ce816a5d86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:36.970470 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-2fd999b9-63c5-4b31-9abd-2ce816a5d86d None None] MFA Rules not processed for user `c3f0e0f7880b42c386281a3e1d652ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:36.972215 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-2fd999b9-63c5-4b31-9abd-2ce816a5d86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:37.077235 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4227/8495] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:37.126479 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:37.129116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:37.199574 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c7f86-33fb-4101-af83-8e4a65c4c458 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:37.203459 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:37.204080 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:37.204358 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:37.204672 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:37.276415 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:37.277919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:37.288733 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4269/8496] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:14:37.734729 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52b49-8d9e-4b53-8f2d-ba2c5337087e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:37.735017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52b49-8d9e-4b53-8f2d-ba2c5337087e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:37.735293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf52b49-8d9e-4b53-8f2d-ba2c5337087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:37.798036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3cf52b49-8d9e-4b53-8f2d-ba2c5337087e None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:37.799259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3cf52b49-8d9e-4b53-8f2d-ba2c5337087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:37.857247 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4228/8497] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:14:38.054132 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:38.055558 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:38.130758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261cafb-d624-4fab-aa61-1242cb358c21 service glance] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:38.137042 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:38.137649 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:38.137925 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:38.138191 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:38.146926 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:38.148527 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8332b-c82d-4f3d-be74-b1444778ef8d service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:38.156895 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4270/8498] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:14:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:47.850394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=87 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:48.153391 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.159353 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8e2e-e1bb-42b9-be55-b4529b1afad6 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:49.159881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8e2e-e1bb-42b9-be55-b4529b1afad6 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:49.159975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc8e2e-e1bb-42b9-be55-b4529b1afad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:49.179779 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-a3cc8e2e-e1bb-42b9-be55-b4529b1afad6 None None] MFA Rules not processed for user `8508520adb904d4d8f390018299f68cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:49.181025 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-a3cc8e2e-e1bb-42b9-be55-b4529b1afad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:49.188021 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4229/8499] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:49.458414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:49.459040 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:49.459420 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:14:49.473366 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:14:49.474493 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:14:49.475454 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4271/8500] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:49 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:14:49.624314 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4a4d-a493-43c2-82e1-8b3c841acbf1 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:49.624663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4a4d-a493-43c2-82e1-8b3c841acbf1 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:49.624929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f4a4d-a493-43c2-82e1-8b3c841acbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:49.645774 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b34f4a4d-a493-43c2-82e1-8b3c841acbf1 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:49.646987 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b34f4a4d-a493-43c2-82e1-8b3c841acbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:49.654914 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4230/8501] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:49.667657 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:49.686318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba67ccc-c5d2-4561-88be-0a06c4936634 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:49.691424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:49.692300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:49.692606 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:49.692880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:49.702821 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:49.704423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:49.713385 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4272/8502] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:14:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:14:51.066168 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245717-cc15-4f03-bc3f-9a5a4aed152e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:51.066944 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245717-cc15-4f03-bc3f-9a5a4aed152e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:51.067065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1245717-cc15-4f03-bc3f-9a5a4aed152e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:51.086922 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-b1245717-cc15-4f03-bc3f-9a5a4aed152e None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:14:51.088131 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-b1245717-cc15-4f03-bc3f-9a5a4aed152e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:14:51.096250 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4231/8503] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:14:51.108627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:14:51.122219 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2536020-9147-48b3-a59b-69bbf43e0779 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:14:51.128118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:14:51.128785 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:14:51.129068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:14:51.129331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:14:51.141213 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:14:51.143115 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc12a6d-da6b-4421-96b4-5bbcebd776d8 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:14:51.156861 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4273/8504] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 02 13:15:01.081501 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:01.149015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=12 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:01.963455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f92e-50da-4972-affb-18c49a0bbab0 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:01.963739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f92e-50da-4972-affb-18c49a0bbab0 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:01.964022 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864f92e-50da-4972-affb-18c49a0bbab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:01.983828 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d864f92e-50da-4972-affb-18c49a0bbab0 None None] MFA Rules not processed for user `8508520adb904d4d8f390018299f68cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:01.985079 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d864f92e-50da-4972-affb-18c49a0bbab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:01.992222 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4232/8505] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:02.265733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:02.266364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:02.266364 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:15:02.273153 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:02.274243 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:15:02.275605 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4274/8506] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:15:02 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:15:02.466070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:02.466590 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:02.466679 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:02.488196 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] MFA Rules not processed for user `598d3903c0a540669a27f9a09b4cdaeb`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:02.489457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:02.497006 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4233/8507] 10.222.0.64 () {58 vars in 967 bytes} [Wed Nov 2 13:15:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:15:02.509264 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:02.530963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028842d-c0c9-4f2d-b815-573a04af4761 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:02.536343 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d62c23e1f774db1bfa311c813861c8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:02.537013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:02.537289 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:02.537556 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:02.547986 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:02.549656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:02.559043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4275/8508] 10.222.0.64 () {60 vars in 1384 bytes} [Wed Nov 2 13:15:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 02 13:15:12.481355 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=6 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:12.555299 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=6 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:12.653692 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:12.733630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb8bb3-bc66-4117-9d80-98b7d86ab224 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:12.738506 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:12.739139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:12.739414 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:12.739681 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] PATH_INFO: `/v3/users/8508520adb904d4d8f390018299f68cd` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:12.740853 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8508520adb904d4d8f390018299f68cd)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:12.742789 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:13.097740 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8508520adb904d4d8f390018299f68cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.258139 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8508520adb904d4d8f390018299f68cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.274293 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8508520adb904d4d8f390018299f68cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.275121 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8508520adb904d4d8f390018299f68cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.275755 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8508520adb904d4d8f390018299f68cd'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.293013 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4234/8509] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:15:12 2022] DELETE /identity/v3/users/8508520adb904d4d8f390018299f68cd => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:13.650170 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:13.665139 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167ecb8-d50c-4de7-ab33-9ebbaaa3adc6 service swift] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:13.731098 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:13.731742 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:13.732018 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:13.732321 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] PATH_INFO: `/v3/projects/de4a5e32387f4e81bd7c863b544a787e` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:13.733635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4a5e32387f4e81bd7c863b544a787e)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:13.735582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:13.867314 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4a5e32387f4e81bd7c863b544a787e', 'request_id': 'req-06c8ac1a-216d-474e-b755-20175116a68c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.875039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4a5e32387f4e81bd7c863b544a787e', 'request_id': 'req-06c8ac1a-216d-474e-b755-20175116a68c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.884663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4a5e32387f4e81bd7c863b544a787e', 'request_id': 'req-06c8ac1a-216d-474e-b755-20175116a68c'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.986162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] The token cache is being invalidate because project de4a5e32387f4e81bd7c863b544a787e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:15:13.989337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.989337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:13.989337 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4276/8510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:15:13 2022] DELETE /identity/v3/projects/de4a5e32387f4e81bd7c863b544a787e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:13.994463 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:13.996021 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:14.073890 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaecc69-fbb9-435b-8d54-31863f79db3f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:14.142986 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:14.143631 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:14.144073 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:14.144261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] PATH_INFO: `/v3/users/c3f0e0f7880b42c386281a3e1d652ac9` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:14.145524 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f0e0f7880b42c386281a3e1d652ac9)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:14.147512 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:14.171895 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:14.404505 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f0e0f7880b42c386281a3e1d652ac9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:14.480759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f0e0f7880b42c386281a3e1d652ac9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:14.495663 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f0e0f7880b42c386281a3e1d652ac9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:14.496422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f0e0f7880b42c386281a3e1d652ac9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:14.497070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-22e93b09-0944-4284-bfb0-e061905e07bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f0e0f7880b42c386281a3e1d652ac9'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:14.511420 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4235/8511] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:15:13 2022] DELETE /identity/v3/users/c3f0e0f7880b42c386281a3e1d652ac9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 02 13:15:14.844903 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:14.846506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:14.865937 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8ac1a-216d-474e-b755-20175116a68c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:14.934979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:14.936225 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:14.936516 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:14.936799 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] PATH_INFO: `/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:14.938030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bf0bf9df1d42689402aa67a81f9f9c)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:14.940087 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.068633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:15.081982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bf0bf9df1d42689402aa67a81f9f9c', 'request_id': 'req-6978adff-9b88-4bbd-829f-9e85d3538b37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:15.089524 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bf0bf9df1d42689402aa67a81f9f9c', 'request_id': 'req-6978adff-9b88-4bbd-829f-9e85d3538b37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:15.096627 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bf0bf9df1d42689402aa67a81f9f9c', 'request_id': 'req-6978adff-9b88-4bbd-829f-9e85d3538b37'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:15.208518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] The token cache is being invalidate because project d0bf0bf9df1d42689402aa67a81f9f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:15:15.208717 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:15.209424 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-6978adff-9b88-4bbd-829f-9e85d3538b37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:15:15.210973 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4277/8512] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:15:14 2022] DELETE /identity/v3/projects/d0bf0bf9df1d42689402aa67a81f9f9c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:15.216555 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.217598 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.217865 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.239973 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:15.241261 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:15.311714 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4236/8513] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:15.319815 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.320107 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.320388 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.342378 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:15.343663 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:15.353421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4278/8514] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:15.360383 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.368759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b98d-0ebd-420c-834a-ec5fb15ccc8e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.373563 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.374176 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.374456 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.374736 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.375398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:15:15.375749 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.377472 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.390481 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4237/8515] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:15:15.395120 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.405612 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2a380-5fc8-49e2-97cc-aad99e189bd2 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.410729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.411326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.411733 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.411860 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.412568 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.416596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.524620 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4279/8516] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:15:15 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:15:15.530857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.541939 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc698794-3916-4155-b7d1-69c37cbdad66 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.605606 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.606221 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.606504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.606778 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.607442 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.609430 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.727744 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4238/8517] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:15:15 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:15:15.733763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.750920 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4f67b-5f49-4565-89a6-c8916f9eb6d2 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.757250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.758119 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.758590 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.759082 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.760256 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.763418 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.776513 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4280/8518] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:15:15.781844 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.792969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10bc-3194-4e01-85b6-3377889c3d8f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.798792 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.799419 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.799696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.799969 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.805119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.805119 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d0890-ca1a-467a-9747-fa8a662d532d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.816740 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4239/8519] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:15:15.821192 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:15.833595 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5611d61-9fe3-4253-a47b-cd5c81941e75 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:15.845428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:15.845428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:15.845428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:15.845428 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] PATH_INFO: `/v3/projects/ef4f1f1efde142479f284d0edca2e143/users/6137db77c8154928a3e0e57c0ecca3dc/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:15.861670 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4f1f1efde142479f284d0edca2e143, user_id=6137db77c8154928a3e0e57c0ecca3dc, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:15.864369 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:15.992554 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4281/8520] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:15:15 2022] PUT /identity/v3/projects/ef4f1f1efde142479f284d0edca2e143/users/6137db77c8154928a3e0e57c0ecca3dc/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:16.002975 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.003259 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.003538 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.020708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:16.037874 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:16.039013 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:16.110775 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4240/8521] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:16.115557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.182146 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a232c-9a75-4f08-8173-1932d4e2e0ee admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.187020 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.187621 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.187896 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.188163 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.188810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.190708 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.376380 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4282/8522] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:15:16 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:15:16.380384 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.392657 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40620b48-9ddb-4426-b29c-a5ae5bf63cfe None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.452868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.453803 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.454175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.454449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.455094 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.457175 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.575200 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4241/8523] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:15:16 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:15:16.580102 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.592700 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef16bec-d15e-42f1-8194-a4d21feeb73d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.597543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.598176 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.598456 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.598718 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.599347 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.600982 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.612400 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4283/8524] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:15:16.616733 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.630696 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51096fb-0cbd-43b4-b034-91d283c44c19 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.632584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.633236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.633519 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.633786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] PATH_INFO: `/v3/projects/5956bd5553cf48a4aba0d194ebd1949a/users/e5e0ba72a02f46f193ff5e7ddc135cb5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.650588 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956bd5553cf48a4aba0d194ebd1949a, user_id=e5e0ba72a02f46f193ff5e7ddc135cb5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.653584 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.750932 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4242/8525] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:15:16 2022] PUT /identity/v3/projects/5956bd5553cf48a4aba0d194ebd1949a/users/e5e0ba72a02f46f193ff5e7ddc135cb5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:16.755628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.766543 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1233d-e76e-47d6-8e28-c0c58fbbd12d admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.797252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:16.828908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.829544 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.829819 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.830133 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.830770 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.832370 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb8ac-ccf0-414b-9fbb-3fdde438597c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.846489 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4284/8526] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:15:16.855777 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:16.860296 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567f89-65d9-4a80-bfa9-dce7e8d6d87d admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:16.871467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:16.872248 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.872646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.873516 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] PATH_INFO: `/v3/projects/5956bd5553cf48a4aba0d194ebd1949a/users/e5e0ba72a02f46f193ff5e7ddc135cb5/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.875528 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5956bd5553cf48a4aba0d194ebd1949a, user_id=e5e0ba72a02f46f193ff5e7ddc135cb5, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:16.878340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:16.900763 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4243/8527] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:15:16 2022] PUT /identity/v3/projects/5956bd5553cf48a4aba0d194ebd1949a/users/e5e0ba72a02f46f193ff5e7ddc135cb5/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:15:16.912247 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:16.912836 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:16.913265 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:16.950843 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] MFA Rules not processed for user `e5e0ba72a02f46f193ff5e7ddc135cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:16.953189 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:17.036043 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4285/8528] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:17.052545 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:17.054561 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:17.117065 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:17.146474 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105ff6-61d9-42dc-b238-7f99ccf25a8f admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:17.154574 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:17.155179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:17.155488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:17.155765 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:17.222881 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:17.224630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19b501-8fc2-4b5c-84f8-fa21fccb0090 service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:17.235351 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4244/8529] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:15:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:15:23.999668 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:15:24.002441 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:24.084638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d246d7-3ecb-4857-811c-7eb650e843ee None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:15:24.088449 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:15:24.089226 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:24.089582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:24.089857 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:24.100963 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:15:24.110739 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6920311-5ddf-4f2c-b310-25d67b2986e9 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:15:24.113510 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4286/8530] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:15:23 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:15:27.243686 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=35 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:28.618326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1944-b07d-4aa9-b2ed-2cc2b8f42ff5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:28.619039 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1944-b07d-4aa9-b2ed-2cc2b8f42ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:28.619877 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1944-b07d-4aa9-b2ed-2cc2b8f42ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:28.656985 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-64ff1944-b07d-4aa9-b2ed-2cc2b8f42ff5 None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:28.659214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-64ff1944-b07d-4aa9-b2ed-2cc2b8f42ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:28.673386 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4245/8531] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:29.211201 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:29.212443 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:29.213397 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:15:29.221823 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:29.222693 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:15:29.223578 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4287/8532] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:15:29 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:15:34.108641 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=75 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:38.647826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:46.327628 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c208-2968-4271-940b-e82f6310c200 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:46.328842 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c208-2968-4271-940b-e82f6310c200 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:46.329313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547c208-2968-4271-940b-e82f6310c200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:46.375162 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3547c208-2968-4271-940b-e82f6310c200 None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:15:46.376723 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3547c208-2968-4271-940b-e82f6310c200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:15:46.384923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4246/8533] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:15:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:15:46.771780 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea25-e425-4cb4-b0e6-8843124ba9f0 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:15:46.772404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea25-e425-4cb4-b0e6-8843124ba9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:15:46.772404 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea25-e425-4cb4-b0e6-8843124ba9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-4768ea25-e425-4cb4-b0e6-8843124ba9f0 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:15:46.780743 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:15:46.781844 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:15:46.782835 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4288/8534] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:15:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:15:56.357373 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:04.133281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246442-54a7-46d6-ad2a-3d8bc8956e74 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:04.134327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246442-54a7-46d6-ad2a-3d8bc8956e74 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:04.134327 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246442-54a7-46d6-ad2a-3d8bc8956e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:04.162585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-97246442-54a7-46d6-ad2a-3d8bc8956e74 None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:04.164155 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-97246442-54a7-46d6-ad2a-3d8bc8956e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:04.173326 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4247/8535] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:04.617878 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37595-2a40-42c8-815e-73612445aaf8 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:04.618688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37595-2a40-42c8-815e-73612445aaf8 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:04.618688 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e37595-2a40-42c8-815e-73612445aaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-e7e37595-2a40-42c8-815e-73612445aaf8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:16:04.626505 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:04.627626 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:16:04.629525 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4289/8536] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:16:04 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:16:14.155326 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:20.953843 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef38c2-ddeb-460c-b0ec-5da87a713c00 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:20.954630 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef38c2-ddeb-460c-b0ec-5da87a713c00 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:20.954970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef38c2-ddeb-460c-b0ec-5da87a713c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:20.991392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-d8ef38c2-ddeb-460c-b0ec-5da87a713c00 None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:20.993055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-d8ef38c2-ddeb-460c-b0ec-5da87a713c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:21.001340 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4248/8537] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 02 13:16:21.834721 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a108-e096-4c41-adae-e4555828e450 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:21.835311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a108-e096-4c41-adae-e4555828e450 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:21.835451 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8a108-e096-4c41-adae-e4555828e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-ade8a108-e096-4c41-adae-e4555828e450 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:16:21.848076 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:21.864624 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:16:21.869553 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4290/8538] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:16:21 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 17 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:16:30.983541 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:38.863879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:38.864599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:38.864599 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:38.891116 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] MFA Rules not processed for user `6137db77c8154928a3e0e57c0ecca3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:38.892422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:38.906319 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4249/8539] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:39.319483 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd852-6d5e-4598-a5bb-9704c93cfc56 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:39.320039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd852-6d5e-4598-a5bb-9704c93cfc56 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:39.320039 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffd852-6d5e-4598-a5bb-9704c93cfc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-27ffd852-6d5e-4598-a5bb-9704c93cfc56 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:16:39.331106 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:16:39.332012 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:16:39.334791 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4291/8540] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:16:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 16 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:16:43.616868 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:43.684790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b9cee-7026-45a1-b4ee-fc1269cb1544 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:43.690581 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:43.691234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:43.691504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:43.691782 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] PATH_INFO: `/v3/users/6137db77c8154928a3e0e57c0ecca3dc` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:43.693052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6137db77c8154928a3e0e57c0ecca3dc)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:43.695018 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:43.917137 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6137db77c8154928a3e0e57c0ecca3dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.047547 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6137db77c8154928a3e0e57c0ecca3dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.061564 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6137db77c8154928a3e0e57c0ecca3dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.062281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6137db77c8154928a3e0e57c0ecca3dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.062992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6137db77c8154928a3e0e57c0ecca3dc'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.076605 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4250/8541] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:16:43 2022] DELETE /identity/v3/users/6137db77c8154928a3e0e57c0ecca3dc => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:44.081506 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:44.082103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:44.082103 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:44.102252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:44.103467 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:44.167421 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4292/8542] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:44.177504 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:44.178967 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:44.242148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73fc63-a5a6-4d57-aded-dc810e0c1b74 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:44.246497 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:44.247109 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:44.247429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:44.247719 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:44.257623 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:44.259072 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:44.269184 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4251/8543] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:16:44.616908 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:44.622871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:44.632710 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bfffd-69bb-4c93-afd2-ebc94cb4041f None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:44.637987 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:44.638758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:44.639044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:44.640002 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] PATH_INFO: `/v3/projects/ef4f1f1efde142479f284d0edca2e143` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:44.641553 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4f1f1efde142479f284d0edca2e143)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:44.643596 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:44.802753 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4f1f1efde142479f284d0edca2e143', 'request_id': 'req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.809766 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4f1f1efde142479f284d0edca2e143', 'request_id': 'req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.817792 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4f1f1efde142479f284d0edca2e143', 'request_id': 'req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.901318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] The token cache is being invalidate because project ef4f1f1efde142479f284d0edca2e143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:16:44.901611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.902849 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:44.904387 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4293/8544] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:16:44 2022] DELETE /identity/v3/projects/ef4f1f1efde142479f284d0edca2e143 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:44.908629 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:44.921408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6a2d5-ad4e-4322-a4df-1940653a1f0e service neutron] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:44.937242 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:44.995513 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:44.996209 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:44.996517 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:44.996801 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] PATH_INFO: `/v3/users/e5e0ba72a02f46f193ff5e7ddc135cb5` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:44.998078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e0ba72a02f46f193ff5e7ddc135cb5)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:45.000132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:45.493560 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e0ba72a02f46f193ff5e7ddc135cb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:45.734882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e0ba72a02f46f193ff5e7ddc135cb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:45.751345 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e0ba72a02f46f193ff5e7ddc135cb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:45.753170 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e0ba72a02f46f193ff5e7ddc135cb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:45.753834 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-0e2062d5-0c8d-439c-abc5-981320a07e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e0ba72a02f46f193ff5e7ddc135cb5'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:45.767356 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4252/8545] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:16:44 2022] DELETE /identity/v3/users/e5e0ba72a02f46f193ff5e7ddc135cb5 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:46.313724 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:46.315561 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:46.330051 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1615ef7-eb66-4e9e-b78b-c0c5d3ede783 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:46.397199 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:46.397871 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:46.398148 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:46.398421 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] PATH_INFO: `/v3/projects/5956bd5553cf48a4aba0d194ebd1949a` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:46.399592 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5956bd5553cf48a4aba0d194ebd1949a)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:46.401598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:46.542728 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:46.562326 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5956bd5553cf48a4aba0d194ebd1949a', 'request_id': 'req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:46.569729 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5956bd5553cf48a4aba0d194ebd1949a', 'request_id': 'req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:46.577027 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5956bd5553cf48a4aba0d194ebd1949a', 'request_id': 'req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:46.672257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] The token cache is being invalidate because project 5956bd5553cf48a4aba0d194ebd1949a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:16:46.672692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:46.673423 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-00d70213-bd9d-4dcd-95bf-fcad8d1c00ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:16:46.675090 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4294/8546] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:16:46 2022] DELETE /identity/v3/projects/5956bd5553cf48a4aba0d194ebd1949a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:46.680833 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:46.682012 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:46.682488 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:46.705982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:46.707234 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:46.769606 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4253/8547] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:46.778055 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:46.778335 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:46.778611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:46.800134 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:46.801379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:46.810558 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4295/8548] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:46.815306 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:46.825970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b40f-4b89-409a-b336-d90042cddd2e None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:46.830845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:46.831455 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:46.831730 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:46.831997 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:46.832683 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:16:46.832982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:46.834600 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:46.847154 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4254/8549] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 02 13:16:46.851431 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:46.861715 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695bcd5-9ec2-4bb5-8ebf-026f3e436cb4 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:46.866707 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:46.867313 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:46.867589 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:46.867851 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:46.868584 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:46.870971 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.000833 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4296/8550] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:16:46 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:16:47.005959 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:47.017008 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55fce-5c7c-407c-8b76-4263f765bebd admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:47.040615 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:47.092999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:47.093530 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.093811 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.094078 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.094708 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:47.096659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.207982 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4255/8551] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:16:47 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:16:47.212610 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:47.223846 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb61bd4-ed9b-4a1e-b6d0-0fff31b48ccf admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:47.229169 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:47.230327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.230582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.230852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.231494 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:47.233150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.244151 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4297/8552] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:16:47.250826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:47.262457 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2c54b-2b41-4f15-999e-a8fd8b56f4a9 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:47.267272 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:47.267889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.268179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.268479 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.269142 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:47.270768 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad222983-f21b-4235-82ed-32ac788482a5 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.285349 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4256/8553] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:16:47.286831 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:47.298357 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c8ab-1056-40a2-ac71-55a2b110a740 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:47.303324 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:47.303997 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.304277 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.304611 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] PATH_INFO: `/v3/projects/9e3de9fd53764accb2dd11608029c233/users/98eab8120e6548789f45589fa8530762/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.323518 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3de9fd53764accb2dd11608029c233, user_id=98eab8120e6548789f45589fa8530762, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:47.326273 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.415208 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4298/8554] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:16:47 2022] PUT /identity/v3/projects/9e3de9fd53764accb2dd11608029c233/users/98eab8120e6548789f45589fa8530762/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:47.421677 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603e37-0514-413f-bd13-67957ab69a61 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.421976 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603e37-0514-413f-bd13-67957ab69a61 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.422262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603e37-0514-413f-bd13-67957ab69a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.443996 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-17603e37-0514-413f-bd13-67957ab69a61 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:47.445281 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-17603e37-0514-413f-bd13-67957ab69a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:47.520734 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4257/8555] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:47.532598 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:47.534919 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:47.604810 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfbad5-f4e5-43fb-9e45-923af9f64771 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:47.609269 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:47.609886 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:47.610160 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:47.610429 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:47.621535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:47.623044 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:47.633972 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4299/8556] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:16:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:16:54.483202 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:54.483739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:54.483739 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:54.516063 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] MFA Rules not processed for user `98eab8120e6548789f45589fa8530762`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:16:54.517678 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:16:54.603468 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4258/8557] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:16:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:16:54.608033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:54.618217 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45c887-570c-46ec-8ece-da9e73e46289 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:54.623036 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:54.623576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:54.623854 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:54.624141 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:54.624841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:54.626784 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:54.786714 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4300/8558] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:16:54 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:16:54.791271 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:54.803542 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91584c-0c14-408e-89e7-d415b62e74fa None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:54.841148 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:54.882962 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:54.883689 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:54.884028 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:54.884363 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:54.885114 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:54.887856 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:55.200938 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4259/8559] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:16:54 2022] POST /identity/v3/users => generated 293 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:16:55.205447 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:55.219356 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee0747-184d-4352-bbae-ca91cf01073b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:55.224972 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:55.225808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:55.226188 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:55.226583 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:55.227521 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:55.229338 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:55.242138 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4301/8560] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:16:55.250662 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:55.262236 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec7a24-80e5-4873-ab30-fd2e3e0f16e8 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:55.267264 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:55.267951 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:55.268227 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:55.268531 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] PATH_INFO: `/v3/projects/37a935bb200744fc95cd49614329c222/users/5c5611de06314f3bad6bf04d2ec17c43/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:55.289714 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a935bb200744fc95cd49614329c222, user_id=5c5611de06314f3bad6bf04d2ec17c43, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:55.293062 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:55.407555 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4260/8561] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:16:55 2022] PUT /identity/v3/projects/37a935bb200744fc95cd49614329c222/users/5c5611de06314f3bad6bf04d2ec17c43/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:16:55.411796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:55.423028 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb77a19-cc91-4e6b-832d-65a69a197c9c admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:55.450472 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:55.495032 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:55.496582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:55.496863 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:55.497257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:55.497931 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:55.499536 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee3b635-ef26-4a18-b13c-b768ecfd1a05 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:55.511662 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4302/8562] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:16:55.522239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:16:55.534585 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ecc68-67be-41c6-9ad5-a2b8f5623363 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:16:55.541015 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:16:55.542770 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:16:55.543151 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:16:55.543429 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] PATH_INFO: `/v3/projects/37a935bb200744fc95cd49614329c222/users/5c5611de06314f3bad6bf04d2ec17c43/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:16:55.545992 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a935bb200744fc95cd49614329c222, user_id=5c5611de06314f3bad6bf04d2ec17c43, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:16:55.549036 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:16:55.565468 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4261/8563] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:16:55 2022] PUT /identity/v3/projects/37a935bb200744fc95cd49614329c222/users/5c5611de06314f3bad6bf04d2ec17c43/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:02.261655 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ee2e-1b3d-4fa6-b5f9-9e2f8e1e937c None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:02.262207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ee2e-1b3d-4fa6-b5f9-9e2f8e1e937c None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:02.262207 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84ee2e-1b3d-4fa6-b5f9-9e2f8e1e937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:02.297959 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bb84ee2e-1b3d-4fa6-b5f9-9e2f8e1e937c None None] MFA Rules not processed for user `5c5611de06314f3bad6bf04d2ec17c43`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:02.299331 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bb84ee2e-1b3d-4fa6-b5f9-9e2f8e1e937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:02.406488 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4303/8564] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:02.430262 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:02.445671 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:02.561484 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7b01e-2a28-49cf-8c15-f5a4c2d7f598 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:02.567982 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:02.568651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:02.568931 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:02.569199 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:02.635035 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:02.637320 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:02.648027 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4262/8565] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 02 13:17:06.319664 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed7a-2cbf-4b24-9ec3-5e786613fc29 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:06.320246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed7a-2cbf-4b24-9ec3-5e786613fc29 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:06.320246 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed7a-2cbf-4b24-9ec3-5e786613fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:06.341834 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-7013ed7a-2cbf-4b24-9ec3-5e786613fc29 None None] MFA Rules not processed for user `98eab8120e6548789f45589fa8530762`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:06.343072 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-7013ed7a-2cbf-4b24-9ec3-5e786613fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:06.350373 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4304/8566] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:06.389219 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:06.390667 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:06.415718 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:06.467396 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb151f6-e9f8-4d5b-9256-d07d04ab3faf service nova] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:06.471329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7bca0e59f8374e88bc91ef8145bb7f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:06.471937 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:06.472214 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:06.472495 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:06.474323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:06.494323 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:06.496382 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e614834-6af9-4927-b24c-aef80b0e0c43 service glance] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:06.513830 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4263/8567] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:17:06.829117 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:06.829559 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:06.829930 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:17:06.837556 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:17:06.839179 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:17:06.841126 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4305/8568] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:17:06 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Nov 02 13:17:11.744188 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a8c-67a2-4047-9a45-e95974dab10c None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:11.744819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a8c-67a2-4047-9a45-e95974dab10c None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:11.744819 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a8c-67a2-4047-9a45-e95974dab10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:11.765794 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-ff7b6a8c-67a2-4047-9a45-e95974dab10c None None] MFA Rules not processed for user `98eab8120e6548789f45589fa8530762`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:11.767179 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-ff7b6a8c-67a2-4047-9a45-e95974dab10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:11.778665 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4264/8569] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:16.336569 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=57 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:21.758999 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=24 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:36.112873 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:36.115680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:36.257881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4d133-da42-4850-a40d-dfa4caf412f6 None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:36.263806 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b073a335e944427a8560a4864364434', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:36.264565 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:36.264847 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:36.265116 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:36.268013 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:36.299692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:36.302692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:36.327277 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4306/8570] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:17:36.777950 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:36.778646 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:36.779146 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:17:36.793201 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:17:36.795071 n-d-857339-6 devstack@keystone.service[82132]: ERROR keystone.server.flask.application Nov 02 13:17:36.796975 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4265/8571] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:17:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:17:45.912582 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:45.914162 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:46.016015 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8289b0-bd4f-45f3-85c7-8005438c2a32 service cinder] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:46.021157 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:46.021764 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:46.022043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:46.022318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:46.024062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:46.039450 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:46.041694 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:46.055604 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4307/8572] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:17:46.149129 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:46.221434 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c002a6e-3125-4f1f-bf70-4ac8395f515a None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:46.226494 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:46.227132 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:46.227408 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:46.227687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] PATH_INFO: `/v3/users/98eab8120e6548789f45589fa8530762` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:46.228941 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98eab8120e6548789f45589fa8530762)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:46.230909 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:46.490297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98eab8120e6548789f45589fa8530762'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:46.607420 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98eab8120e6548789f45589fa8530762'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:46.623394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98eab8120e6548789f45589fa8530762'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:46.624313 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98eab8120e6548789f45589fa8530762'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:46.625112 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98eab8120e6548789f45589fa8530762'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:46.639343 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4266/8573] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:17:46 2022] DELETE /identity/v3/users/98eab8120e6548789f45589fa8530762 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:46.969763 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:46.981526 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a40de-3c1c-41b7-b994-3f4c40433d82 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:47.048361 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:47.049026 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:47.049311 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:47.049585 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] PATH_INFO: `/v3/projects/9e3de9fd53764accb2dd11608029c233` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:47.050734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3de9fd53764accb2dd11608029c233)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:47.052746 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:47.072881 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=100 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:47.371629 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3de9fd53764accb2dd11608029c233', 'request_id': 'req-de609326-96c8-4f35-88f7-0b4ac880c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:47.383034 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3de9fd53764accb2dd11608029c233', 'request_id': 'req-de609326-96c8-4f35-88f7-0b4ac880c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:47.393250 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3de9fd53764accb2dd11608029c233', 'request_id': 'req-de609326-96c8-4f35-88f7-0b4ac880c0ec'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:47.591522 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] The token cache is being invalidate because project 9e3de9fd53764accb2dd11608029c233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:17:47.591817 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:47.592633 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:47.594186 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4308/8574] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:17:46 2022] DELETE /identity/v3/projects/9e3de9fd53764accb2dd11608029c233 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:47.598633 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:47.600319 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:47.614812 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a5489-dbba-469f-9bac-1de32a849c4c admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:47.673826 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:47.674467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:47.674750 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:47.675017 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] PATH_INFO: `/v3/users/5c5611de06314f3bad6bf04d2ec17c43` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:47.676183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5611de06314f3bad6bf04d2ec17c43)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:47.678147 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:47.705817 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:47.977093 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5611de06314f3bad6bf04d2ec17c43'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.149638 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5611de06314f3bad6bf04d2ec17c43'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.163070 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5611de06314f3bad6bf04d2ec17c43'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.163781 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5611de06314f3bad6bf04d2ec17c43'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.164385 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-7e016310-b4b3-49ea-bc76-115fbc5e7d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5611de06314f3bad6bf04d2ec17c43'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.178346 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4267/8575] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:17:47 2022] DELETE /identity/v3/users/5c5611de06314f3bad6bf04d2ec17c43 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:48.512296 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:48.514003 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:48.527232 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de609326-96c8-4f35-88f7-0b4ac880c0ec admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:48.595366 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:48.596033 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:48.596312 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:48.596685 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] PATH_INFO: `/v3/projects/37a935bb200744fc95cd49614329c222` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:48.598006 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a935bb200744fc95cd49614329c222)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:48.599969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:48.730434 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a935bb200744fc95cd49614329c222', 'request_id': 'req-53eab7cc-e86e-46ea-98ec-3875572fb061'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.736984 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a935bb200744fc95cd49614329c222', 'request_id': 'req-53eab7cc-e86e-46ea-98ec-3875572fb061'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.742904 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a935bb200744fc95cd49614329c222', 'request_id': 'req-53eab7cc-e86e-46ea-98ec-3875572fb061'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.831234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] The token cache is being invalidate because project 37a935bb200744fc95cd49614329c222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:17:48.831480 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.832114 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-53eab7cc-e86e-46ea-98ec-3875572fb061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:17:48.833676 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4309/8576] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:17:48 2022] DELETE /identity/v3/projects/37a935bb200744fc95cd49614329c222 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:48.839340 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:48.839900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:48.839900 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:48.864802 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:48.866052 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:48.939627 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4268/8577] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:48.950071 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:48.950576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:48.950882 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:48.975706 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.auth.core [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:48.976979 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:48.985803 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4310/8578] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:48.990544 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.003632 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626749af-a3ab-4050-bf05-9a81e8ef5091 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.010249 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.010807 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.011086 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.011418 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] PATH_INFO: `/v3/domains` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.012088 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82132) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 02 13:17:49.012393 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.014082 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.026997 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4269/8579] 10.222.0.64 () {58 vars in 1153 bytes} [Wed Nov 2 13:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 02 13:17:49.031679 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.041964 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaca166-0fde-451e-af09-ed53755585fb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.047287 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.048329 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.048716 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.049021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.050079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.052535 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.175677 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4311/8580] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:17:49 2022] POST /identity/v3/projects => generated 375 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:17:49.180057 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.191467 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bee27-6335-4d35-b117-b07fbd5bf386 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.256449 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.257673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.257673 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.257882 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.258514 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.260444 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.390923 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4270/8581] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:17:49 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:17:49.395068 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.401995 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:49.406628 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2570ba9-364f-400f-893b-68a3c39fc489 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.411519 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.412136 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.412414 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.413030 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.413371 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.415021 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.426649 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4312/8582] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 02 13:17:49.431862 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.442981 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7806ff-7326-41b2-9037-599d1817abef admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.448753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.449372 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.449715 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.450020 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.450707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.452511 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4df00-881f-4e94-aad2-e7b6eb578c04 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.464456 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4271/8583] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:17:49.468924 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.480650 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3c76-bbff-4836-89d2-39c923d23fd9 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.485460 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.486130 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] REQUEST_METHOD: `PUT` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.486407 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.486681 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] PATH_INFO: `/v3/projects/045c48f108df42c9b839fa7b5ce32cea/users/f9de36669f8b420299e8efbf62442d9b/roles/8a005951b7924bba902f57f978fd27d0` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.505085 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045c48f108df42c9b839fa7b5ce32cea, user_id=f9de36669f8b420299e8efbf62442d9b, role_id=8a005951b7924bba902f57f978fd27d0)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.507835 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.677112 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4313/8584] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:17:49 2022] PUT /identity/v3/projects/045c48f108df42c9b839fa7b5ce32cea/users/f9de36669f8b420299e8efbf62442d9b/roles/8a005951b7924bba902f57f978fd27d0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:49.690297 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a3fd-8133-4249-ad67-5fd6da6a6c60 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.690582 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a3fd-8133-4249-ad67-5fd6da6a6c60 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.690857 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7a3fd-8133-4249-ad67-5fd6da6a6c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.699398 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:49.710534 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-aaa7a3fd-8133-4249-ad67-5fd6da6a6c60 None None] MFA Rules not processed for user `d787a32a40cf4bfab2a0a7e140cad17b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:49.711753 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-aaa7a3fd-8133-4249-ad67-5fd6da6a6c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:49.806732 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4272/8585] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:49.817093 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:49.818844 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:49.889300 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de602-9268-42d7-9c24-90f716ed8391 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:49.893062 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b46383fc54d5469884898c1b75ce41ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:49.893758 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:49.893946 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:49.894220 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:49.904802 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:49.906262 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:49.917016 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4314/8586] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:17:57.458239 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:57.459401 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:57.460058 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:57.500889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] MFA Rules not processed for user `f9de36669f8b420299e8efbf62442d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:17:57.502889 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:57.618307 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4273/8587] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:17:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:17:57.623840 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:57.636808 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54ce70-6e3c-4715-965b-cea9bc5a5168 service neutron] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:57.642580 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:57.643222 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:57.643495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:57.643929 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] PATH_INFO: `/v3/projects` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:57.644852 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:57.646962 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:57.777537 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4315/8588] 10.222.0.64 () {60 vars in 1153 bytes} [Wed Nov 2 13:17:57 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 02 13:17:57.780295 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:57.792552 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df0d40-475c-45f7-af7a-ecbbc24d0685 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:57.867566 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:57.868722 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:57.869009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:57.869276 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:57.869904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:57.871893 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:57.971124 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4274/8589] 10.222.0.64 () {60 vars in 1144 bytes} [Wed Nov 2 13:17:57 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 02 13:17:57.976150 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:57.989789 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461ad3-1033-4008-8aa6-19abd8724691 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:57.996178 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:57.996839 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:57.997128 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:57.997393 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:57.998043 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:57.999692 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:58.013004 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4316/8590] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:17:58.018970 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:58.028661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935c90a-c3bd-4123-a850-fed8f06205f6 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:58.033399 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:58.034055 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:58.034329 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:58.034658 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] PATH_INFO: `/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4/users/8aa21b62f8f54a4d8589b7bca3cbe913/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:58.051816 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf7b9ad61db4c4fa1ff3039e08d65f4, user_id=8aa21b62f8f54a4d8589b7bca3cbe913, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:58.054546 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:58.135371 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:58.140365 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4275/8591] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:17:58 2022] PUT /identity/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4/users/8aa21b62f8f54a4d8589b7bca3cbe913/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:58.152218 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:58.162841 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac1ec0-e78f-42e1-93e8-3bc4b5fffe79 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:58.222495 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a933a-3168-4025-946d-907523d8155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:58.223104 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a933a-3168-4025-946d-907523d8155b admin admin] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:58.223379 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a933a-3168-4025-946d-907523d8155b admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:58.223645 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a933a-3168-4025-946d-907523d8155b admin admin] PATH_INFO: `/v3/roles` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:58.224327 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a933a-3168-4025-946d-907523d8155b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:58.225907 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a933a-3168-4025-946d-907523d8155b admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:58.236625 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4317/8592] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 13:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 02 13:17:58.241687 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:58.252929 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48b92-2bfd-4ef9-bb10-c2d0fd419b36 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:58.257659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:58.258302 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] REQUEST_METHOD: `PUT` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:58.258571 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:58.258894 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] PATH_INFO: `/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4/users/8aa21b62f8f54a4d8589b7bca3cbe913/roles/4a6c8234b6f1406c9820f1c2b4c94c32` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:58.260759 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf7b9ad61db4c4fa1ff3039e08d65f4, user_id=8aa21b62f8f54a4d8589b7bca3cbe913, role_id=4a6c8234b6f1406c9820f1c2b4c94c32)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:58.263404 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd90ec-ae99-4cc9-8e1a-917501d5665b admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:58.274618 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4276/8593] 10.222.0.64 () {60 vars in 1483 bytes} [Wed Nov 2 13:17:58 2022] PUT /identity/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4/users/8aa21b62f8f54a4d8589b7bca3cbe913/roles/4a6c8234b6f1406c9820f1c2b4c94c32 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:17:58.971625 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a933a-3168-4025-946d-907523d8155b admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:17:58.973992 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-315a933a-3168-4025-946d-907523d8155b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:59.029734 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:59.072377 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a933a-3168-4025-946d-907523d8155b admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:17:59.175680 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:17:59.176318 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:17:59.176675 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:17:59.176954 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:17:59.179070 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:17:59.195856 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:17:59.198035 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:17:59.211796 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4318/8594] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:17:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:18:05.717879 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997810-a2d1-490f-b179-ce989edf60e5 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:05.718370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997810-a2d1-490f-b179-ce989edf60e5 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:05.718452 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06997810-a2d1-490f-b179-ce989edf60e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:05.753952 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-06997810-a2d1-490f-b179-ce989edf60e5 None None] MFA Rules not processed for user `8aa21b62f8f54a4d8589b7bca3cbe913`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:18:05.755312 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-06997810-a2d1-490f-b179-ce989edf60e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:18:05.837366 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4277/8595] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:18:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:18:05.854079 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:18:05.855576 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:18:05.949773 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cdf549-7867-43b3-bc15-b6478ba6ac66 service placement] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:18:05.965257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c48d278dd82d4be0b5a79b225c962d1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:18:05.965257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:05.965257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:05.965257 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:06.025405 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:18:06.027025 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2a5f9-52ed-43e7-9541-af6a4e9ed03d service nova] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:18:06.037230 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4319/8596] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:18:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:18:10.348183 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] REQUEST_METHOD: `POST` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:10.348761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:10.348761 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:10.368725 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.auth.core [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] MFA Rules not processed for user `f9de36669f8b420299e8efbf62442d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82132) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 02 13:18:10.369946 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:18:10.377018 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4278/8597] 10.222.0.64 () {58 vars in 958 bytes} [Wed Nov 2 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 02 13:18:10.701123 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] REQUEST_METHOD: `POST` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:10.701656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:10.701656 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Traceback (most recent call last): Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Nov 02 13:18:10.708384 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application return f(*args, **kwargs) Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Nov 02 13:18:10.709515 n-d-857339-6 devstack@keystone.service[82131]: ERROR keystone.server.flask.application Nov 02 13:18:10.710623 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4320/8598] 10.222.0.64 () {58 vars in 1009 bytes} [Wed Nov 2 13:18:10 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 9 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Nov 02 13:18:16.032635 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=98 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:20.100370 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:18:20.168775 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345947bc-c49f-41fb-ab98-811202f19af8 None None] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:18:20.173461 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:18:20.174115 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:20.174392 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:20.174707 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] PATH_INFO: `/v3/users/f9de36669f8b420299e8efbf62442d9b` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:20.175786 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9de36669f8b420299e8efbf62442d9b)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:18:20.177791 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:18:20.433394 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9de36669f8b420299e8efbf62442d9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:20.543845 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9de36669f8b420299e8efbf62442d9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:20.557661 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:20.561354 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9de36669f8b420299e8efbf62442d9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:20.562348 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9de36669f8b420299e8efbf62442d9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:20.562955 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9de36669f8b420299e8efbf62442d9b'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:20.576232 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4279/8599] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:18:20 2022] DELETE /identity/v3/users/f9de36669f8b420299e8efbf62442d9b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:18:20.874473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:18:20.874473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:18:20.956975 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6be90-4f40-4840-b3e9-80478d57eefb None None] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:18:20.965305 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:18:20.965969 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:20.966252 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:20.966638 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] PATH_INFO: `/v3/projects/045c48f108df42c9b839fa7b5ce32cea` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:20.968197 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=045c48f108df42c9b839fa7b5ce32cea)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:18:20.970323 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:18:21.179229 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045c48f108df42c9b839fa7b5ce32cea', 'request_id': 'req-0201d430-062f-4251-858c-3cfbe8857bd6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.186156 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045c48f108df42c9b839fa7b5ce32cea', 'request_id': 'req-0201d430-062f-4251-858c-3cfbe8857bd6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.192241 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045c48f108df42c9b839fa7b5ce32cea', 'request_id': 'req-0201d430-062f-4251-858c-3cfbe8857bd6'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.286913 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] The token cache is being invalidate because project 045c48f108df42c9b839fa7b5ce32cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:18:21.287202 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.287880 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.289664 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4321/8600] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:18:20 2022] DELETE /identity/v3/projects/045c48f108df42c9b839fa7b5ce32cea => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:18:21.293780 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:18:21.313085 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42500f-54fc-40fb-b9ae-0cb769da0fe7 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:18:21.374317 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:18:21.375045 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:21.375246 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:21.375510 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] PATH_INFO: `/v3/users/8aa21b62f8f54a4d8589b7bca3cbe913` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:21.376675 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa21b62f8f54a4d8589b7bca3cbe913)` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:18:21.378651 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:18:21.712458 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa21b62f8f54a4d8589b7bca3cbe913'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.835181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa21b62f8f54a4d8589b7bca3cbe913'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.851790 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa21b62f8f54a4d8589b7bca3cbe913'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.853286 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa21b62f8f54a4d8589b7bca3cbe913'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.854051 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.notifications [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa21b62f8f54a4d8589b7bca3cbe913'} {{(pid=82132) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:21.867388 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4280/8601] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 13:18:21 2022] DELETE /identity/v3/users/8aa21b62f8f54a4d8589b7bca3cbe913 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:18:22.356996 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:18:22.358796 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:18:22.376422 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201d430-062f-4251-858c-3cfbe8857bd6 admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:18:22.443091 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd787a32a40cf4bfab2a0a7e140cad17b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a77a9a466b3c4a1db84a2273ce5d6a0e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:18:22.443803 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:18:22.444118 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:18:22.444435 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] PATH_INFO: `/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:18:22.445813 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf7b9ad61db4c4fa1ff3039e08d65f4)` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:18:22.448319 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:18:22.589916 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:22.601935 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf7b9ad61db4c4fa1ff3039e08d65f4', 'request_id': 'req-61fda994-11a1-434b-8796-bd4bd4b107ed'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:22.608190 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf7b9ad61db4c4fa1ff3039e08d65f4', 'request_id': 'req-61fda994-11a1-434b-8796-bd4bd4b107ed'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:22.613738 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf7b9ad61db4c4fa1ff3039e08d65f4', 'request_id': 'req-61fda994-11a1-434b-8796-bd4bd4b107ed'} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:22.783084 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] The token cache is being invalidate because project 7bf7b9ad61db4c4fa1ff3039e08d65f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 02 13:18:22.783337 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:22.784057 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.notifications [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 02 13:18:22.785622 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4322/8602] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 13:18:22 2022] DELETE /identity/v3/projects/7bf7b9ad61db4c4fa1ff3039e08d65f4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 02 13:18:31.863806 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:DELETE=11,keystone:SELECT=59,keystone:INSERT=1 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:32.863309 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:19:09.871904 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Authenticating user token {{(pid=82132) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:19:09.873361 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:19:09.985009 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280aa508-8630-4d68-ac55-27209aa090b2 admin admin] Validating token access rules against request {{(pid=82132) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:19:10.046619 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82132) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:19:10.047145 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] REQUEST_METHOD: `GET` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:19:10.047422 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] SCRIPT_NAME: `/identity` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:19:10.047695 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82132) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:19:10.049551 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.fernet_utils [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82132) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:19:10.064181 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:19:10.065804 n-d-857339-6 devstack@keystone.service[82132]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474477-8218-4915-a604-0a0605ff2a13 service placement] RBAC: Authorization granted {{(pid=82132) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:19:10.079122 n-d-857339-6 devstack@keystone.service[82132]: [pid: 82132|app: 0|req: 4281/8603] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:19:20.071659 n-d-857339-6 devstack@keystone.service[82132]: DEBUG dbcounter [-] [82132] Writing DB stats keystone:SELECT=72 {{(pid=82132) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:23:03.967089 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Authenticating user token {{(pid=82131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 02 13:23:03.968859 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:23:04.025463 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fda994-11a1-434b-8796-bd4bd4b107ed admin admin] Validating token access rules against request {{(pid=82131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 02 13:23:04.031288 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6af56c33cae041dfbfe1cddcd37db3ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba600d2ed70a473da94973c7bf9a691d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 02 13:23:04.031914 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] REQUEST_METHOD: `GET` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 02 13:23:04.032196 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] SCRIPT_NAME: `/identity` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 02 13:23:04.032473 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 02 13:23:04.034557 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.fernet_utils [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 02 13:23:04.051234 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 02 13:23:04.052874 n-d-857339-6 devstack@keystone.service[82131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c3711-961c-4fd5-b585-7dab172bf8ee service placement] RBAC: Authorization granted {{(pid=82131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 02 13:23:04.068051 n-d-857339-6 devstack@keystone.service[82131]: [pid: 82131|app: 0|req: 4323/8604] 10.222.0.64 () {60 vars in 1365 bytes} [Wed Nov 2 13:23:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 02 13:23:14.059231 n-d-857339-6 devstack@keystone.service[82131]: DEBUG dbcounter [-] [82131] Writing DB stats keystone:SELECT=22 {{(pid=82131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}